Skip to content

A computer, compiled into the weights of a language model. An exact CPU inside Qwen3.5-4B, with Gated DeltaNet state as RAM.

hidden-reasoning: 6 seeds per OLMo-Hybrid arm, four-switch task results

divagr180043088af423
diff --git a/research/hidden-reasoning/README.md b/research/hidden-reasoning/README.md
index 8849786..3c174f1 100644
--- a/research/hidden-reasoning/README.md
+++ b/research/hidden-reasoning/README.md
@@ -11,10 +11,21 @@ Answer-only accuracy on parity (the light-switch task), trained up to 64 flips,
| Model | GDN write strength β | Accuracy at 128 flips |
|---|---|---|
-| OLMo-Hybrid-7B | up to 2 | 0.80 (3 seeds: 0.97, 0.53, 0.89) |
-| OLMo-Hybrid-7B, β capped at 1 | up to 1 | 0.52 (3 seeds: 0.53, 0.54, 0.50) |
-| Qwen3.5-4B | up to 1 | 0.55 |
-| OLMo-3-7B (dense control) | none | 0.54 |
+| OLMo-Hybrid-7B | up to 2 | 0.89 (6 seeds, 0.53 to 1.00) |
+| OLMo-Hybrid-7B, β capped at 1 | up to 1 | 0.52 (6 seeds, 0.49 to 0.56) |
+| Qwen3.5-4B | up to 1 | 0.55 (3 seeds) |
+| OLMo-3-7B (dense control) | none | 0.54 (3 seeds) |
+
+Counting runs that learned the training range (at least 0.85 at 64 flips) and still scored at least 0.80 at 128:
+
+| Model | Learned 64 flips | Of those, held at 128 |
+|---|---|---|
+| OLMo-Hybrid-7B | 5 of 6 | 5 of 5 |
+| OLMo-Hybrid-7B, β capped at 1 | 2 of 6 | 0 of 2 |
+| Qwen3.5-4B | 2 of 3 | 0 of 2 |
+| OLMo-3-7B | 0 of 3 | none |
+
+Over all runs, 5 of 6 against 0 of 6 for the two OLMo-Hybrid arms (one-sided Fisher p ≈ 0.008). The cap also makes the training range harder, so the "learned it but didn't generalise" case under the cap rests on 2 OLMo-Hybrid runs plus 2 Qwen3.5 runs. Per-seed numbers are in `results/ft/seeds_table.md`.
Capping β costs OLMo-Hybrid about 3.5% perplexity on plain text.
@@ -22,11 +33,11 @@ Where the bit lives: swapping the DeltaNet state between sequences changes nothi
Compiled β = 2 trackers track parity exactly over 100k tokens, and a planted tracker inside Qwen3.5-4B is ranked 1st of 864 heads by a blind detector.
-This is 3 seeds per arm and one task, with artificial answer-only pressure, not an RL setup.
+This is 6 seeds per OLMo-Hybrid arm (3 for the others) and one task, with artificial answer-only pressure, not an RL setup. A four-switch version of the task (T5) was a negative result: both OLMo-Hybrid arms learned it at 16 flips and were at chance by 64, so it can't separate them.
## Layout
-- `hcot/tasks.py`: state-tracking tasks with exact answers (T2 is parity).
+- `hcot/tasks.py`: state-tracking tasks with exact answers (T2 is parity, T5 is four switches).
- `hcot/models.py`: model registry and chat formatting.
- `hcot/behave.py`: answer-only and CoT behaviour runs.
- `hcot/train.py`: answer-only LoRA fine-tuning, with the β and decay projections unfrozen.
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_answer.jsonl
new file mode 100644
index 0000000..f8e72c6
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_final_answer.jsonl
new file mode 100644
index 0000000..3e03d8c
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_final_val.jsonl
new file mode 100644
index 0000000..f5bb4c3
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_val.jsonl
new file mode 100644
index 0000000..f22ac9a
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s3_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_answer.jsonl
new file mode 100644
index 0000000..e7377b8
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_final_answer.jsonl
new file mode 100644
index 0000000..ee7e290
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_final_val.jsonl
new file mode 100644
index 0000000..8b976a8
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_val.jsonl
new file mode 100644
index 0000000..a8e0148
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s4_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_answer.jsonl
new file mode 100644
index 0000000..1153a79
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_final_answer.jsonl
new file mode 100644
index 0000000..3ca489a
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_final_val.jsonl
new file mode 100644
index 0000000..e418e93
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_val.jsonl
new file mode 100644
index 0000000..0b05e3b
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_cap_min_s5_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_answer.jsonl
new file mode 100644
index 0000000..8c22f74
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_final_answer.jsonl
new file mode 100644
index 0000000..b5394ae
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_final_val.jsonl
new file mode 100644
index 0000000..1399523
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_val.jsonl
new file mode 100644
index 0000000..1399523
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s3_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_answer.jsonl
new file mode 100644
index 0000000..3e24542
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_final_answer.jsonl
new file mode 100644
index 0000000..051e009
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_final_val.jsonl
new file mode 100644
index 0000000..1399523
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_val.jsonl
new file mode 100644
index 0000000..1399523
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s4_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_answer.jsonl
new file mode 100644
index 0000000..98eecab
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_final_answer.jsonl
new file mode 100644
index 0000000..4def8c9
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 82, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 162, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 194, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 210, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 258, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 322, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 578, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_final_val.jsonl
new file mode 100644
index 0000000..1399523
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_val.jsonl
new file mode 100644
index 0000000..1399523
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T2_stock_s5_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T2", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 130, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_answer.jsonl
new file mode 100644
index 0000000..8070264
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_final_answer.jsonl
new file mode 100644
index 0000000..5b5285b
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_final_val.jsonl
new file mode 100644
index 0000000..2146988
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_val.jsonl
new file mode 100644
index 0000000..c548b50
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s0_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_answer.jsonl
new file mode 100644
index 0000000..0c41980
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_final_answer.jsonl
new file mode 100644
index 0000000..413396c
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_final_val.jsonl
new file mode 100644
index 0000000..f93f3a4
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_val.jsonl
new file mode 100644
index 0000000..4ec9e7f
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s1_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_answer.jsonl
new file mode 100644
index 0000000..521bc53
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_final_answer.jsonl
new file mode 100644
index 0000000..4102b60
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_final_val.jsonl
new file mode 100644
index 0000000..bd8e3c9
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_val.jsonl
new file mode 100644
index 0000000..44ca235
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_cap_min_s2_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_answer.jsonl
new file mode 100644
index 0000000..a7b7a7c
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_final_answer.jsonl
new file mode 100644
index 0000000..73cce3a
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_final_val.jsonl
new file mode 100644
index 0000000..6bad361
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_val.jsonl
new file mode 100644
index 0000000..fa4004d
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s0_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_answer.jsonl
new file mode 100644
index 0000000..4d2c3a1
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_final_answer.jsonl
new file mode 100644
index 0000000..23f6e3f
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_final_val.jsonl
new file mode 100644
index 0000000..cca38a3
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_val.jsonl
new file mode 100644
index 0000000..0326757
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s1_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_answer.jsonl
new file mode 100644
index 0000000..891747e
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_final_answer.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_final_answer.jsonl
new file mode 100644
index 0000000..d5c3f5b
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_final_answer.jsonl
@@ -0,0 +1,800 @@
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 5, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 6, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 8, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 12, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 15, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 16, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 17, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 21, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 22, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 25, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 31, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 42, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 45, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 54, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 58, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 61, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 62, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 63, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 64, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 67, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 68, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 72, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 73, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 76, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 84, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 85, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 86, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 87, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 88, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 98, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 16, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 89, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 1, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 48, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 96, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 169, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 24, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 51, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 91, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 128, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 201, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 7, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 13, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 14, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 18, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 46, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 71, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 82, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 89, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 96, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 144, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 217, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 4, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 10, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 27, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 34, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 62, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 68, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 69, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 76, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 192, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 265, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 3, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 6, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 9, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 11, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 16, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 20, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 21, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 22, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 23, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 25, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 28, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 36, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 39, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 43, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 45, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 47, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 49, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 52, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 56, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 58, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 60, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 66, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 67, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 75, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 78, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 81, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 84, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 86, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 92, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 95, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 97, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 256, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 329, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 0, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 2, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 5, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 8, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 12, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 15, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 17, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 19, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 29, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 30, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 31, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 32, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 33, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 35, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 37, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 38, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 40, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 42, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 44, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 50, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 53, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 54, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 55, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 57, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 59, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 61, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 63, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 64, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 65, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 70, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 72, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 73, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 74, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 77, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 79, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 80, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 83, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 85, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 87, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 88, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 90, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 93, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 94, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 98, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 512, "idx": 99, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 585, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_final_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_final_val.jsonl
new file mode 100644
index 0000000..f522af2
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_final_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": false, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_val.jsonl b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_val.jsonl
new file mode 100644
index 0000000..dd4ccd8
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_T5_stock_s2_val.jsonl
@@ -0,0 +1,100 @@
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 0, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 1, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 2, "filler": 0, "answer": "0", "output": " 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "0", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 3, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 4, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 5, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 6, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 7, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 8, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 9, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 10, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 11, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 12, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 13, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 14, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 15, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 16, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 17, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 18, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 19, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 20, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 21, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 22, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 23, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 24, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 25, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 26, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 27, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 28, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 29, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 30, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 31, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 32, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 33, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 34, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 35, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 36, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 37, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 38, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 39, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 40, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 41, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 42, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 43, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 44, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 45, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 46, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 47, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 48, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 49, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 50, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 51, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 52, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 53, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 54, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 55, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 56, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 57, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 58, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 59, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 60, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 61, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 62, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 63, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 64, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 65, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 66, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 67, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 68, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 69, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 70, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 71, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 72, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 73, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 74, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 75, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 76, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 77, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 78, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 79, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 80, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 81, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 82, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 83, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 84, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 85, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 86, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 87, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 88, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 89, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 90, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 91, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 92, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 93, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 94, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 95, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 96, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 97, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 98, "filler": 0, "answer": "0", "output": " 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": false, "top1_in_cands": true}
+{"task": "T5", "fmt": "sym", "n": 64, "idx": 99, "filler": 0, "answer": "1", "output": " 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 2, "n_prompt": 137, "truncated": false, "cstep": 1, "cpred": "1", "ccorrect": true, "top1_in_cands": true}
diff --git a/research/hidden-reasoning/results/ft/olmoh_base_T5_cot.jsonl b/research/hidden-reasoning/results/ft/olmoh_base_T5_cot.jsonl
new file mode 100644
index 0000000..3ba945e
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/olmoh_base_T5_cot.jsonl
@@ -0,0 +1,80 @@
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 0, "filler": 0, "answer": "0", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na = 1 (initial) \nb = 1 (initial) \nc = 1 (initial) \nd = 0 (initial) \n\n**Operation sequence:** \nEach operation toggles the named switches. The sequence is: \n**b c a d c b d c**\n\nLet\u2019s track the state of each switch after each operation.\n\n---\n\n### Step-by-step toggling\n\n#### Initial state:\n- a: 1 \n- b: 1 \n- c: 1 \n- d: 0 \n\n---\n\n#### 1. **b** \n- b toggles: 1 \u2192 0 \n- State: a=1, b=0, c=1, d=0 \n\n#### 2. **c** \n- c toggles: 1 \u2192 0 \n- State: a=1, b=0, c=0, d=0 \n\n#### 3. **a** \n- a toggles: 1 \u2192 0 \n- State: a=0, b=0, c=0, d=0 \n\n#### 4. **d** \n- d toggles: 0 \u2192 1 \n- State: a=0, b=0, c=0, d=1 \n\n#### 5. **c** \n- c toggles: 0 \u2192 1 \n- State: a=0, b=0, c=1, d=1 \n\n#### 6. **b** \n- b toggles: 0 \u2192 1 \n- State: a=0, b=1, c=1, d=1 \n\n#### 7. **d** \n- d toggles: 1 \u2192 0 \n- State: a=0, b=1, c=1, d=0 \n\n#### 8. **c** \n- c toggles: 1 \u2192 0 \n- Final state: a=0, b=1, c=0, d=0 \n\n---\n\n### **Final state of d:** \n**d = 0**\n\n---\n\n**Answer: 0**", "pred": "0", "correct": true, "leaked": false, "n_gen": 451, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 1, "filler": 0, "answer": "1", "output": "Let\u2019s track the effect of each operation on the switches **a, b, c, d** (initially all 0).\n\n**Switches:** \na=0, b=0, c=0, d=0\n\n**Operation sequence:** \nc, a, c, d, d, b, d, a\n\nEach operation **toggles** (flips) the named switch.\n\nLet\u2019s process step by step:\n\n| Step | Op | Switches before | After toggle |\n|------|----|-----------------|--------------|\n| 1 | c | a=0, b=0, c=0, d=0 | c=1 |\n| 2 | a | a=0, b=1, c=1, d=0 | a=1 |\n| 3 | c | a=1, b=1, c=0, d=0 | c=1 |\n| 4 | d | a=1, b=1, c=1, d=1 | d=0 |\n| 5 | d | a=1, b=1, c=1, d=1 | d=0 |\n| 6 | b | a=1, b=0, c=1, d=0 | b=1 |\n| 7 | d | a=1, b=1, c=1, d=1 | d=0 |\n| 8 | a | a=0, b=1, c=1, d=0 | a=0 |\n\n**Final states:** \na=0, b=1, c=1, d=0\n\n**Question:** What is the final value of **c**? \n**Answer:** **1**\n\n---\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 390, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 2, "filler": 0, "answer": "1", "output": "Let\u2019s track the state of each switch (a, b, c, d) through the sequence of operations. \nInitial: a=0, b=0, c=1, d=0 \nEach operation toggles the named switch (0\u21921, 1\u21920).\n\nSequence: **b a b c a a c b**\n\nWe\u2019ll process left to right, updating the switches as we go.\n\n---\n\n### Step-by-step\n\n**Start:** \na=0, b=0, c=1, d=0\n\n---\n\n1. **b** \n Toggle b: b=0\u21921 \n State: a=0, b=1, c=1, d=0\n\n2. **a** \n Toggle a: a=0\u21921 \n State: a=1, b=1, c=1, d=0\n\n3. **b** \n Toggle b: b=1\u21920 \n State: a=1, b=0, c=1, d=0\n\n4. **c** \n Toggle c: c=1\u21920 \n State: a=1, b=0, c=0, d=0\n\n5. **a** \n Toggle a: a=1\u21920 \n State: a=0, b=0, c=0, d=0\n\n6. **a** \n Toggle a: a=0\u21921 \n State: a=1, b=0, c=0, d=0\n\n7. **c** \n Toggle c: c=0\u21921 \n State: a=1, b=0, c=1, d=0\n\n8. **b** \n Toggle b: b=0\u21921 \n State: a=1, b=1, c=1, d=0\n\n---\n\n### Final states:\n- **a = 1**\n- **b = 1**\n- **c = 1**\n- **d = 0**\n\n**Question:** What is the final value of **b**? \n**Answer:** **1**\n\n---\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 450, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 3, "filler": 0, "answer": "0", "output": "Let\u2019s track the state of each switch (a, b, c, d) as we process the sequence of operations. Each operation toggles the named switch (0\u21921 or 1\u21920).\n\n**Initial state:** \na = 1 \nb = 1 \nc = 0 \nd = 0 \n\n**Operation sequence:** \nb \na \na \nb \nc \na \nb \nd \n\nLet\u2019s process each operation step by step:\n\n---\n\n### 1. **b** \nToggle **b**: \nb: 1 \u2192 0 \n**State:** \na=1, b=0, c=0, d=0\n\n---\n\n### 2. **a** \nToggle **a**: \na: 1 \u2192 0 \n**State:** \na=0, b=0, c=0, d=0\n\n---\n\n### 3. **a** \nToggle **a** again: \na: 0 \u2192 1 \n**State:** \na=1, b=0, c=0, d=0\n\n---\n\n### 4. **b** \nToggle **b** again: \nb: 0 \u2192 1 \n**State:** \na=1, b=1, c=0, d=0\n\n---\n\n### 5. **c** \nToggle **c**: \nc: 0 \u2192 1 \n**State:** \na=1, b=1, c=1, d=0\n\n---\n\n### 6. **a** \nToggle **a** again: \na: 1 \u2192 0 \n**State:** \na=0, b=1, c=1, d=0\n\n---\n\n### 7. **b** \nToggle **b** again: \nb: 1 \u2192 0 \n**State:** \na=0, b=0, c=1, d=0\n\n---\n\n### 8. **d** \nToggle **d**: \nd: 0 \u2192 1 \n**State:** \na=0, b=0, c=1, d=1\n\n---\n\n## **Final state:** \na = **0** \nb = 0 \nc = 1 \nd = 1 \n\n---\n\n**Final answer:** \nAnswer: 0", "pred": "", "correct": false, "leaked": false, "n_gen": 479, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 4, "filler": 0, "answer": "0", "output": "Let\u2019s track each switch\u2019s state (initially all 0). Each operation toggles the listed switches.\n\nInitial: \na=0, b=0, c=0, d=0\n\nSequence of ops (each op toggles its switches): \n1. c \u2192 toggle c \n2. a \u2192 toggle a \n3. d \u2192 toggle d \n4. c \u2192 toggle c \n5. a \u2192 toggle a \n6. b \u2192 toggle b \n7. a \u2192 toggle a \n8. a \u2192 toggle a \n\nNow, tally how many times each switch is toggled:\n\n- **a**: ops 2, 5, 7, 8 \u2192 **4 toggles** (even) \u2192 ends at **0**\n- **b**: op 6 \u2192 **1 toggle** (odd) \u2192 ends at **1**\n- **c**: ops 1, 4 \u2192 **2 toggles** (even) \u2192 ends at **0**\n- **d**: op 3 \u2192 **1 toggle** (odd) \u2192 ends at **1**\n\n**Final state:** \na=0, b=1, c=0, d=1\n\n**Final value of b:** \n**1**\n\nAnswer: 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 254, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 5, "filler": 0, "answer": "0", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na = 1 (initial) \nb = 0 (initial) \nc = 0 (initial) \nd = 0 (initial) \n\n**Each operation toggles the named switch:** \nSo, if an operation says \"b\", it flips b from 0\u21921 or 1\u21920.\n\n**Sequence of operations:** \nb\u2003b\u2003b\u2003d\u2003b\u2003c\u2003d\u2003d\n\nLet\u2019s track the state of **b** through each step (starting at 0):\n\n1. **First \"b\"** \n b: 0 \u2192 1 \n2. **Second \"b\"** \n b: 1 \u2192 0 \n3. **Third \"b\"** \n b: 0 \u2192 1 \n4. **\"d\"** \n (d doesn\u2019t affect b) \n b stays 1 \n5. **Fourth \"b\"** \n b: 1 \u2192 0 \n6. **\"c\"** \n (c doesn\u2019t affect b) \n b stays 0 \n7. **\"d\"** \n (d doesn\u2019t affect b) \n b stays 0 \n8. **Last \"d\"** \n (d doesn\u2019t affect b) \n b stays 0 \n\n**Final value of b:** **0**\n\n---\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 306, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 6, "filler": 0, "answer": "0", "output": "We start with switches a=0, b=1, c=1, d=0. \nEach operation toggles the listed switches. The sequence is: \nb, b, c, d, d, a, b, a \n\nTrack each switch\u2019s parity (even = 0, odd = 1):\n\n1. **b** \n b: 1 \u2192 0 \n (a,c,d unchanged)\n\n2. **b** \n b: 0 \u2192 1 \n (others unchanged)\n\n3. **c** \n c: 1 \u2192 0 \n (others unchanged)\n\n4. **d** \n d: 0 \u2192 1 \n (others unchanged)\n\n5. **d** \n d: 1 \u2192 0 \n (others unchanged)\n\n6. **a** \n a: 0 \u2192 1 \n (others unchanged)\n\n7. **b** \n b: 1 \u2192 0 \n (others unchanged)\n\n8. **a** \n a: 1 \u2192 0 \n (others unchanged)\n\nFinal states: \na=0, b=0, c=0, d=0 \n\n**Answer: 0**", "pred": "0", "correct": true, "leaked": false, "n_gen": 254, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 7, "filler": 0, "answer": "0", "output": "Let\u2019s track the state of each switch (a, b, c, d) starting from (1,1,0,0). \nEach operation toggles the named switches (1\u21920 or 0\u21921).\n\n**Initial:** \na=1, b=1, c=0, d=0\n\n**Operations (in order):** \na, d, c, a, c, b, b, b\n\nLet\u2019s process step by step:\n\n1. **a** \n Toggle a: 1\u21920 \n State: (0,1,0,0)\n\n2. **d** \n Toggle d: 0\u21921 \n State: (0,1,0,1)\n\n3. **c** \n Toggle c: 0\u21921 \n State: (0,1,1,1)\n\n4. **a** \n Toggle a: 0\u21921 \n State: (1,1,1,1)\n\n5. **c** \n Toggle c: 1\u21920 \n State: (1,1,0,1)\n\n6. **b** \n Toggle b: 1\u21920 \n State: (1,0,0,1)\n\n7. **b** \n Toggle b: 0\u21921 \n State: (1,1,0,1)\n\n8. **b** \n Toggle b: 1\u21920 \n State: (1,0,0,1)\n\n**Final state:** \na=1, b=0, c=0, d=1\n\n**Question:** What is the final value of **b**? \n**Answer:** 0\n\n---\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 359, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 8, "filler": 0, "answer": "0", "output": "Let\u2019s analyze the sequence of operations step by step. \nEach operation toggles the named switches (i.e., flips their state: 0\u21921 or 1\u21920). \nWe start with **a=1, b=1, c=0, d=0**.\n\nThe operation sequence is: \n**d d a a a a a c**\n\nLet\u2019s track each switch\u2019s state after each operation:\n\n---\n\n### Initial State\n- a = 1 \n- b = 1 \n- c = 0 \n- d = 0 \n\n---\n\n### Step-by-step Execution\n\n#### 1. **d**\n- Toggle **d**: 0 \u2192 **1**\n\n#### 2. **d**\n- Toggle **d**: 1 \u2192 **0**\n\n#### 3. **a**\n- Toggle **a**: 1 \u2192 **0**\n\n#### 4. **a**\n- Toggle **a**: 0 \u2192 **1**\n\n#### 5. **a**\n- Toggle **a**: 1 \u2192 **0**\n\n#### 6. **a**\n- Toggle **a**: 0 \u2192 **1**\n\n#### 7. **a**\n- Toggle **a**: 1 \u2192 **0**\n\n#### 8. **c**\n- Toggle **c**: 0 \u2192 **1**\n\n---\n\n### Final States\n- **a**: 0 \n- **b**: (never toggled) \u2192 **1** \n- **c**: 1 \n- **d**: 0 \n\n---\n\n### **Final Answer**\n**d = 0**\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 322, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 9, "filler": 0, "answer": "1", "output": "Let\u2019s track the state of each switch (a, b, c, d) starting from all 0s. Each operation toggles the named switches.\n\n**Initial state:** \na=0, b=0, c=0, d=0\n\n**Operation sequence:** \na d d b a a b c\n\nLet\u2019s process each operation, updating the switches:\n\n---\n\n### 1. **a**\n- Toggles **a**\n- State: a=1, b=0, c=0, d=0\n\n---\n\n### 2. **d**\n- Toggles **d**\n- State: a=1, b=0, c=0, d=1\n\n---\n\n### 3. **d**\n- Toggles **d** again (back to 0)\n- State: a=1, b=0, c=0, d=0\n\n---\n\n### 4. **b**\n- Toggles **b**\n- State: a=1, b=1, c=0, d=0\n\n---\n\n### 5. **a**\n- Toggles **a**\n- State: a=0, b=1, c=0, d=0\n\n---\n\n### 6. **a**\n- Toggles **a** again (back to 1)\n- State: a=1, b=1, c=0, d=0\n\n---\n\n### 7. **b**\n- Toggles **b**\n- State: a=1, b=0, c=0, d=0\n\n---\n\n### 8. **c**\n- Toggles **c**\n- State: a=1, b=0, c=1, d=0\n\n---\n\n**Final state:** \na=1, b=0, c=1, d=0\n\n**Question:** What is the final value of **c**? \n**Answer:** 1\n\n---\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 402, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 10, "filler": 0, "answer": "1", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na = 1 (initial) \nb = 0 \nc = 0 \nd = 1 \n\n**Operation sequence:** \nEach operation toggles the named switch. \nThe sequence of operations is: \n**b, b, a, b, b, b, d, a**\n\nWe need to find the **final state of switch a** (0 or 1).\n\n---\n\n### Step 1: Track toggles for each switch\n\n#### **Switch a**\nToggled by operations at positions: \n- 3rd operation: **a** \n- 8th operation: **a** \n\nSo, **a is toggled twice**.\n\n#### **Switch b**\nToggled by operations at positions: \n- 1st: **b** \n- 2nd: **b** \n- 4th: **b** \n- 5th: **b** \n- 6th: **b** \n\nSo, **b is toggled 5 times**.\n\n#### **Switch c**\nNever toggled \u2192 stays at **0**.\n\n#### **Switch d**\nToggled by operation at position 7: **d** \nSo, **d is toggled once**.\n\n---\n\n### Step 2: Compute final states\n\n#### **Switch a**\n- Starts at **1**\n- Toggled **2 times** (even number)\n- Each toggle flips: 1 \u2192 0 \u2192 1 \n- **Final state: 1**\n\n#### **Switch b**\n- Starts at **0**\n- Toggled **5 times** (odd number)\n- 0 \u2192 1 \u2192 0 \u2192 1 \u2192 0 \u2192 1 \n- **Final state: 1**\n\n#### **Switch c**\n- **0** (never toggled)\n\n#### **Switch d**\n- Starts at **1**\n- Toggled **1 time**\n- 1 \u2192 0 \n- **Final state: 0**\n\n---\n\n### Step 3: **Final answer (just a)**\n\n**Final state of a = 1**\n\nBut the question asks: \n> \"Final a? Answer 0 or 1.\"\n\n---\n\n## **Answer: 1**", "pred": "1", "correct": true, "leaked": false, "n_gen": 462, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 11, "filler": 0, "answer": "0", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na = 1 \nb = 1 \nc = 0 \nd = 0 \n\n**Operation sequence (each op toggles the named switch):** \nd, d, c, b, c, a, b, d\n\nWe need to find the **final state of switch c** (0 or 1).\n\n---\n\n### Step 1: Track each switch\u2019s toggles\n\nWe\u2019ll count how many times each switch is toggled.\n\n#### **Switch a**\nToggled in: **a** (position 6) \nCount: **1 time**\n\n#### **Switch b**\nToggled in: **b** (position 4), **b** (position 7) \nCount: **2 times**\n\n#### **Switch c**\nToggled in: **c** (position 3), **c** (position 5) \nCount: **2 times**\n\n#### **Switch d**\nToggled in: **d** (position 1), **d** (position 2), **d** (position 8) \nCount: **3 times**\n\n---\n\n### Step 2: Apply toggles to initial values\n\nEach toggle flips the switch (0\u21941).\n\n#### **Switch a**\nStart: 1 \nToggled 1 time \u2192 1 \u2192 0\n\n#### **Switch b**\nStart: 1 \nToggled 2 times \u2192 1 \u2192 0 \u2192 1\n\n#### **Switch c**\nStart: 0 \nToggled 2 times \u2192 0 \u2192 1 \u2192 0\n\n#### **Switch d**\nStart: 0 \nToggled 3 times \u2192 0 \u2192 1 \u2192 0 \u2192 1\n\n---\n\n### Step 3: **Final state of c**\n\nAfter 2 toggles, c goes: \n0 \u2192 1 \u2192 0\n\n**Final answer:** \n**c = 0**\n\n---\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 406, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 12, "filler": 0, "answer": "1", "output": "Let\u2019s break down the sequence step by step. \nEach operation toggles the named switch (0\u21921 or 1\u21920). \nInitial state: a=0, b=0, c=1, d=0 \nSequence of operations: **c d d a c d d b**\n\nLet\u2019s track the state after each operation:\n\n| Step | Op | Switches toggled | a | b | c | d | \n|------|----|------------------|---|---|---|---| \n| 0 | Start | \u2014 | 0 | 0 | 1 | 0 | \n| 1 | c | c | 0 | 0 | 0 | 0 | \n| 2 | d | d | 0 | 0 | 0 | 1 | \n| 3 | d | d | 0 | 0 | 0 | 0 | \n| 4 | a | a | 1 | 0 | 0 | 0 | \n| 5 | c | c | 1 | 0 | 1 | 0 | \n| 6 | d | d | 1 | 0 | 1 | 1 | \n| 7 | d | d | 1 | 0 | 1 | 0 | \n| 8 | b | b | 1 | 1 | 1 | 0 | \n\n**Final state:** \na=1, b=1, c=1, d=0\n\n**Question:** What is the final value of **c**? \n**Answer:** 1\n\n---\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 367, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 13, "filler": 0, "answer": "1", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na = 1 \nb = 1 \nc = 0 \nd = 0 \n\n**Operation sequence:** \nc c c d d d d c \nEach occurrence of a letter toggles that switch (0\u21921 or 1\u21920).\n\nLet\u2019s track the state of each switch after each operation:\n\n---\n\n### Initial State:\n- a: 1 \n- b: 1 \n- c: 0 \n- d: 0 \n\n---\n\n### Step-by-step toggling:\n\n#### 1. **c** (first c)\n- c: 0 \u2192 1 \n- State: a=1, b=1, c=1, d=0 \n\n#### 2. **c** (second c)\n- c: 1 \u2192 0 \n- State: a=1, b=1, c=0, d=0 \n\n#### 3. **c** (third c)\n- c: 0 \u2192 1 \n- State: a=1, b=1, c=1, d=0 \n\n#### 4. **d** (first d)\n- d: 0 \u2192 1 \n- State: a=1, b=1, c=1, d=1 \n\n#### 5. **d** (second d)\n- d: 1 \u2192 0 \n- State: a=1, b=1, c=1, d=0 \n\n#### 6. **d** (third d)\n- d: 0 \u2192 1 \n- State: a=1, b=1, c=1, d=1 \n\n#### 7. **d** (fourth d)\n- d: 1 \u2192 0 \n- State: a=1, b=1, c=1, d=0 \n\n#### 8. **c** (fourth c)\n- c: 1 \u2192 0 \n- State: a=1, b=1, c=0, d=0 \n\n---\n\n### **Final Switch States:**\n- a = 1 \n- **b = 1** \n- c = 0 \n- d = 0 \n\n---\n\n### **Question:** \n**What is the final value of b?** \nIt is **1**.\n\n---\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 493, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 14, "filler": 0, "answer": "0", "output": "We have four switches a,b,c,d with initial states a=0, b=1, c=1, d=1. \nEach operation toggles one switch: the sequence of operations is \nc, b, c, b, a, b, c, a \n(i.e. eight operations in that order).\n\nWe track the final state of b by counting how many times it is toggled:\n\u2013 Operation 2: b \n\u2013 Operation 4: b \n\u2013 Operation 6: b \nThat\u2019s 3 toggles in total.\n\nEach toggle flips b. Starting from b=1:\n\u2013 After 1st toggle (op2): 1\u21920 \n\u2013 After 2nd toggle (op4): 0\u21921 \n\u2013 After 3rd toggle (op6): 1\u21920 \n\nSo the final state of b is **0**.\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 184, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 15, "filler": 0, "answer": "0", "output": "Let\u2019s track the state of each switch (a, b, c, d) as we process the sequence of operations. Each operation toggles the named switch (0\u21921 or 1\u21920).\n\n**Initial state:** \na=1, b=1, c=1, d=0\n\n**Operation sequence:** \nb, a, b, c, b, a, d, a\n\nLet\u2019s process step by step:\n\n---\n\n### 1. **b** \nToggles **b** \n- b: 1 \u2192 0 \n**State:** a=1, b=0, c=1, d=0\n\n---\n\n### 2. **a** \nToggles **a** \n- a: 1 \u2192 0 \n**State:** a=0, b=0, c=1, d=0\n\n---\n\n### 3. **b** \nToggles **b** \n- b: 0 \u2192 1 \n**State:** a=0, b=1, c=1, d=0\n\n---\n\n### 4. **c** \nToggles **c** \n- c: 1 \u2192 0 \n**State:** a=0, b=1, c=0, d=0\n\n---\n\n### 5. **b** \nToggles **b** \n- b: 1 \u2192 0 \n**State:** a=0, b=0, c=0, d=0\n\n---\n\n### 6. **a** \nToggles **a** \n- a: 0 \u2192 1 \n**State:** a=1, b=0, c=0, d=0\n\n---\n\n### 7. **d** \nToggles **d** \n- d: 0 \u2192 1 \n**State:** a=1, b=0, c=0, d=1\n\n---\n\n### 8. **a** \nToggles **a** \n- a: 1 \u2192 0 \n**Final state:** a=0, b=0, c=0, d=1\n\n---\n\n**Final value of a:** \n**0**\n\n---\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 452, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 16, "filler": 0, "answer": "0", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na = 1 \nb = 1 \nc = 0 \nd = 1 \n\n**Operation sequence:** \nc d c d c d c b \nEach operation toggles the named switch (i.e., adds 1 mod 2 to that switch\u2019s current value).\n\nLet\u2019s track the state of each switch after each operation:\n\n### Initial state:\na=1, b=1, c=0, d=1\n\n---\n\n#### Step 1: **c**\n- Toggle c (0 \u2192 1)\n- State: a=1, b=1, c=1, d=1\n\n#### Step 2: **d**\n- Toggle d (1 \u2192 0)\n- State: a=1, b=1, c=1, d=0\n\n#### Step 3: **c**\n- Toggle c (1 \u2192 0)\n- State: a=1, b=1, c=0, d=0\n\n#### Step 4: **d**\n- Toggle d (0 \u2192 1)\n- State: a=1, b=1, c=0, d=1\n\n#### Step 5: **c**\n- Toggle c (0 \u2192 1)\n- State: a=1, b=1, c=1, d=1\n\n#### Step 6: **d**\n- Toggle d (1 \u2192 0)\n- State: a=1, b=1, c=1, d=0\n\n#### Step 7: **c**\n- Toggle c (1 \u2192 0)\n- State: a=1, b=1, c=0, d=0\n\n#### Step 8: **b**\n- Toggle b (1 \u2192 0)\n- State: a=1, b=0, c=0, d=0\n\n---\n\n**Final state:** \nb = 0\n\n---\n\n**Answer:** \nAnswer: 0", "pred": "", "correct": false, "leaked": false, "n_gen": 414, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 17, "filler": 0, "answer": "1", "output": "We start with switches a=0, b=1, c=0, d=1. \nEach operation toggles the listed switches. The sequence of operations is: \nc, d, a, d, b, c, c, c \n\nTrack each switch\u2019s state (initial = 0 for off):\n\n1. **c** (toggle c): \n c: 0 \u2192 1 \n State: a=0, b=1, c=1, d=1\n\n2. **d** (toggle d): \n d: 1 \u2192 0 \n State: a=0, b=1, c=1, d=0\n\n3. **a** (toggle a): \n a: 0 \u2192 1 \n State: a=1, b=1, c=1, d=0\n\n4. **d** (toggle d): \n d: 0 \u2192 1 \n State: a=1, b=1, c=1, d=1\n\n5. **b** (toggle b): \n b: 1 \u2192 0 \n State: a=1, b=0, c=1, d=1\n\n6. **c** (toggle c): \n c: 1 \u2192 0 \n State: a=1, b=0, c=0, d=1\n\n7. **c** (toggle c): \n c: 0 \u2192 1 \n State: a=1, b=0, c=1, d=1\n\n8. **c** (toggle c): \n c: 1 \u2192 0 \n Final State: a=1, b=0, c=0, d=1\n\n**Final value of d is 1.**\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 384, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 18, "filler": 0, "answer": "0", "output": "We start with switches a=1, b=1, c=0, d=1. \nEach operation toggles the listed switches. \nSequence of ops: b, b, a, a, a, b, c, d.\n\nTrack b\u2019s state (initially 1):\n\n1) op b \u2192 toggle b: 1\u21920 \n2) op b \u2192 toggle b: 0\u21921 \n3) op a \u2192 no change to b (still 1) \n4) op a \u2192 no change to b (still 1) \n5) op a \u2192 no change to b (still 1) \n6) op b \u2192 toggle b: 1\u21920 \n7) op c \u2192 no change to b (still 0) \n8) op d \u2192 no change to b (still 0)\n\nFinal state of b = 0.\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 185, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 8, "idx": 19, "filler": 0, "answer": "0", "output": "Let\u2019s break down the sequence of operations step by step, tracking the state of each switch (a, b, c, d), starting from the initial state: \n**a=0, b=1, c=0, d=1**\n\nEach operation toggles (flips) the named switch(s). The sequence of operations is: \n**c, b, c, c, c, c, d**\n\nLet\u2019s process each operation in order:\n\n---\n\n### **Initial State**\n- a = 0 \n- b = 1 \n- c = 0 \n- d = 1 \n\n---\n\n### **1. Operation: c**\n- Toggles **c**\n- c: 0 \u2192 1 \n**State:** a=0, b=1, c=1, d=1\n\n---\n\n### **2. Operation: b**\n- Toggles **b**\n- b: 1 \u2192 0 \n**State:** a=0, b=0, c=1, d=1\n\n---\n\n### **3. Operation: c**\n- Toggles **c**\n- c: 1 \u2192 0 \n**State:** a=0, b=0, c=0, d=1\n\n---\n\n### **4. Operation: c**\n- Toggles **c**\n- c: 0 \u2192 1 \n**State:** a=0, b=0, c=1, d=1\n\n---\n\n### **5. Operation: c**\n- Toggles **c**\n- c: 1 \u2192 0 \n**State:** a=0, b=0, c=0, d=1\n\n---\n\n### **6. Operation: c**\n- Toggles **c**\n- c: 0 \u2192 1 \n**State:** a=0, b=0, c=1, d=1\n\n---\n\n### **7. Operation: d**\n- Toggles **d**\n- d: 1 \u2192 0 \n**Final State:** a=0, b=0, c=1, **d=0**\n\n---\n\n## **Final Answer**\n**d = 0**\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 443, "n_prompt": 102, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 0, "filler": 0, "answer": "0", "output": "We have four switches a,b,c,d, each starting at 0. Each operation toggles exactly one switch (the one named). We list the sequence of operations and count how many times each switch is toggled.\n\nSequence of operations (each is a single letter):\n1. b \n2. c \n3. b \n4. a \n5. b \n6. b \n7. b \n8. b \n9. a \n10. c \n11. d \n12. c \n13. d \n14. a \n15. d \n16. a \n17. b \n18. d \n19. a \n20. a \n21. b \n22. b \n23. c \n24. b \n25. b \n26. b \n27. a \n28. a \n29. a \n30. d \n31. c \n32. d \n\nNow count toggles for each switch:\n\n\u2013 **a** appears in positions 4, 9, 14, 16, 19, 20, 27, 28, 29 \n \u2192 9 times \n\u2013 **b** appears in positions 1, 3, 5, 6, 7, 8, 17, 21, 22, 24, 25, 26 \n \u2192 12 times \n\u2013 **c** appears in positions 2, 10, 12, 23, 31 \n \u2192 5 times \n\u2013 **d** appears in positions 11, 13, 18, 30, 32 \n \u2192 5 times \n\nEach toggle flips the switch (0\u21921\u21920\u2026). Starting from 0, an odd number of toggles ends at 1; even \u2192 0.\n\n\u2013 a: 9 (odd) \u2192 final a = 1 \n\u2013 b: 12 (even) \u2192 final b = 0 \n\u2013 c: 5 (odd) \u2192 final c = 1 \n\u2013 d: 5 (odd) \u2192 final d = 1 \n\n**Final state of d is 1.**\n\nAnswer: 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 443, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 1, "filler": 0, "answer": "1", "output": "We have four switches a,b,c,d with initial states a=0, b=0, c=0, d=0 (all off). \nEach operation toggles the listed switches. We need the final state of b (0 or 1).\n\nList of operations (each is a string of letters indicating which switches to toggle):\n\n1. a \n2. b \n3. c \n4. a d \n5. a c \n6. b a \n7. a b a \n8. a b \n9. a b c \n10. c c c \n11. a c d \n12. d d c \n13. a c b \n14. a a b \n15. a b c \n16. d c \n17. c a \n\nWe track a,b,c,d as bits (0=off,1=on). Start at (0,0,0,0).\n\nProcess each operation in order, toggling the listed switches:\n\n1. a \u2192 (1,0,0,0) \n2. b \u2192 (1,1,0,0) \n3. c \u2192 (1,1,1,0) \n4. a d \u2192 (0,1,1,1) \n5. a c \u2192 (1,1,0,1) \n6. b a \u2192 (0,0,0,1) \n7. a b a \u2192 (1,1,0,1) \n8. a b \u2192 (0,0,0,1) \n9. a b c \u2192 (1,1,1,1) \n10. c c c \u2192 (1,1,0,1) \n11. a c d \u2192 (0,1,1,0) \n12. d d c \u2192 (0,1,0,1) \n13. a c b \u2192 (1,0,1,1) \n14. a a b \u2192 (0,1,1,1) \n15. a b c \u2192 (1,0,0,1) \n16. d c \u2192 (1,0,1,0) \n17. c a \u2192 (0,0,1,0) \n\nFinal state: a=0, b=0, c=1, d=0. \nThus **b = 0**.\n\nAnswer: 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 493, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 2, "filler": 0, "answer": "0", "output": "We have four switches a,b,c,d with initial states a=0,b=1,c=0,d=1. \nEach operation toggles the listed switches. We need the final state of a after applying the sequence:\n\nSequence of operations (each is a list of switches to toggle):\n1. b d \n2. a d \n3. b d \n4. b c \n5. b c \n6. d b \n7. b d \n8. b c \n9. b c \n10. d b \n11. b d \n12. c a \n13. a a \n14. b a \n15. b b \n16. a b \n17. b b \n18. b c \n19. b b \n20. d c \n21. b d \n\nWe track the parity (even/odd) of toggles for each switch:\n\nInitialize counts (mod 2):\na:0, b:0, c:0, d:0\n\nProcess each operation, flipping the corresponding bits:\n\n1. b,d \u2192 b=1, d=1 \n2. a,d \u2192 a=1, d=0 \n3. b,d \u2192 b=0, d=1 \n4. b,c \u2192 b=1, c=1 \n5. b,c \u2192 b=0, c=0 \n6. d,b \u2192 d=0, b=1 \n7. b,d \u2192 b=0, d=1 \n8. b,c \u2192 b=1, c=1 \n9. b,c \u2192 b=0, c=0 \n10. d,b \u2192 d=1, b=1 \n11. b,d \u2192 b=0, d=0 \n12. c,a \u2192 c=1, a=0 \n13. a,a \u2192 a stays 0 \n14. b,a \u2192 b=1, a=1 \n15. b,b \u2192 b stays 1 \n16. a,b \u2192 a=0, b=0 \n17. b,b \u2192 b stays 0 \n18. b,c \u2192 b=1, c=1 \n19. b,b \u2192 b stays 1 \n20. d,c \u2192 d=1, c=0 \n21. b,d \u2192 b=0, d=0 \n\nFinal parities:\na=0, b=0, c=0, d=0 \n\nSince a started at 0 and was toggled an even number of times, it remains 0.\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 517, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 3, "filler": 0, "answer": "1", "output": "We have four switches a,b,c,d with initial states a=0,b=0,c=1,d=1. \nEach operation toggles exactly the switches whose labels appear in that operation\u2019s string. \nWe list the operations in order (spaces separate ops):\n\n1 d \n2 d \n3 a \n4 c \n5 d \n6 d \n7 d \n8 c \n9 b \n10 a \n11 d \n12 a \n13 b \n14 d \n15 d \n16 a \n17 b \n18 d \n19 a \n20 d \n21 a \n22 d \n23 b \n24 d \n25 d \n26 a \n27 b \n28 b \n\nWe track each switch\u2019s total number of toggles (mod 2):\n\n\u2013 **Switch a** appears in ops 3,10,12,16,19,21,26 \u2192 7 times \u2192 7 mod 2 = 1 \u2192 toggled once \u2192 final = 0\u22951 = **1** \n\u2013 **Switch b** in 9,13,17,23,27 \u2192 5 times \u2192 5 mod 2 = 1 \u2192 final = 0\u22951 = **1** \n\u2013 **Switch c** in 4,8 \u2192 2 times \u2192 0 \u2192 final = 1\u22950 = **1** \n\u2013 **Switch d** in 1,2,5,6,7,11,14,15,18,20,22,24,25 \u2192 13 times \u2192 13 mod 2 = 1 \u2192 final = 1\u22951 = **0** \n\nWe only care about **b**. Its final state is **1**, i.e. **1** in binary.\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 366, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 4, "filler": 0, "answer": "1", "output": "We have four switches a,b,c,d with initial states a=0, b=1, c=0, d=0. \nEach operation toggles exactly one of the named switches (a, b, c, or d). \nWe are given a sequence of operations (each is one of a,b,c,d). \nWe only care about the final state of switch b (answer 0 or 1).\n\n**Step 1: Count how many times \u201cb\u201d appears in the operation list.** \nThe operation sequence (space\u2010separated): \na b b b c a c c b b c c b b b a b c d d d b d b c b d b c b\n\nLet\u2019s count the occurrences of \u201cb\u201d:\n\n1. b \n2. b \n3. b \n4. (c) \n5. (a) \n6. (c) \n7. (c) \n8. b \n9. b \n10. (c) \n11. (c) \n12. b \n13. b \n14. (b) \n15. (b) \n16. (b) \n17. (a) \n18. b \n19. (c) \n20. d \n21. d \n22. d \n23. b \n24. d \n25. b \n26. (c) \n27. b \n28. (c) \n29. b \n\nNow list all the positions where \u201cb\u201d occurs (1\u2010indexed for clarity):\n\nPositions: \n2, 3, 4, 8, 9, 12, 13, 14, 15, 18, 23, 25, 27, 29\n\nCount them: \nThat\u2019s 14 occurrences of \u201cb\u201d.\n\n**Step 2: Initial state of b is 1.** \nEach time we see \u201cb\u201d in the operation list, we toggle b (1\u21920\u21921\u2026). \nAfter an even number of toggles, b returns to its initial state (1). \nAfter an odd number of toggles, b flips to 0.\n\n14 is even \u2192 b ends up at its initial value: **1**.\n\n**Final answer:** \nAnswer: 1", "pred": "", "correct": false, "leaked": false, "n_gen": 468, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 5, "filler": 0, "answer": "1", "output": "We have four switches a,b,c,d, each initially 0. A sequence of operations toggles the named switches. We only care about switch d\u2019s final state.\n\nList of operations (each is \u201ctoggle switch X\u201d):\nd, b, c, d, c, a, c, c, a, a, a, a, b, b, c, c, c, b, d, d, b, b, a, b, d, c, a, b, d, d, c\n\nCount how many times \u201cd\u201d appears in the list:\nPositions with d: 1, 4, 20, 21, 28 \u2192 total of 5 times.\n\nEach occurrence toggles d. Starting from 0:\n5 toggles \u2192 0 \u2192 1 \u2192 0 \u2192 1 \u2192 0 \u2192 1 \nSo final state of d is **1**.\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 192, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 6, "filler": 0, "answer": "0", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na = 1 (start) \nb = 0 (start) \nc = 1 (start) \nd = 0 (start) \n\n**Operation sequence:** \nEach operation toggles the named switches. \nSequence (split into operations): \n1. a \n2. b \n3. b \n4. d \n5. c \n6. a \n7. b \n8. b \n9. d \n10. c \n11. a \n12. b \n13. c \n14. b \n15. a \n16. c \n17. a \n18. d \n19. c \n20. d \n21. d \n22. b \n23. a \n24. d \n25. c \n26. d \n27. c \n28. d \n29. c \n30. c \n31. b \n32. b \n\nWe only care about **c** (switch c starts at 1). Each time we see \"c\" in the operation list, we toggle c (1\u21920\u21921...).\n\nLet\u2019s count how many times **c** appears in the sequence:\n\nGo through the list and tally:\n\n1. a \n2. b \n3. b \n4. d \n5. **c** (1) \n6. a \n7. b \n8. b \n9. d \n10. **c** (2) \n11. a \n12. b \n13. **c** (3) \n14. b \n15. a \n16. **c** (4) \n17. a \n18. d \n19. **c** (5) \n20. d \n21. d \n22. b \n23. a \n24. d \n25. **c** (6) \n26. d \n27. **c** (7) \n28. d \n29. **c** (8) \n30. **c** (9) \n31. b \n32. b \n\n**Total toggles of c:** 9 times.\n\n**Initial state of c:** 1 \n**Each toggle flips:** \nOdd number of toggles \u2192 ends up at 0 \nEven number \u2192 stays at 1\n\n9 is **odd**, so:\n\n**Final state of c = 0**\n\n---\n\n**Answer: 0**", "pred": "0", "correct": true, "leaked": false, "n_gen": 497, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 7, "filler": 0, "answer": "1", "output": "We have four switches a,b,c,d, each initially 0 (off). Each operation toggles the listed switches. We only care about switch b\u2019s final state (0 or 1).\n\nList of operations (each is a string of letters indicating which switches to toggle):\n\n1. a \n2. b \n3. c \n4. d \n5. d \n6. d \n7. c \n8. a \n9. b \n10. b \n11. a \n12. d \n13. a \n14. c \n15. c \n16. b \n17. c \n18. b \n19. c \n20. a \n21. d \n22. c \n23. c \n24. b \n25. a \n26. c \n27. c \n28. b \n29. a \n30. d \n31. c \n32. b \n33. a \n34. c \n35. c \n36. b \n37. a \n38. d \n39. c \n40. b \n41. b \n\nWe only track how many times **b** is toggled (each occurrence of \u201cb\u201d in an operation toggles b once).\n\nScan the list for \u201cb\u201d:\n\nPositions with \u201cb\u201d:\n2, 9, 10, 16, 18, 24, 28, 32, 36, 40 \nCount them:\n2, 9, 10 \u2192 3 \n16, 18 \u2192 +2 (total 5) \n24 \u2192 +1 (6) \n28 \u2192 +1 (7) \n32 \u2192 +1 (8) \n36 \u2192 +1 (9) \n40 \u2192 +1 (10)\n\nTotal toggles of b = **10** (even).\n\nInitial state of b = 0. \nEven number of toggles \u2192 b returns to 0.\n\n**Final state of b = 0**\n\nAnswer: 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 401, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 8, "filler": 0, "answer": "1", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na = 1 (initially) \nb = 0 \nc = 1 \nd = 1 \n\n**Operation sequence:** \nEach operation toggles the named switches. The sequence is: \nc a d b d b d d d b c c a a a a d a d b b a c b c c c a b a b a\n\nWe need to find the **final state of switch a** (0 or 1).\n\n---\n\n### Step 1: Count how many times each switch is toggled\n\nLet\u2019s count the number of times each letter appears in the sequence:\n\n#### **Count for 'a':**\nGo through the sequence and tally every 'a':\n\nc a d b d b d d d b c c a a a a d a d b b a c b c c c a b a b a\n\nLet\u2019s list the positions of 'a':\n\n1. 2nd: a \n3. 9th: a \n4. 10th: a \n5. 11th: a \n6. 12th: a \n7. 14th: a \n8. 18th: a \n9. 21st: a \n10. 24th: a \n11. 27th: a \n12. 30th: a \n13. 33rd: a \n14. 34th: a \n15. 35th: a \n16. 36th: a \n17. 37th: a \n\nLet\u2019s count them:\n\nPositions: \n2, 9, 10, 11, 12, 14, 18, 21, 24, 27, 30, 33, 34, 35, 36, 37 \nThat\u2019s **16 times**.\n\n#### **Count for 'b':**\nPositions of 'b':\n\n4, 6, 7, 13, 15, 19, 20, 22, 25, 26, 28, 29, 31, 32, 36, 38\n\nLet\u2019s count:\n\n4, 6, 7, 13, 15, 19, 20, 22, 25, 26, 28, 29, 31, 32, 36, 38 \nThat\u2019s **16 times**.\n\n#### **Count for 'c':**\nPositions of 'c':\n\n1, 8, 12, 17, 19, 23, 27, 29, 33, 35, 39\n\nLet\u2019s count:\n\n1, 8, 12, 17, 19, 23, 27, 29, 33, 35, 39 \nThat\u2019s **11 times**.\n\n#### **Count for 'd':**\nPositions of 'd':\n\n3, 5, 7, 8, 10, 11, 13, 14, 16, 17, 19, 20, 22, 24, 25, 26, 28, 30, 32, 33, 36, 37\n\nLet\u2019s count:\n\n3, 5, 7, 8, 10, 11, 13, 14, 16, 17, 19, 20, 22, 24, 25, 26, 28, 30, 32, 33, 36, 37 \nThat\u2019s **22 times**.\n\n---\n\n### Step 2: Toggling effect\n\nEach time a switch is toggled, its state flips (1\u21920 or 0\u21921).\n\n- **Initial state:** a=1, b=0, c=1, d=1\n- **Final state:** \n - a = 1 + (number of toggles of a) mod 2 \n - b = 0 + (number of toggles of b) mod 2 \n - c = 1 + (number of toggles of c) mod 2 \n - d = 1 + (number of toggles of d) mod 2\n\nBut we only care about **a**.\n\n---\n\n### Step 3: Compute final state of a\n\nNumber of toggles of **a** = **16**\n\n16 mod 2 = **0** (even number of toggles)\n\nSo, **a** returns to its original state.\n\n**Initial a = 1**\n\n**Final a = 1**\n\n---\n\n### Step 4: Final Answer\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 969, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 9, "filler": 0, "answer": "1", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na=0, b=0, c=1, d=0 \nEach operation toggles (flips) the state of the named switch.\n\n**Operation sequence:** \nb d c a b b b b b a b a b b c a c c d d c d b c b a \n(That\u2019s 30 operations, each is a single letter: which switch to toggle.)\n\nWe only care about **switch c** (initially 1). \nEach time \u201cc\u201d appears in the sequence, we toggle c (1\u21920 or 0\u21921).\n\nLet\u2019s **count how many times \u201cc\u201d appears** in the operation list:\n\nSequence (with positions for clarity): \n1. b \n2. d \n3. c \n4. a \n5. b \n6. b \n7. b \n8. b \n9. b \n10. a \n11. b \n12. a \n13. b \n14. b \n15. c \n16. a \n17. c \n18. c \n19. d \n20. d \n21. c \n22. d \n23. b \n24. c \n25. b \n26. a \n27. b \n28. c \n29. b \n30. a \n\nNow, **list all positions where \u201cc\u201d appears**:\n- 3\n- 15\n- 17\n- 18\n- 21\n- 24\n- 28\n\nCount them: **7 times**.\n\n**Initial state of c:** 1 \nEach toggle flips it: \n- Odd number of toggles \u2192 ends up at 0 \n- Even number \u2192 stays at 1\n\n**7 toggles** \u2192 odd \u2192 **final state of c is 0**.\n\n---\n\n**Answer: 0**", "pred": "0", "correct": false, "leaked": false, "n_gen": 390, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 10, "filler": 0, "answer": "0", "output": "We have four switches a,b,c,d with initial states a=1, b=0, c=0, d=1. \nEach operation toggles the listed switches. We need the final state of b (0 or 1).\n\nList of operations (each is a string of letters indicating which switches to toggle):\n1. d \n2. b \n3. d \n4. d \n5. d \n6. b \n7. a \n8. d \n9. a \n10. b \n11. c \n12. a \n13. c \n14. c \n15. a \n16. a \n17. d \n18. a \n19. b \n20. b \n21. a \n22. d \n23. c \n24. d \n25. a \n26. d \n27. d \n28. c \n29. b \n30. a \n31. a \n32. d \n33. c \n34. b \n35. a \n36. d \n\nWe only care about how many times **b** is toggled (operations containing \u201cb\u201d).\n\nScan the list for \u201cb\u201d:\n\u2013 #2 (b) \n\u2013 #6 (b) \n\u2013 #10 (b) \n\u2013 #19 (b) \n\u2013 #20 (b) \n\u2013 #29 (b) \n\u2013 #34 (b) \n\u2013 #35 (b) \n\nCount = 8 toggles of b. \nInitial b = 0. \nEven number of toggles \u2192 b returns to 0.\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 326, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 11, "filler": 0, "answer": "1", "output": "We have four switches a,b,c,d, each toggled by the listed operations in order. Each operation toggles exactly the switches whose letters appear in it. We only care about the parity (even/odd) of each switch\u2019s total toggles.\n\nList of operations (spaces separate ops):\na d a b a c c a b d d a d c d d b c d c a d a b b b c d c d a a\n\nWe\u2019ll count how many times each letter appears (mod 2):\n\n1. Scan through the sequence, tallying each letter:\n - a: positions 1,3,5,8,11,16,20,27,32,34,36,39,41,44,48,49 \u2192 count = 16 \u2192 even \u2192 a=0\n - b: positions 4,9,12,18,23,26,30,35,38,42,45,46,50 \u2192 count = 13 \u2192 odd \u2192 b=1\n - c: positions 7,10,13,22,25,29,33,37,39,43,47,51 \u2192 count = 12 \u2192 even \u2192 c=0\n - d: positions 2,6,14,15,19,21,24,28,31,32,35,40,44,49,52 \u2192 count = 15 \u2192 odd \u2192 d=1\n\nThus the final state is:\na = 0 \nb = 1 \nc = 0 \nd = 1\n\nAnswer: 0", "pred": "0", "correct": false, "leaked": false, "n_gen": 328, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 12, "filler": 0, "answer": "0", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na = 1 \nb = 1 \nc = 0 \nd = 0 \n\n**Operation sequence:** \na b c d c a d b a d d a b a a b d d b a d b b d c b a d d c b\n\nEach time a switch is mentioned, it **toggles** (flips) its current state: \n- If it\u2019s 0 \u2192 1 \n- If it\u2019s 1 \u2192 0 \n\nWe only care about **switch d** at the end.\n\n---\n\n### Step 1: Count how many times **d** is toggled\n\nLet\u2019s scan the sequence and count every occurrence of **d**:\n\nSequence (with positions for clarity): \n1. a \n2. b \n3. c \n4. **d** \n5. c \n6. a \n7. **d** \n8. b \n9. a \n10. **d** \n11. **d** \n12. a \n13. b \n14. a \n15. **a** \n16. **b** \n17. **a** \n18. **a** \n19. **b** \n20. **d** \n21. **d** \n22. **b** \n23. **a** \n24. **d** \n25. **b** \n26. **b** \n27. **d** \n28. **c** \n29. **b** \n30. **a** \n31. **d** \n32. **d** \n33. **c** \n34. **b**\n\nNow, **list all the positions where d appears** (1-based indexing):\n\n4, 7, 10, 11, 20, 21, 24, 27, 31, 32\n\nLet\u2019s count them:\n\n1. 4 \n2. 7 \n3. 10 \n4. 11 \n5. 20 \n6. 21 \n7. 24 \n8. 27 \n9. 31 \n10. 32 \n\n**Total toggles of d = 10**\n\n---\n\n### Step 2: Determine final state of d\n\n- **Initial state of d:** 0 \n- **Each toggle flips the state.** \n- **Even number of toggles:** returns to original state \n- **Odd number of toggles:** flips to the opposite state\n\n10 is **even**.\n\nSo, after 10 toggles, d returns to its **starting value**: **0**\n\n---\n\n### **Final Answer**\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 551, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 13, "filler": 0, "answer": "0", "output": "We have four switches a,b,c,d, each initially 1 (on). \nEach operation toggles the listed switches. \nThe sequence of operations is: \nc b c d a b c d d c a d c d c c d a d a c c a a c b a c b c b c \n\nWe only care about switch **c** (initially 1). \nEach time **c** appears in the operation list, it is toggled (1\u21920 or 0\u21921). \nCount how many times **c** occurs in the sequence:\n\nLet\u2019s scan the list (positions 1 to 30): \n1. c \n2. b \n3. c \n4. d \n5. a \n6. b \n7. c \n8. d \n9. d \n10. c \n11. a \n12. d \n13. c \n14. d \n15. c \n16. c \n17. d \n18. a \n19. d \n20. a \n21. c \n22. c \n23. a \n24. a \n25. c \n26. b \n27. a \n28. c \n29. b \n30. c \n31. b \n32. c \n33. b \n34. c \n\nNow count the **c**\u2019s (positions with \u201cc\u201d): \n1, 3, 7, 10, 13, 15, 16, 21, 22, 25, 28, 30, 32, 34 \nThat\u2019s **14** occurrences.\n\nEach occurrence toggles c. \nStart at 1 (on). \nAfter 14 toggles: \n1 + 14 = 15 \u2192 odd \u2192 final state = 0 (off).\n\n**Answer: 0**", "pred": "0", "correct": true, "leaked": false, "n_gen": 379, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 14, "filler": 0, "answer": "1", "output": "We have four switches a,b,c,d, each toggled by the given sequence of operations. Each operation toggles exactly the switches whose letter appears in that operation string. We only care about switch d\u2019s final state (0 = off, 1 = on).\n\n1. **Initial state:** \n a=1, b=1, c=0, d=1\n\n2. **List of operations (each is a string of letters):** \n a c a c c a a a c d \n a b c a a b b c a b a d \n c a c c a c b c b b \n\n (There are 3 lines \u00d7 10 ops = 30 operations total.)\n\n3. **Count how many times each switch is toggled:**\n\n - **Switch a:** \n Appears in every operation except the 3rd line\u2019s 7th op (which is \u201cb\u201d). \n Total ops = 30 \u2212 1 = **29** \n Toggles = 29 \u2192 odd \u2192 final state flips 29 times.\n\n - **Switch b:** \n Appears in every op of the 2nd line (10 times) and in the 3rd line\u2019s 8th op. \n Total = 10 + 1 = **11** \n Toggles = 11 \u2192 odd \u2192 flips 11 times.\n\n - **Switch c:** \n Appears in every op of the 1st line (10 times), and in every op of the 3rd line (10 times). \n Total = 10 + 10 = **20** \n Toggles = 20 \u2192 even \u2192 returns to original state (0).\n\n - **Switch d:** \n Appears in the 1st line\u2019s 10th op and in the 2nd line\u2019s 10th op. \n Total = 2 \u2192 even \u2192 returns to original state (1).\n\n4. **Apply toggles to initial states:**\n - a: 1 \u2192 flip 29\u00d7 \u2192 ends at **0** \n - b: 1 \u2192 flip 11\u00d7 \u2192 ends at **0** \n - c: 0 \u2192 flip 20\u00d7 (even) \u2192 stays **0** \n - d: 1 \u2192 flip 2\u00d7 (even) \u2192 stays **1**\n\n5. **Final state of d:** **1**\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 501, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 15, "filler": 0, "answer": "0", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na=1, b=0, c=1, d=1 \nEach occurrence of a letter in the sequence **toggles** that switch (1\u21920 or 0\u21921).\n\n**Operation sequence:** \nb b b c d a a d a b d a b a c a a c d b d c\n\nWe need to **count how many times each switch is toggled** and see if its final state is 0 or 1.\n\n---\n\n### 1. **Count toggles for each switch**\n\nLet\u2019s list the sequence and tally:\n\n```\nb b b c d a a d a b d a b a c a a c d b d c\n```\n\nLet\u2019s go through each letter and increment the count:\n\n#### **Switch a (starts at 1)**\nPositions where **a** appears:\n- a (6th)\n- a (7th)\n- a (10th)\n- a (13th)\n- a (16th)\n- a (18th)\n\n**Count for a:** 6 toggles \nInitial: 1 \nAfter 6 toggles: 1 + 6 mod 2 = **1 + 0 = 1**\n\n#### **Switch b (starts at 0)**\nPositions where **b** appears:\n- b (1st)\n- b (2nd)\n- b (3rd)\n- b (8th)\n- b (11th)\n- b (20th)\n\n**Count for b:** 6 toggles \nInitial: 0 \nAfter 6 toggles: 0 + 6 mod 2 = **0 + 0 = 0**\n\n#### **Switch c (starts at 1)**\nPositions where **c** appears:\n- c (4th)\n- c (14th)\n- c (19th)\n- c (24th)\n\n**Count for c:** 4 toggles \nInitial: 1 \nAfter 4 toggles: 1 + 4 mod 2 = **1 + 0 = 1**\n\n#### **Switch d (starts at 1)**\nPositions where **d** appears:\n- d (5th)\n- d (9th)\n- d (12th)\n- d (17th)\n- d (22nd)\n\n**Count for d:** 5 toggles \nInitial: 1 \nAfter 5 toggles: 1 + 5 mod 2 = **1 + 1 = 0**\n\n---\n\n### 2. **Final states**\n\n| Switch | Initial | Toggles | Final |\n|--------|---------|---------|-------|\n| a | 1 | 6 | 1 |\n| b | 0 | 6 | 0 |\n| c | 1 | 4 | 1 |\n| d | 1 | 5 | 0 |\n\n---\n\n### 3. **Final question: What is the final value of switch c?**\n\n**Answer:** **1**\n\n---\n\nAnswer: 1", "pred": "1", "correct": false, "leaked": false, "n_gen": 661, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 16, "filler": 0, "answer": "1", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na=1, b=1, c=0, d=0 \nEach occurrence of a letter in the sequence **toggles** that switch (1\u21920 or 0\u21921).\n\n**Operation sequence:** \nd a c d c c d d c a b b b a a b a b c d a b b b d a a a b a c d\n\nWe need to **count how many times each switch is toggled** and see if its final state is 0 or 1.\n\n---\n\n### 1. **Count toggles for each switch**\n\nLet\u2019s list the sequence and tally:\n\n```\nd a c d c c d d c a b b b a a b a b c d a b b b d a a a b a c d\n```\n\nLet\u2019s go through each letter and increment the count for a, b, c, d:\n\n#### **d**\nPositions (1-based): \n1, 4, 7, 8, 16, 27, 32, 36 \nCount: **8**\n\n#### **a**\nPositions: \n2, 10, 15, 16, 19, 21, 24, 29, 33, 37 \nCount: **10**\n\n#### **c**\nPositions: \n3, 6, 9, 17, 35, 38 \nCount: **6**\n\n#### **b**\nPositions: \n11, 12, 13, 22, 23, 25, 28, 30, 31, 34 \nCount: **10**\n\n---\n\n### 2. **Compute final state for each switch**\n\nEach toggle flips the switch. \nStart at 0 (off). \nFinal = (initial + number_of_toggles) mod 2\n\n#### **d**\n- Initial: 0\n- Toggles: 8\n- Final: (0 + 8) mod 2 = **0**\n\n#### **a**\n- Initial: 1\n- Toggles: 10\n- Final: (1 + 10) mod 2 = 11 mod 2 = **1**\n\n#### **c**\n- Initial: 0\n- Toggles: 6\n- Final: (0 + 6) mod 2 = **0**\n\n#### **b**\n- Initial: 1\n- Toggles: 10\n- Final: (1 + 10) mod 2 = **1**\n\n---\n\n### 3. **Question: Final d?**\n\n**Final state of d = 0**\n\n---\n\n**Answer: 0**", "pred": "0", "correct": false, "leaked": false, "n_gen": 554, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 17, "filler": 0, "answer": "0", "output": "We have four switches a,b,c,d, each toggled by the sequence of operations:\nSequence: \na b b b c d d c c d b a c a b b b c d b d a b b c d b c a c b a\n\nEach occurrence of a letter toggles that switch (0\u21921\u21920\u2026). \nWe start with a=0, b=0, c=0, d=1.\n\nCount how many times each switch appears in the sequence:\n\n1. **Switch a** appears at positions: \n 1 (a), 10 (a), 13 (a), 19 (a), 27 (a), 33 (a) \n \u2192 **6 times**\n\n2. **Switch b** appears at positions: \n 2,3,4,12,22,24,26,30,34,35 \n \u2192 **10 times**\n\n3. **Switch c** appears at positions: \n 5,7,8,14,25,32,36 \n \u2192 **7 times**\n\n4. **Switch d** appears at positions: \n 6,9,11,18,20,28,29,31 \n \u2192 **8 times**\n\nNow, each toggle flips the switch:\n- Final state = initial state XOR (number_of_toggles mod 2)\n\nInitial states: \na=0, b=0, c=0, d=1\n\nCompute parity (even=0, odd=1):\n\n- a: 6 toggles \u2192 even \u2192 remains 0 \n- b: 10 toggles \u2192 even \u2192 remains 0 \n- c: 7 toggles \u2192 odd \u2192 flips from 0 \u2192 1 \n- d: 8 toggles \u2192 even \u2192 remains 1 \n\n**Final states:** \na = 0 \nb = 0 \nc = 1 \nd = 1\n\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 402, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 18, "filler": 0, "answer": "1", "output": "Let\u2019s break down the problem step by step:\n\n**Switches:** \na=1, b=1, c=0, d=1 \nEach occurrence of a letter in the sequence **toggles** that switch (1\u21920 or 0\u21921).\n\n**Operation sequence:** \nb b b d b a a c b d a b d d a b c d c c b d c d d d c a c b d a\n\nWe need to find the **final state of switch c** (0 or 1).\n\n---\n\n### Step 1: Count how many times each switch is toggled\n\nLet\u2019s count the number of times each letter appears in the sequence:\n\n#### **b**\nSequence: \nb b b d b a a c b d a b d d a b c d c c b d c d d d c a c b d a\n\nLet\u2019s scan and count:\n\n- b at positions: \n 1, 2, 3, 5, 7, 10, 13, 16, 19, 23, 27, 32 \n **Total b toggles = 12**\n\n#### **a**\nPositions: \n6, 7, 12, 18, 25, 33, 36 \n**Total a toggles = 7**\n\n#### **c**\nPositions: \n9, 22, 26, 28, 30, 34, 37 \n**Total c toggles = 7**\n\n#### **d**\nPositions: \n4, 11, 14, 15, 20, 21, 24, 29, 31, 35, 38, 39 \n**Total d toggles = 12**\n\n---\n\n### Step 2: Apply toggles to initial states\n\nEach toggle flips the switch (1\u21940).\n\n#### **Switch a**\n- Start: 1\n- Toggles: 7 times (odd)\n- Final: 1 \u2192 0\n\n#### **Switch b**\n- Start: 1\n- Toggles: 12 times (even)\n- Final: 1 \u2192 1\n\n#### **Switch c**\n- Start: 0\n- Toggles: 7 times (odd)\n- Final: 0 \u2192 1\n\n#### **Switch d**\n- Start: 1\n- Toggles: 12 times (even)\n- Final: 1 \u2192 1\n\n---\n\n### Step 3: **Final state of c**\n\n**c = 1**\n\n---\n\n## **Final Answer**\n\nAnswer: 1", "pred": "1", "correct": true, "leaked": false, "n_gen": 535, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "sym", "n": 32, "idx": 19, "filler": 0, "answer": "0", "output": "We have four switches a,b,c,d, each toggled by the given sequence of operations. Each operation toggles exactly one switch (a, b, c, or d). The initial state of all switches is 0. We only care about the final state of switch d.\n\nStep 1: Count how many times the operation \u201cd\u201d appears in the sequence.\n\nSequence (space-separated ops):\na a a d a c a c d c d d b d b a d c a a c b a c b d a c b b c a\n\nLet\u2019s scan and tally every occurrence of \u201cd\u201d:\n\nPositions (1-based) where op = d:\n4, 9, 11, 14, 20, 27, 36, 48\n\nCount them:\n4, 9 \u2192 2 \n11 \u2192 3 \n14 \u2192 4 \n20 \u2192 5 \n27 \u2192 6 \n36 \u2192 7 \n48 \u2192 8 \n\nTotal number of \u201cd\u201d operations = 8.\n\nStep 2: Each time \u201cd\u201d is chosen, switch d is toggled (0\u21921, 1\u21920, \u2026). Starting from 0, after an even number of toggles it returns to 0; after an odd number, it ends at 1.\n\nHere, 8 is even \u2192 final state of d = 0.\n\nAnswer: 0", "pred": "0", "correct": true, "leaked": false, "n_gen": 288, "n_prompt": 126, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 0, "filler": 0, "answer": "off", "output": "Let's track the state of each light step by step. Initial state: \na: ON \nb: OFF \nc: ON \nd: OFF \n\n**Eve flips d:** \nd: ON \n\n**Gus flips c:** \nc: OFF \n\n**Dee flips c:** \nc: ON \n\n**Jo flips a:** \na: OFF \n\n**Eve flips a:** \na: ON \n\n**Gus flips a:** \na: OFF \n\n**Cal flips b:** \nb: ON \n\n**Cal flips b again:** \nb: OFF \n\nNow, final states: \na: **OFF** \nb: OFF \nc: ON \nd: ON \n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 147, "n_prompt": 174, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 1, "filler": 0, "answer": "off", "output": "Let's track the state of each light step by step. We'll represent each light as a binary value: **on = 1**, **off = 0**.\n\n**Initial state:** \na = 1 (on) \nb = 1 (on) \nc = 1 (on) \nd = 0 (off)\n\nNow, process each flip in order:\n\n1. **Hal flips c:** \n c = 1 \u2192 0 \n **State:** a=1, b=1, c=0, d=0\n\n2. **Gus flips b:** \n b = 1 \u2192 0 \n **State:** a=1, b=0, c=0, d=0\n\n3. **Fay flips d:** \n d = 0 \u2192 1 \n **State:** a=1, b=0, c=0, d=1\n\n4. **Ann flips a:** \n a = 1 \u2192 0 \n **State:** a=0, b=0, c=0, d=1\n\n5. **Fay flips a:** \n a = 0 \u2192 1 \n **State:** a=1, b=0, c=0, d=1\n\n6. **Jo flips b:** \n b = 0 \u2192 1 \n **State:** a=1, b=1, c=0, d=1\n\n7. **Ben flips a:** \n a = 1 \u2192 0 \n **State:** a=0, b=1, c=0, d=1\n\n**Final state:** \na = 0 (off) \nb = 1 (on) \nc = 0 (off) \nd = 1 (on)\n\n**Question:** Is light **c** on or off now? \n**Answer:** off", "pred": "off", "correct": true, "leaked": false, "n_gen": 395, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 2, "filler": 0, "answer": "off", "output": "Let's track the state of each light step by step. Initial state: \na: OFF \nb: ON \nc: ON \nd: ON \n\nNow process each flip in order:\n\n1. **Cal flips c** \n c toggles: ON \u2192 OFF \n a: OFF \n b: ON \n c: OFF \n d: ON \n\n2. **Jo flips c** \n c toggles: OFF \u2192 ON \n a: OFF \n b: ON \n c: ON \n d: ON \n\n3. **Dee flips a** \n a toggles: OFF \u2192 ON \n a: ON \n b: ON \n c: ON \n d: ON \n\n4. **Ida flips d** \n d toggles: ON \u2192 OFF \n a: ON \n b: ON \n c: ON \n d: OFF \n\n5. **Dee flips c** \n c toggles: ON \u2192 OFF \n a: ON \n b: ON \n c: OFF \n d: OFF \n\n6. **Eve flips b** \n b toggles: ON \u2192 OFF \n a: ON \n b: OFF \n c: OFF \n d: OFF \n\n7. **Jo flips b** \n b toggles: OFF \u2192 ON \n a: ON \n b: ON \n c: OFF \n d: OFF \n\n8. **Ida flips b** \n b toggles: ON \u2192 OFF \n a: ON \n b: OFF \n c: OFF \n d: OFF \n\n**Final states:** \na: ON \nb: OFF \nc: OFF \nd: OFF \n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 366, "n_prompt": 174, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 3, "filler": 0, "answer": "on", "output": "Let's track the state of light **c** step by step (each \"flip\" toggles its state):\n\n**Initial state:** \nc: **off**\n\nNow process each action involving **c**:\n\n1. **Ben flips c:** \n off \u2192 **on**\n\n2. **Hal flips c:** \n on \u2192 **off**\n\n3. **Jo flips a** (doesn't affect c): \n c stays **off**\n\n4. **Ann flips b** (doesn't affect c): \n c stays **off**\n\n5. **Jo flips c:** \n off \u2192 **on**\n\n6. **Fay flips c:** \n on \u2192 **off**\n\n7. **Ida flips d** (doesn't affect c): \n c stays **off**\n\n8. **Fay flips c:** \n off \u2192 **on**\n\n**Final state of c:** **on**\n\nAnswer: on", "pred": "on", "correct": true, "leaked": false, "n_gen": 187, "n_prompt": 172, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 4, "filler": 0, "answer": "off", "output": "Let's track the state of each light after each flip. Start with: \na: ON \nb: ON \nc: ON \nd: OFF \n\nNow process each person in order, flipping only the specified switch:\n\n1. **Dee flips d** \n d: OFF \u2192 ON \n State: a=ON, b=ON, c=ON, d=ON\n\n2. **Jo flips a** \n a: ON \u2192 OFF \n State: a=OFF, b=ON, c=ON, d=ON\n\n3. **Ann flips b** \n b: ON \u2192 OFF \n State: a=OFF, b=OFF, c=ON, d=ON\n\n4. **Ann flips d** \n d: ON \u2192 OFF \n State: a=OFF, b=OFF, c=ON, d=OFF\n\n5. **Ben flips c** \n c: ON \u2192 OFF \n State: a=OFF, b=OFF, c=OFF, d=OFF\n\n6. **Hal flips b** \n b: OFF \u2192 ON \n State: a=OFF, b=ON, c=OFF, d=OFF\n\n7. **Fay flips c** \n c: OFF \u2192 ON \n State: a=OFF, b=ON, c=ON, d=OFF\n\n8. **Dee flips d** \n d: OFF \u2192 ON \n Final State: a=OFF, b=ON, c=ON, d=ON\n\n**Final status of light a:** OFF\n\nAnswer: off", "pred": "off", "correct": true, "leaked": false, "n_gen": 333, "n_prompt": 172, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 5, "filler": 0, "answer": "on", "output": "Let's track the state of light **c** through each flip:\n\n**Initial state:** \na: ON \nb: OFF \nc: OFF \nd: OFF \n\nNow, list all flips **only for c** (others don't affect c):\n\n1. **Gus flips c:** \n c: OFF \u2192 ON \n2. **Eve flips c:** \n c: ON \u2192 OFF \n\nNo other person flips c. \nSo after all flips, **light c is OFF**.\n\nAnswer: off", "pred": "off", "correct": false, "leaked": false, "n_gen": 106, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 6, "filler": 0, "answer": "off", "output": "Let's track the state of light c through each flip:\n\n**Initial state:** \na: ON \nb: OFF \nc: ON \nd: OFF \n\n**Flips affecting c:** \n1. **Gus flips c:** \n c: ON \u2192 OFF \n2. **Eve flips c:** \n c: OFF \u2192 ON \n3. **Jo flips c:** \n c: ON \u2192 OFF \n\nNo other person flips c. \n**Final state of c:** **OFF**\n\nAnswer: off", "pred": "off", "correct": true, "leaked": false, "n_gen": 106, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 7, "filler": 0, "answer": "on", "output": "Let's track the state of light **b** through each flip:\n\n**Initial state:** \na: off \nb: off \nc: off \nd: off \n\nNow, list all flips **in order**, focusing only on **switch b**:\n\n1. **Ida:** flips **d** \u2192 b unchanged (off) \n2. **Dee:** flips **c** \u2192 b unchanged (off) \n3. **Hal:** flips **c** \u2192 b unchanged (off) \n4. **Eve:** flips **b** \u2192 **b turns ON** (now on) \n5. **Hal:** flips **b** \u2192 **b turns OFF** (now off) \n6. **Ben:** flips **b** \u2192 **b turns ON** (now on) \n7. **Cal:** flips **c** \u2192 b unchanged (on) \n8. **Gus:** flips **d** \u2192 b unchanged (on) \n\n**Final state of b:** **ON**\n\nAnswer: on", "pred": "on", "correct": true, "leaked": false, "n_gen": 208, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 8, "filler": 0, "answer": "off", "output": "Let's track the state of each light step by step. We'll represent each light as a binary value: **on = 1**, **off = 0**.\n\n**Initial state:** \na: 1 (on) \nb: 1 (on) \nc: 1 (on) \nd: 0 (off)\n\nNow process each person's flip in order:\n\n---\n\n### 1. **Ben flips switch a**\n- a: 1 \u2192 0 \n**State:** \na: 0 \nb: 1 \nc: 1 \nd: 0\n\n---\n\n### 2. **Jo flips switch d**\n- d: 0 \u2192 1 \n**State:** \na: 0 \nb: 1 \nc: 1 \nd: 1\n\n---\n\n### 3. **Fay flips switch d**\n- d: 1 \u2192 0 \n**State:** \na: 0 \nb: 1 \nc: 1 \nd: 0\n\n---\n\n### 4. **Hal flips switch b**\n- b: 1 \u2192 0 \n**State:** \na: 0 \nb: 0 \nc: 1 \nd: 0\n\n---\n\n### 5. **Dee flips switch d**\n- d: 0 \u2192 1 \n**State:** \na: 0 \nb: 0 \nc: 1 \nd: 1\n\n---\n\n### 6. **Gus flips switch b**\n- b: 0 \u2192 1 \n**State:** \na: 0 \nb: 1 \nc: 1 \nd: 1\n\n---\n\n### 7. **Gus flips switch a**\n- a: 0 \u2192 1 \n**State:** \na: 1 \nb: 1 \nc: 1 \nd: 1\n\n---\n\n### 8. **Gus flips switch a again**\n- a: 1 \u2192 0 \n**Final state:** \na: 0 \nb: 1 \nc: 1 \nd: 1\n\n---\n\n**Final question:** \nIs light **a** on or off now?\n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 460, "n_prompt": 174, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 9, "filler": 0, "answer": "on", "output": "Let's track the state of light **a** through each flip:\n\n**Initial state:** \na: OFF \nb: ON \nc: ON \nd: ON \n\nNow, process each person's flip in order:\n\n1. **Gus flips a:** \n a: OFF \u2192 ON \n (b, c, d unchanged)\n\n2. **Fay flips a:** \n a: ON \u2192 OFF \n (others unchanged)\n\n3. **Ida flips d:** \n a: OFF (no change) \n d: ON \u2192 OFF\n\n4. **Cal flips c:** \n a: OFF (no change) \n c: ON \u2192 OFF\n\n5. **Jo flips b:** \n a: OFF (no change) \n b: ON \u2192 OFF\n\n6. **Dee flips d:** \n a: OFF (no change) \n d: OFF \u2192 ON\n\n7. **Cal flips a:** \n a: OFF \u2192 ON \n (others unchanged)\n\n8. **Cal flips d:** \n a: ON (no change) \n d: ON \u2192 OFF\n\n---\n\n**Final state of light a:** \nAfter all flips, **light a is ON**.\n\nAnswer: on", "pred": "on", "correct": true, "leaked": false, "n_gen": 256, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 10, "filler": 0, "answer": "on", "output": "Let's track the state of each light step by step. Initial state: \na: ON \nb: OFF \nc: OFF \nd: OFF \n\n**Ida's flips (in order):** \n1. **Flips d:** \n d: OFF \u2192 ON \n (a: ON, b: OFF, c: OFF, d: ON) \n2. **Flips c:** \n c: OFF \u2192 ON \n (a: ON, b: OFF, c: ON, d: ON) \n3. **Flips b:** \n b: OFF \u2192 ON \n (a: ON, b: ON, c: ON, d: ON) \n4. **Flips a:** \n a: ON \u2192 OFF \n (a: OFF, b: ON, c: ON, d: ON) \n\n**Eve's flips:** \n5. **Flips c:** \n c: ON \u2192 OFF \n (a: OFF, b: ON, c: OFF, d: ON) \n\n**Cal's flip:** \n6. **Flips a:** \n a: OFF \u2192 ON \n (a: ON, b: ON, c: OFF, d: ON) \n\n**Ben's flip:** \n7. **Flips a:** \n a: ON \u2192 OFF \n (a: OFF, b: ON, c: OFF, d: ON) \n\n**Eve's final flip:** \n8. **Flips a:** \n a: OFF \u2192 ON \n (a: ON, b: ON, c: OFF, d: ON) \n\n**Final states:** \na: ON \nb: ON \nc: OFF \nd: **ON** \n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 370, "n_prompt": 175, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 11, "filler": 0, "answer": "off", "output": "Let's track the state of light d after each flip:\n\n**Initial state:** \nd: **off**\n\nNow, process each person's flips in order:\n\n1. **Eve flips d:** \n off \u2192 **on**\n\n2. **Cal flips a:** \n (a is irrelevant for d) \n d remains **on**\n\n3. **Fay flips a:** \n (a is irrelevant for d) \n d stays **on**\n\n4. **Fay flips a again:** \n (a is irrelevant for d) \n d still **on**\n\n5. **Fay flips d:** \n on \u2192 **off**\n\n6. **Cal flips d:** \n off \u2192 **on**\n\n7. **Ann flips a:** \n (a is irrelevant for d) \n d remains **on**\n\n8. **Ann flips d:** \n on \u2192 **off**\n\n**Final state of d:** **off**\n\nAnswer: off", "pred": "off", "correct": true, "leaked": false, "n_gen": 197, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 12, "filler": 0, "answer": "off", "output": "Let's track the state of each light after each flip, starting from the initial state:\n\n**Initial state:** \na: ON \nb: OFF \nc: OFF \nd: OFF \n\nNow process each person's flip in order:\n\n1. **Dee flips c** \n c: OFF \u2192 ON \n a: ON \n b: OFF \n d: OFF \n\n2. **Eve flips d** \n d: OFF \u2192 ON \n a: ON \n b: OFF \n c: ON \n\n3. **Ann flips d** \n d: ON \u2192 OFF \n a: ON \n b: OFF \n c: ON \n\n4. **Eve flips d** \n d: OFF \u2192 ON \n a: ON \n b: OFF \n c: ON \n\n5. **Ben flips b** \n b: OFF \u2192 ON \n a: ON \n b: ON \n c: ON \n\n6. **Dee flips b** \n b: ON \u2192 OFF \n a: ON \n b: OFF \n c: ON \n\n7. **Ann flips c** \n c: ON \u2192 OFF \n a: ON \n b: OFF \n c: OFF \n\n8. **Ann flips a** \n a: ON \u2192 OFF \n a: OFF \n b: OFF \n c: OFF \n\n**Final state:** \na: OFF \nb: OFF \nc: OFF \nd: ON \n\n**Question:** Is light **b** on or off now? \n**Answer:** off", "pred": "off", "correct": true, "leaked": false, "n_gen": 331, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 13, "filler": 0, "answer": "on", "output": "Let's track the state of each light after each flip:\n\n**Initial state:** \na: OFF \nb: ON \nc: ON \nd: OFF \n\nNow process each person in order, flipping only the specified switch:\n\n1. **Cal flips b:** \n b: ON \u2192 OFF \n a: OFF \n c: ON \n d: OFF \n\n2. **Dee flips a:** \n a: OFF \u2192 ON \n b: OFF \n c: ON \n d: OFF \n\n3. **Fay flips c:** \n c: ON \u2192 OFF \n a: ON \n b: OFF \n d: OFF \n\n4. **Jo flips b:** \n b: OFF \u2192 ON \n a: ON \n c: OFF \n d: OFF \n\n5. **Eve flips b:** \n b: ON \u2192 OFF \n a: ON \n c: OFF \n d: OFF \n\n6. **Ann flips d:** \n d: OFF \u2192 ON \n a: ON \n b: OFF \n c: OFF \n\n7. **Ben flips c:** \n c: OFF \u2192 ON \n a: ON \n b: OFF \n d: ON \n\n8. **Eve flips b:** \n b: OFF \u2192 ON \n a: ON \n c: ON \n d: ON \n\n**Final states:** \na: **ON** \nb: ON \nc: ON \nd: ON \n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 318, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 14, "filler": 0, "answer": "off", "output": "Let's track the state of each light after each flip. Initial state: \na: OFF \nb: ON \nc: ON \nd: ON \n\nNow process each person in order, flipping only the specified switch:\n\n1. **Hal flips c** \n c: ON \u2192 OFF \n (a: OFF, b: ON, c: OFF, d: ON)\n\n2. **Dee flips d** \n d: ON \u2192 OFF \n (a: OFF, b: ON, c: OFF, d: OFF)\n\n3. **Gus flips a** \n a: OFF \u2192 ON \n (a: ON, b: ON, c: OFF, d: OFF)\n\n4. **Fay flips c** \n c: OFF \u2192 ON \n (a: ON, b: ON, c: ON, d: OFF)\n\n5. **Gus flips a** \n a: ON \u2192 OFF \n (a: OFF, b: ON, c: ON, d: OFF)\n\n6. **Cal flips c** \n c: ON \u2192 OFF \n (a: OFF, b: ON, c: OFF, d: OFF)\n\n7. **Dee flips d** \n d: OFF \u2192 ON \n (a: OFF, b: ON, c: OFF, d: ON)\n\n8. **Hal flips c** \n c: OFF \u2192 ON \n (a: OFF, b: ON, c: ON, d: ON)\n\n**Final state:** \na: OFF \nb: ON \nc: ON \nd: ON \n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 340, "n_prompt": 174, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 15, "filler": 0, "answer": "on", "output": "Let's track the state of each light after each flip, starting from the initial state:\n\n**Initial state:** \na: ON \nb: OFF \nc: ON \nd: ON \n\nNow process each person in order, flipping only the specified switch:\n\n1. **Eve flips d:** \n d: ON \u2192 OFF \n a: ON \n b: OFF \n c: ON \n d: OFF \n\n2. **Fay flips a:** \n a: ON \u2192 OFF \n b: OFF \n c: ON \n d: OFF \n\n3. **Cal flips c:** \n c: ON \u2192 OFF \n a: OFF \n b: OFF \n c: OFF \n d: OFF \n\n4. **Jo flips a:** \n a: OFF \u2192 ON \n b: OFF \n c: OFF \n d: OFF \n\n5. **Ann flips a:** \n a: ON \u2192 OFF \n b: OFF \n c: OFF \n d: OFF \n\n6. **Dee flips b:** \n b: OFF \u2192 ON \n a: OFF \n c: OFF \n d: OFF \n\n7. **Hal flips d:** \n d: OFF \u2192 ON \n a: OFF \n b: ON \n c: OFF \n d: ON \n\n8. **Dee flips d again:** \n d: ON \u2192 OFF \n a: OFF \n b: ON \n c: OFF \n d: OFF \n\n**Final states:** \na: OFF \nb: **ON** \nc: OFF \nd: OFF \n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 345, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 16, "filler": 0, "answer": "on", "output": "Let's track the state of each light after each flip:\n\n**Initial state:** \na: ON \nb: OFF \nc: OFF \nd: OFF \n\nNow process each person in order, flipping only the specified switch:\n\n1. **Ida flips d:** \n d: OFF \u2192 ON \n a: ON \n b: OFF \n c: OFF \n d: ON \n\n2. **Ben flips a:** \n a: ON \u2192 OFF \n b: OFF \n c: OFF \n d: ON \n\n3. **Hal flips b:** \n b: OFF \u2192 ON \n a: OFF \n b: ON \n c: OFF \n d: ON \n\n4. **Hal flips a:** \n a: OFF \u2192 ON \n b: ON \n c: OFF \n d: ON \n\n5. **Eve flips b:** \n b: ON \u2192 OFF \n a: ON \n b: OFF \n c: OFF \n d: ON \n\n6. **Ben flips a:** \n a: ON \u2192 OFF \n b: OFF \n c: OFF \n d: ON \n\n7. **Cal flips b:** \n b: OFF \u2192 ON \n a: OFF \n b: ON \n c: OFF \n d: ON \n\n8. **Jo flips a:** \n a: OFF \u2192 ON \n b: ON \n c: OFF \n d: ON \n\n**Final states:** \na: ON \nb: ON \nc: OFF \nd: **ON**\n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 335, "n_prompt": 171, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 17, "filler": 0, "answer": "on", "output": "Let's track the state of each light after each flip. Initial state: \na: ON \nb: ON \nc: OFF \nd: OFF \n\nNow process each person in order, flipping only the specified switch:\n\n1. **Fay flips d:** \n d: OFF \u2192 ON \n (a:ON, b:ON, c:OFF, d:ON)\n\n2. **Ida flips b:** \n b: ON \u2192 OFF \n (a:ON, b:OFF, c:OFF, d:ON)\n\n3. **Gus flips b:** \n b: OFF \u2192 ON \n (a:ON, b:ON, c:OFF, d:ON)\n\n4. **Ann flips a:** \n a: ON \u2192 OFF \n (a:OFF, b:ON, c:OFF, d:ON)\n\n5. **Cal flips a:** \n a: OFF \u2192 ON \n (a:ON, b:ON, c:OFF, d:ON)\n\n6. **Cal flips b:** \n b: ON \u2192 OFF \n (a:ON, b:OFF, c:OFF, d:ON)\n\n7. **Fay flips c:** \n c: OFF \u2192 ON \n (a:ON, b:OFF, c:ON, d:ON)\n\n8. **Ida flips b:** \n b: OFF \u2192 ON \n (a:ON, b:ON, c:ON, d:ON)\n\n**Final state:** \na: ON \nb: ON \nc: ON \nd: ON \n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 340, "n_prompt": 174, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 18, "filler": 0, "answer": "on", "output": "Let's track the state of each light step by step. Initial state:\n- a: OFF\n- b: ON\n- c: OFF\n- d: ON\n\nNow process each person's flip in order:\n\n1. **Gus flips a:** \n a: OFF \u2192 ON \n (b, c, d unchanged)\n\n2. **Gus flips d:** \n d: ON \u2192 OFF \n (a, b, c unchanged)\n\n3. **Fay flips c:** \n c: OFF \u2192 ON \n (a, b, d unchanged)\n\n4. **Hal flips b:** \n b: ON \u2192 OFF \n (a, c, d unchanged)\n\n5. **Ida flips d:** \n d: OFF \u2192 ON \n (a, b, c unchanged)\n\n6. **Ben flips c:** \n c: ON \u2192 OFF \n (a, b, d unchanged)\n\n7. **Ann flips c:** \n c: OFF \u2192 ON \n (a, b, d unchanged)\n\n8. **Ann flips b:** \n b: OFF \u2192 ON \n (a, c, d unchanged)\n\n**Final states:**\n- a: ON \n- b: ON \n- c: ON \n- d: ON \n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 270, "n_prompt": 173, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 8, "idx": 19, "filler": 0, "answer": "on", "output": "Let's track the state of light d step by step:\n\n**Initial state:** \na: off \nb: on \nc: on \nd: on \n\n**Ida flips a:** \na: on \nb: on \nc: on \nd: on \n\n**Ida flips a again:** \na: off \nb: on \nc: on \nd: on \n\n**Ann flips d:** \na: off \nb: on \nc: on \nd: **off** \n\n**Cal flips d:** \na: off \nb: on \nc: on \nd: **on** \n\n**Ann flips c:** \na: off \nb: on \nc: **off** \nd: on \n\n**Eve flips c:** \na: off \nb: on \nc: **on** \nd: on \n\n**Ann flips c again:** \na: off \nb: on \nc: **off** \nd: on \n\n**Ann flips b:** \na: off \nb: **off** \nc: off \nd: on \n\n**Final state:** \na: off \nb: off \nc: off \nd: **on** \n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 254, "n_prompt": 172, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 0, "filler": 0, "answer": "off", "output": "Let's track the state of each light (A, B, C, D) step by step. \n**Initial state:** \nA: off \nB: off \nC: off \nD: on \n\nWe'll process each flip in order, updating the corresponding light (toggle: on\u2194off).\n\n---\n\n### Step-by-step flips\n\n| Step | Person | Switch | Before | After |\n|------|--------|--------|---------|-------|\n| 1 | Jo | C | off | **on** |\n| 2 | Cal | B | off | **on** |\n| 3 | Gus | D | on | **off** |\n| 4 | Jo | A | off | **on** |\n| 5 | Gus | D | off | **on** |\n| 6 | Ida | C | on | **off** |\n| 7 | Gus | C | off | **on** |\n| 8 | Ann | D | on | **off** |\n| 9 | Hal | C | off | **on** |\n|10 | Dee | A | on | **off** |\n|11 | Gus | A | off | **on** |\n|12 | Jo | B | on | **off** |\n|13 | Ida | D | off | **on** |\n|14 | Eve | B | off | **on** |\n|15 | Hal | C | on | **off** |\n|16 | Fay | B | off | **on** |\n|17 | Cal | C | on | **off** |\n|18 | Hal | B | on | **off** |\n|19 | Dee | D | off | **on** |\n|20 | Jo | A | off | **on** |\n|21 | Ann | D | on | **off** |\n|22 | Ben | B | off | **on** |\n|23 | Eve | B | on | **off** |\n|24 | Jo | B | off | **on** |\n|25 | Eve | D | off | **on** |\n|26 | Ann | C | off | **on** |\n|27 | Cal | D | on | **off** |\n|28 | Ann | D | off | **on** |\n|29 | Hal | D | on | **off** |\n|30 | Ben | C | off | **on** |\n|31 | Ann | D | off | **on** |\n|32 | Fay | D | on | **off** |\n\n---\n\n### Final states after all 32 flips\n\n- **A:** Last flip was Jo (step 20) \u2192 **on**\n- **B:** Last flip was Jo (step 24) \u2192 **on**\n- **C:** Last flip was Ann (step 26) \u2192 **on**\n- **D:** Last flip was Fay (step 32) \u2192 **off**\n\n---\n\n**Final answer:** \nAnswer: on", "pred": "", "correct": false, "leaked": false, "n_gen": 734, "n_prompt": 302, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 1, "filler": 0, "answer": "off", "output": "Let's track the state of each light (a, b, c, d) step by step. \n**Initial state:** \na: OFF \nb: OFF \nc: OFF \nd: ON \n\nWe'll process each flip in order, updating the state after each.\n\n---\n\n### 1. **Gus flips a** \na: OFF \u2192 ON \n**a: ON | b: OFF | c: OFF | d: ON**\n\n---\n\n### 2. **Cal flips a** \na: ON \u2192 OFF \n**a: OFF | b: OFF | c: OFF | d: ON**\n\n---\n\n### 3. **Ida flips b** \nb: OFF \u2192 ON \n**a: OFF | b: ON | c: OFF | d: ON**\n\n---\n\n### 4. **Cal flips b** \nb: ON \u2192 OFF \n**a: OFF | b: OFF | c: OFF | d: ON**\n\n---\n\n### 5. **Ben flips a** \na: OFF \u2192 ON \n**a: ON | b: OFF | c: OFF | d: ON**\n\n---\n\n### 6. **Jo flips a** \na: ON \u2192 OFF \n**a: OFF | b: OFF | c: OFF | d: ON**\n\n---\n\n### 7. **Dee flips c** \nc: OFF \u2192 ON \n**a: OFF | b: OFF | c: ON | d: ON**\n\n---\n\n### 8. **Ben flips b** \nb: OFF \u2192 ON \n**a: OFF | b: ON | c: ON | d: ON**\n\n---\n\n### 9. **Ann flips c** \nc: ON \u2192 OFF \n**a: OFF | b: ON | c: OFF | d: ON**\n\n---\n\n### 10. **Eve flips c** \nc: OFF \u2192 ON \n**a: OFF | b: ON | c: ON | d: ON**\n\n---\n\n### 11. **Ben flips b** \nb: ON \u2192 OFF \n**a: OFF | b: OFF | c: ON | d: ON**\n\n---\n\n### 12. **Ben flips b** \nb: OFF \u2192 ON \n**a: OFF | b: ON | c: ON | d: ON**\n\n---\n\n### 13. **Dee flips d** \nd: ON \u2192 OFF \n**a: OFF | b: ON | c: ON | d: OFF**\n\n---\n\n### 14. **Ida flips a** \na: OFF \u2192 ON \n**a: ON | b: ON | c: ON | d: OFF**\n\n---\n\n### 15. **Fay flips c** \nc: ON \u2192 OFF \n**a: ON | b: ON | c: OFF | d: OFF**\n\n---\n\n### 16. **Eve flips a** \na: ON \u2192 OFF \n**a: OFF | b: ON | c: OFF | d: OFF**\n\n---\n\n### 17. **Gus flips c** \nc: OFF \u2192 ON \n**a: OFF | b: ON | c: ON | d: OFF**\n\n---\n\n### 18. **Eve flips a** \na: OFF \u2192 ON \n**a: ON | b: ON | c: ON | d: OFF**\n\n---\n\n### 19. **Cal flips c** \nc: ON \u2192 OFF \n**a: ON | b: ON | c: OFF | d: OFF**\n\n---\n\n### 20. **Hal flips b** \nb: ON \u2192 OFF \n**a: ON | b: OFF | c: OFF | d: OFF**\n\n---\n\n### 21. **Eve flips a** \na: ON \u2192 OFF \n**a: OFF | b: OFF | c: OFF | d: OFF**\n\n---\n\n### 22. **Fay flips a** \na: OFF \u2192 ON \n**a: ON | b: OFF | c: OFF | d: OFF**\n\n---\n\n### 23. **Gus flips b** \nb: OFF \u2192 ON \n**a: ON | b: ON | c: OFF | d: OFF**\n\n---\n\n### 24. **Hal flips b** \nb: ON \u2192 OFF \n**a: ON | b: OFF | c: OFF | d: OFF**\n\n---\n\n### 25. **Hal flips d** \nd: OFF \u2192 ON \n**a: ON | b: OFF | c: OFF | d: ON**\n\n---\n\n### 26. **Ben flips d** \nd: ON \u2192 OFF \n**a: ON | b: OFF | c: OFF | d: OFF**\n\n---\n\n### 27. **Ann flips c** \nc: OFF \u2192 ON \n**a: ON | b: OFF | c: ON | d: OFF**\n\n---\n\n### 28. **Ben flips b** \nb: OFF \u2192 ON \n**a: ON | b: ON | c: ON | d: OFF**\n\n---\n\n### 29. **Ben flips c** \nc: ON \u2192 OFF \n**a: ON | b: ON | c: OFF | d: OFF**\n\n---\n\n### 30. **Cal flips b** \nb: ON \u2192 OFF \n**a: ON | b: OFF | c: OFF | d: OFF**\n\n---\n\n### 31. **Eve flips a** \na: ON \u2192 OFF \n**a: OFF | b: OFF | c: OFF | d: OFF**\n\n---\n\n### 32. **Ida flips a** \na: OFF \u2192 ON \n**a: ON | b: OFF | c: OFF | d: OFF**\n\n---\n\n## **Final State After All Flips:**\n- **a:** ON \n- **b:** OFF \n- **c:** OFF \n- **d:** OFF \n\n---\n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 1201, "n_prompt": 304, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 2, "filler": 0, "answer": "on", "output": "Let's track the state of each light (a, b, c, d) step by step. Start with:\n- a: ON\n- b: ON\n- c: OFF\n- d: OFF\n\nWe'll process each person in order, updating the relevant light (flip = toggle ON\u2194OFF).\n\n---\n\n### 1. **Eve flips a**\n- a: ON \u2192 OFF \n- b: ON \n- c: OFF \n- d: OFF \n\n### 2. **Gus flips d**\n- a: OFF \n- b: ON \n- c: OFF \n- d: OFF \u2192 ON \n\n### 3. **Gus flips c**\n- a: OFF \n- b: ON \n- c: OFF \u2192 ON \n- d: ON \n\n### 4. **Hal flips a**\n- a: OFF \u2192 ON \n- b: ON \n- c: ON \n- d: ON \n\n### 5. **Jo flips a**\n- a: ON \u2192 OFF \n- b: ON \n- c: ON \n- d: ON \n\n### 6. **Hal flips c**\n- a: OFF \n- b: ON \n- c: ON \u2192 OFF \n- d: ON \n\n### 7. **Eve flips a**\n- a: OFF \u2192 ON \n- b: ON \n- c: OFF \n- d: ON \n\n### 8. **Ann flips d**\n- a: ON \n- b: ON \n- c: OFF \n- d: ON \u2192 OFF \n\n### 9. **Gus flips d**\n- a: ON \n- b: ON \n- c: OFF \n- d: OFF \u2192 ON \n\n### 10. **Eve flips d**\n- a: ON \n- b: ON \n- c: OFF \n- d: ON \u2192 OFF \n\n### 11. **Fay flips a**\n- a: ON \u2192 OFF \n- b: ON \n- c: OFF \n- d: OFF \n\n### 12. **Hal flips a**\n- a: OFF \u2192 ON \n- b: ON \n- c: OFF \n- d: OFF \n\n### 13. **Dee flips b**\n- a: ON \n- b: ON \u2192 OFF \n- c: OFF \n- d: OFF \n\n### 14. **Ann flips b**\n- a: ON \n- b: OFF \u2192 ON \n- c: OFF \n- d: OFF \n\n### 15. **Ann flips b**\n- a: ON \n- b: ON \u2192 OFF \n- c: OFF \n- d: OFF \n\n### 16. **Fay flips d**\n- a: ON \n- b: OFF \n- c: OFF \n- d: OFF \u2192 ON \n\n### 17. **Dee flips c**\n- a: ON \n- b: OFF \n- c: OFF \u2192 ON \n- d: ON \n\n### 18. **Ben flips d**\n- a: ON \n- b: OFF \n- c: ON \n- d: ON \u2192 OFF \n\n### 19. **Cal flips d**\n- a: ON \n- b: OFF \n- c: ON \n- d: OFF \u2192 ON \n\n### 20. **Jo flips b**\n- a: ON \n- b: OFF \u2192 ON \n- c: ON \n- d: ON \n\n### 21. **Ann flips b**\n- a: ON \n- b: ON \u2192 OFF \n- c: ON \n- d: ON \n\n### 22. **Ann flips d**\n- a: ON \n- b: OFF \n- c: ON \n- d: ON \u2192 OFF \n\n### 23. **Dee flips b**\n- a: ON \n- b: OFF \u2192 ON \n- c: ON \n- d: OFF \n\n### 24. **Jo flips d**\n- a: ON \n- b: ON \n- c: ON \n- d: OFF \u2192 ON \n\n### 25. **Ann flips b**\n- a: ON \n- b: ON \u2192 OFF \n- c: ON \n- d: ON \n\n### 26. **Cal flips d**\n- a: ON \n- b: OFF \n- c: ON \n- d: ON \u2192 OFF \n\n### 27. **Ida flips c**\n- a: ON \n- b: OFF \n- c: ON \u2192 OFF \n- d: OFF \n\n### 28. **Fay flips a**\n- a: ON \u2192 OFF \n- b: OFF \n- c: OFF \n- d: OFF \n\n### 29. **Ida flips c**\n- a: OFF \n- b: OFF \n- c: OFF \u2192 ON \n- d: OFF \n\n### 30. **Cal flips b**\n- a: OFF \n- b: OFF \u2192 ON \n- c: ON \n- d: OFF \n\n### 31. **Hal flips d**\n- a: OFF \n- b: ON \n- c: ON \n- d: OFF \u2192 ON \n\n### 32. **Jo flips b**\n- a: OFF \n- b: ON \u2192 OFF \n- c: ON \n- d: ON \n\n---\n\n**Final states after all 32 flips:**\n- **a:** OFF \n- **b:** OFF \n- **c:** ON \n- **d:** ON \n\n---\n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 1113, "n_prompt": 303, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 3, "filler": 0, "answer": "on", "output": "Let's track the state of each light (A, B, C, D) step by step. \n**Initial state:** \nA: ON \nB: OFF \nC: ON \nD: OFF \n\nWe'll process each flip in order, updating the state after each one.\n\n---\n\n### 1. Dee flips **d** \nD: OFF \u2192 ON \n**A:ON, B:OFF, C:ON, D:ON**\n\n---\n\n### 2. Ann flips **b** \nB: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:ON**\n\n---\n\n### 3. Dee flips **a** \nA: ON \u2192 OFF \n**A:OFF, B:ON, C:ON, D:ON**\n\n---\n\n### 4. Ben flips **c** \nC: ON \u2192 OFF \n**A:OFF, B:ON, C:OFF, D:ON**\n\n---\n\n### 5. Hal flips **c** \nC: OFF \u2192 ON \n**A:OFF, B:ON, C:ON, D:ON**\n\n---\n\n### 6. Cal flips **d** \nD: ON \u2192 OFF \n**A:OFF, B:ON, C:ON, D:OFF**\n\n---\n\n### 7. Ben flips **b** \nB: ON \u2192 OFF \n**A:OFF, B:OFF, C:ON, D:OFF**\n\n---\n\n### 8. Hal flips **b** \nB: OFF \u2192 ON \n**A:OFF, B:ON, C:ON, D:OFF**\n\n---\n\n### 9. Fay flips **a** \nA: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:OFF**\n\n---\n\n### 10. Eve flips **c** \nC: ON \u2192 OFF \n**A:ON, B:ON, C:OFF, D:OFF**\n\n---\n\n### 11. Fay flips **d** \nD: OFF \u2192 ON \n**A:ON, B:ON, C:OFF, D:ON**\n\n---\n\n### 12. Ann flips **c** \nC: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:ON**\n\n---\n\n### 13. Jo flips **b** \nB: ON \u2192 OFF \n**A:ON, B:OFF, C:ON, D:ON**\n\n---\n\n### 14. Fay flips **b** \nB: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:ON**\n\n---\n\n### 15. Ida flips **a** \nA: ON \u2192 OFF \n**A:OFF, B:ON, C:ON, D:ON**\n\n---\n\n### 16. Dee flips **b** \nB: ON \u2192 OFF \n**A:OFF, B:OFF, C:ON, D:ON**\n\n---\n\n### 17. Hal flips **c** \nC: ON \u2192 OFF \n**A:OFF, B:OFF, C:OFF, D:ON**\n\n---\n\n### 18. Hal flips **b** \nB: OFF \u2192 ON \n**A:OFF, B:ON, C:OFF, D:ON**\n\n---\n\n### 19. Ann flips **d** \nD: ON \u2192 OFF \n**A:OFF, B:ON, C:OFF, D:OFF**\n\n---\n\n### 20. Fay flips **b** \nB: ON \u2192 OFF \n**A:OFF, B:OFF, C:OFF, D:OFF**\n\n---\n\n### 21. Ann flips **b** \nB: OFF \u2192 ON \n**A:OFF, B:ON, C:OFF, D:OFF**\n\n---\n\n### 22. Fay flips **a** \nA: OFF \u2192 ON \n**A:ON, B:ON, C:OFF, D:OFF**\n\n---\n\n### 23. Eve flips **c** \nC: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:OFF**\n\n---\n\n### 24. Hal flips **d** \nD: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:ON**\n\n---\n\n### 25. Eve flips **b** \nB: ON \u2192 OFF \n**A:ON, B:OFF, C:ON, D:ON**\n\n---\n\n### 26. Ben flips **c** \nC: ON \u2192 OFF \n**A:ON, B:OFF, C:OFF, D:ON**\n\n---\n\n### 27. Eve flips **a** \nA: ON \u2192 OFF \n**A:OFF, B:OFF, C:OFF, D:ON**\n\n---\n\n### 28. Ann flips **c** \nC: OFF \u2192 ON \n**A:OFF, B:OFF, C:ON, D:ON**\n\n---\n\n### 29. Dee flips **d** \nD: ON \u2192 OFF \n**A:OFF, B:OFF, C:ON, D:OFF**\n\n---\n\n### 30. Dee flips **a** \nA: OFF \u2192 ON \n**A:ON, B:OFF, C:ON, D:OFF**\n\n---\n\n### 31. Cal flips **b** \nB: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:OFF**\n\n---\n\n### 32. Gus flips **d** \nD: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:ON**\n\n---\n\n## **Final State:**\n- **A:** ON \n- **B:** ON \n- **C:** ON \n- **D:** ON \n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 1183, "n_prompt": 305, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 4, "filler": 0, "answer": "off", "output": "Let's track the state of each light (A=a, B=b, C=c, D=d) step by step. Start: A=0, B=1, C=0, D=0.\n\nI'll process each action in order, updating the lights:\n\n1. Jo flips a: A=1 \n2. Eve flips a: A=0 \n3. Hal flips b: B=0 \n4. Fay flips b: B=1 \n5. Ben flips a: A=1 \n6. Hal flips b: B=0 \n7. Gus flips d: D=1 \n8. Ben flips d: D=0 \n9. Gus flips c: C=1 \n10. Ann flips b: B=1 \n11. Gus flips b: B=0 \n12. Ben flips a: A=0 \n13. Jo flips c: C=0 \n14. Gus flips c: C=1 \n15. Dee flips c: C=0 \n16. Ann flips b: B=1 \n17. Eve flips a: A=1 \n18. Eve flips c: C=1 \n19. Hal flips c: C=0 \n20. Dee flips a: A=1 \n21. Gus flips a: A=0 \n22. Jo flips b: B=1 \n23. Gus flips a: A=1 \n24. Eve flips c: C=1 \n25. Dee flips b: B=0 \n26. Eve flips d: D=1 \n27. Gus flips d: D=0 \n28. Cal flips a: A=1 \n29. Eve flips c: C=0 \n30. Jo flips b: B=1 \n31. Hal flips a: A=0 \n32. Dee flips a: A=1 \n\n**Final states:** \nA = 1 (on) \nB = 1 (on) \nC = 0 (off) \nD = 0 (off) \n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 417, "n_prompt": 307, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 5, "filler": 0, "answer": "off", "output": "Let's track the state of each light (a, b, c, d) step by step. \n**Initial state:** \na: ON \nb: ON \nc: OFF \nd: ON \n\nWe'll process each person in order, flipping exactly one switch per person (toggle: ON\u2194OFF).\n\n---\n\n### 1. Cal flips b \nb: ON \u2192 OFF \n**a: ON, b: OFF, c: OFF, d: ON**\n\n---\n\n### 2. Fay flips d \nd: ON \u2192 OFF \n**a: ON, b: OFF, c: OFF, d: OFF**\n\n---\n\n### 3. Ben flips d \nd: OFF \u2192 ON \n**a: ON, b: OFF, c: OFF, d: ON**\n\n---\n\n### 4. Hal flips d \nd: ON \u2192 OFF \n**a: ON, b: OFF, c: OFF, d: OFF**\n\n---\n\n### 5. Hal flips a \na: ON \u2192 OFF \n**a: OFF, b: OFF, c: OFF, d: OFF**\n\n---\n\n### 6. Dee flips a \na: OFF \u2192 ON \n**a: ON, b: OFF, c: OFF, d: OFF**\n\n---\n\n### 7. Hal flips a \na: ON \u2192 OFF \n**a: OFF, b: OFF, c: OFF, d: OFF**\n\n---\n\n### 8. Dee flips a \na: OFF \u2192 ON \n**a: ON, b: OFF, c: OFF, d: OFF**\n\n---\n\n### 9. Cal flips b \nb: OFF \u2192 ON \n**a: ON, b: ON, c: OFF, d: OFF**\n\n---\n\n### 10. Dee flips a \na: ON \u2192 OFF \n**a: OFF, b: ON, c: OFF, d: OFF**\n\n---\n\n### 11. Ann flips a \na: OFF \u2192 ON \n**a: ON, b: ON, c: OFF, d: OFF**\n\n---\n\n### 12. Ida flips c \nc: OFF \u2192 ON \n**a: ON, b: ON, c: ON, d: OFF**\n\n---\n\n### 13. Ida flips b \nb: ON \u2192 OFF \n**a: ON, b: OFF, c: ON, d: OFF**\n\n---\n\n### 14. Ben flips b \nb: OFF \u2192 ON \n**a: ON, b: ON, c: ON, d: OFF**\n\n---\n\n### 15. Ben flips d \nd: OFF \u2192 ON \n**a: ON, b: ON, c: ON, d: ON**\n\n---\n\n### 16. Hal flips b \nb: ON \u2192 OFF \n**a: ON, b: OFF, c: ON, d: ON**\n\n---\n\n### 17. Ben flips a \na: ON \u2192 OFF \n**a: OFF, b: OFF, c: ON, d: ON**\n\n---\n\n### 18. Jo flips c \nc: ON \u2192 OFF \n**a: OFF, b: OFF, c: OFF, d: ON**\n\n---\n\n### 19. Ben flips a \na: OFF \u2192 ON \n**a: ON, b: OFF, c: OFF, d: ON**\n\n---\n\n### 20. Cal flips a \na: ON \u2192 OFF \n**a: OFF, b: OFF, c: OFF, d: ON**\n\n---\n\n### 21. Ann flips c \nc: OFF \u2192 ON \n**a: OFF, b: OFF, c: ON, d: ON**\n\n---\n\n### 22. Eve flips b \nb: OFF \u2192 ON \n**a: OFF, b: ON, c: ON, d: ON**\n\n---\n\n### 23. Jo flips a \na: OFF \u2192 ON \n**a: ON, b: ON, c: ON, d: ON**\n\n---\n\n### 24. Fay flips d \nd: ON \u2192 OFF \n**a: ON, b: ON, c: ON, d: OFF**\n\n---\n\n### 25. Eve flips a \na: ON \u2192 OFF \n**a: OFF, b: ON, c: ON, d: OFF**\n\n---\n\n## **Final States After All Flips:**\n- **a:** OFF \n- **b:** ON \n- **c:** ON \n- **d:** OFF \n\n---\n\n**Light c is ON.**\n\nAnswer: on", "pred": "on", "correct": false, "leaked": false, "n_gen": 913, "n_prompt": 302, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 6, "filler": 0, "answer": "on", "output": "Let's track the state of each light (A, B, C, D) as a binary variable: \n**0 = off, 1 = on**. \nWe'll process each flip in order, updating the corresponding light.\n\n---\n\n### **Initial State**\nA=0, B=0, C=0, D=0\n\n---\n\n### **Step-by-step flips (only showing changes):**\n\n#### **A flips:**\n1. Jo: A=1 \n2. Fay: A=0 \n3. Ida: A=1 \n4. Ann: A=0 \n5. Eve: \u2014 \n6. Fay: A=1 \n7. Cal: \u2014 \n8. Ann: A=1 \n9. Ben: A=0 \n10. Hal: \u2014 \n11. Jo: A=1 \n12. Ben: A=0 \n13. Dee: \u2014 \n14. Jo: A=1 \n15. Ben: A=0 \n16. Ben: A=1 \n17. Jo: A=0 \n\n**Final A:** **0** (off)\n\n---\n\n#### **B flips:**\n1. Ida: B=1 \n2. Eve: B=0 \n3. Cal: \u2014 \n4. Ann: \u2014 \n5. Hal: B=1 \n6. Gus: B=0 \n7. Jo: B=1 \n8. Dee: B=0 \n9. Ben: \u2014 \n10. Ben: B=1 \n11. Jo: B=0 \n\n**Final B:** **0** (off)\n\n---\n\n#### **C flips:**\n1. Ida: C=1 \n2. Gus: C=0 \n3. Ann: C=1 \n4. Hal: C=0 \n5. Ida: C=1 \n6. Jo: C=0 \n7. Gus: \u2014 \n8. Ida: C=1 \n\n**Final C:** **1** (on)\n\n---\n\n#### **D flips:**\n1. Ann: D=1 \n2. Eve: D=0 \n3. Cal: D=1 \n4. Fay: D=0 \n5. Jo: D=1 \n6. Ben: D=0 \n7. Ben: D=1 \n8. Dee: \u2014 \n9. Jo: D=0 \n10. Gus: D=1 \n11. Ida: D=0 \n12. Jo: \u2014 \n13. Ben: D=1 \n14. Ben: D=0 \n15. Jo: \u2014 \n\n**Final D:** **0** (off)\n\n---\n\n### **Final States**\n- **A:** 0 \u2192 **off** \n- **B:** 0 \u2192 **off** \n- **C:** 1 \u2192 **on** \n- **D:** 0 \u2192 **off** \n\n---\n\n**Answer: off**", "pred": "off", "correct": false, "leaked": false, "n_gen": 598, "n_prompt": 303, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 7, "filler": 0, "answer": "off", "output": "Let's track the state of light **d** step by step, starting from the initial state:\n\n**Initial:** \na: ON \nb: ON \nc: ON \nd: OFF \n\nWe'll go through each flip, updating only **d** (others can be ignored for this question):\n\n---\n\n### 1. Hal flips d \nd: OFF \u2192 ON \n\n### 2. Fay flips d \nd: ON \u2192 OFF \n\n### 3. Ben flips b (irrelevant to d) \nd stays OFF \n\n### 4. Fay flips b (irrelevant to d) \nd stays OFF \n\n### 5. Ben flips b (irrelevant to d) \nd stays OFF \n\n### 6. Cal flips c (irrelevant to d) \nd stays OFF \n\n### 7. Ben flips d \nd: OFF \u2192 ON \n\n### 8. Cal flips b (irrelevant to d) \nd stays ON \n\n### 9. Eve flips c (irrelevant to d) \nd stays ON \n\n### 10. Jo flips b (irrelevant to d) \nd stays ON \n\n### 11. Cal flips b (irrelevant to d) \nd stays ON \n\n### 12. Ida flips a (irrelevant to d) \nd stays ON \n\n### 13. Hal flips d \nd: ON \u2192 OFF \n\n### 14. Ben flips d \nd: OFF \u2192 ON \n\n### 15. Dee flips b (irrelevant to d) \nd stays ON \n\n### 16. Gus flips b (irrelevant to d) \nd stays ON \n\n### 17. Ann flips c (irrelevant to d) \nd stays ON \n\n### 18. Cal flips b (irrelevant to d) \nd stays ON \n\n### 19. Dee flips b (irrelevant to d) \nd stays ON \n\n### 20. Ann flips b (irrelevant to d) \nd stays ON \n\n### 21. Dee flips c (irrelevant to d) \nd stays ON \n\n### 22. Hal flips a (irrelevant to d) \nd stays ON \n\n### 23. Ann flips b (irrelevant to d) \nd stays ON \n\n### 24. Ben flips c (irrelevant to d) \nd stays ON \n\n### 25. Jo flips b (irrelevant to d) \nd stays ON \n\n### 26. Gus flips d \nd: ON \u2192 OFF \n\n---\n\n**Final state of d:** **OFF**\n\n---\n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 523, "n_prompt": 300, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 8, "filler": 0, "answer": "off", "output": "Let's track the state of light **c** through each flip. We'll list only the relevant steps (flips of switch **c**) and the resulting state after each:\n\n---\n\n### Initial State:\n- **c**: **OFF**\n\n---\n\n### Steps affecting **c** (switch c is flipped):\n\n1. **Hal flips c** \n - c: OFF \u2192 **ON**\n\n2. **Gus flips b** \n - (No effect on c)\n\n3. **Gus flips a** \n - (No effect on c)\n\n4. **Hal flips c** \n - c: ON \u2192 **OFF**\n\n5. **Cal flips a** \n - (No effect on c)\n\n6. **Gus flips d** \n - (No effect on c)\n\n7. **Ben flips d** \n - (No effect on c)\n\n8. **Ann flips a** \n - (No effect on c)\n\n9. **Gus flips c** \n - c: OFF \u2192 **ON**\n\n10. **Dee flips c** \n - c: ON \u2192 **OFF**\n\n11. **Cal flips a** \n - (No effect on c)\n\n12. **Gus flips d** \n - (No effect on c)\n\n13. **Ben flips d** \n - (No effect on c)\n\n14. **Jo flips d** \n - (No effect on c)\n\n15. **Fay flips b** \n - (No effect on c)\n\n16. **Jo flips c** \n - c: OFF \u2192 **ON**\n\n17. **Fay flips c** \n - c: ON \u2192 **OFF**\n\n18. **Ida flips b** \n - (No effect on c)\n\n19. **Gus flips c** \n - c: OFF \u2192 **ON**\n\n20. **Eve flips b** \n - (No effect on c)\n\n21. **Cal flips c** \n - c: ON \u2192 **OFF**\n\n22. **Jo flips d** \n - (No effect on c)\n\n23. **Ann flips d** \n - (No effect on c)\n\n24. **Ben flips d** \n - (No effect on c)\n\n25. **Jo flips d** \n - (No effect on c)\n\n26. **Fay flips a** \n - (No effect on c)\n\n27. **Jo flips c** \n - c: OFF \u2192 **ON**\n\n28. **Fay flips b** \n - (No effect on c)\n\n29. **Fay flips c** \n - c: ON \u2192 **OFF**\n\n30. **Ida flips b** \n - (No effect on c)\n\n31. **Gus flips c** \n - c: OFF \u2192 **ON**\n\n32. **Eve flips b** \n - (No effect on c)\n\n---\n\n### **Final State of Light c:**\nAfter the **last flip (Gus flips c)**, **light c is ON**.\n\n---\n\n**Answer: on**", "pred": "on", "correct": false, "leaked": false, "n_gen": 636, "n_prompt": 303, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 9, "filler": 0, "answer": "on", "output": "Let's track the state of each light (a, b, c, d) step by step. \n**Initial state:** \na: OFF \nb: ON \nc: ON \nd: ON \n\nWe'll process each flip in order, updating the state after each flip.\n\n---\n\n### 1. Dee flips d \nd: ON \u2192 OFF \n**a: OFF, b: ON, c: ON, d: OFF**\n\n---\n\n### 2. Gus flips b \nb: ON \u2192 OFF \n**a: OFF, b: OFF, c: ON, d: OFF**\n\n---\n\n### 3. Fay flips b \nb: OFF \u2192 ON \n**a: OFF, b: ON, c: ON, d: OFF**\n\n---\n\n### 4. Hal flips c \nc: ON \u2192 OFF \n**a: OFF, b: ON, c: OFF, d: OFF**\n\n---\n\n### 5. Dee flips d \nd: OFF \u2192 ON \n**a: OFF, b: ON, c: OFF, d: ON**\n\n---\n\n### 6. Dee flips c \nc: OFF \u2192 ON \n**a: OFF, b: ON, c: ON, d: ON**\n\n---\n\n### 7. Eve flips b \nb: ON \u2192 OFF \n**a: OFF, b: OFF, c: ON, d: ON**\n\n---\n\n### 8. Eve flips a \na: OFF \u2192 ON \n**a: ON, b: OFF, c: ON, d: ON**\n\n---\n\n### 9. Eve flips c \nc: ON \u2192 OFF \n**a: ON, b: OFF, c: OFF, d: ON**\n\n---\n\n### 10. Ann flips b \nb: OFF \u2192 ON \n**a: ON, b: ON, c: OFF, d: ON**\n\n---\n\n### 11. Ann flips d \nd: ON \u2192 OFF \n**a: ON, b: ON, c: OFF, d: OFF**\n\n---\n\n### 12. Ida flips a \na: ON \u2192 OFF \n**a: OFF, b: ON, c: OFF, d: OFF**\n\n---\n\n### 13. Gus flips a \na: OFF \u2192 ON \n**a: ON, b: ON, c: OFF, d: OFF**\n\n---\n\n### 14. Cal flips b \nb: ON \u2192 OFF \n**a: ON, b: OFF, c: OFF, d: OFF**\n\n---\n\n### 15. Ann flips d \nd: OFF \u2192 ON \n**a: ON, b: OFF, c: OFF, d: ON**\n\n---\n\n### 16. Cal flips c \nc: OFF \u2192 ON \n**a: ON, b: OFF, c: ON, d: ON**\n\n---\n\n### 17. Ben flips a \na: ON \u2192 OFF \n**a: OFF, b: OFF, c: ON, d: ON**\n\n---\n\n### 18. Gus flips d \nd: ON \u2192 OFF \n**a: OFF, b: OFF, c: ON, d: OFF**\n\n---\n\n### 19. Eve flips c \nc: ON \u2192 OFF \n**a: OFF, b: OFF, c: OFF, d: OFF**\n\n---\n\n### 20. Jo flips c \nc: OFF \u2192 ON \n**a: OFF, b: OFF, c: ON, d: OFF**\n\n---\n\n### 21. Fay flips b \nb: OFF \u2192 ON \n**a: OFF, b: ON, c: ON, d: OFF**\n\n---\n\n### 22. Hal flips b \nb: ON \u2192 OFF \n**a: OFF, b: OFF, c: ON, d: OFF**\n\n---\n\n### 23. Hal flips d \nd: OFF \u2192 ON \n**a: OFF, b: OFF, c: ON, d: ON**\n\n---\n\n### 24. Gus flips c \nc: ON \u2192 OFF \n**a: OFF, b: OFF, c: OFF, d: ON**\n\n---\n\n### 25. Dee flips c \nc: OFF \u2192 ON \n**a: OFF, b: OFF, c: ON, d: ON**\n\n---\n\n### 26. Dee flips c \nc: ON \u2192 OFF \n**a: OFF, b: OFF, c: OFF, d: ON**\n\n---\n\n### 27. Ben flips c \nc: OFF \u2192 ON \n**a: OFF, b: OFF, c: ON, d: ON**\n\n---\n\n### 28. Cal flips a \na: OFF \u2192 ON \n**a: ON, b: OFF, c: ON, d: ON**\n\n---\n\n### 29. Ann flips c \nc: ON \u2192 OFF \n**a: ON, b: OFF, c: OFF, d: ON**\n\n---\n\n### 30. Eve flips a \na: ON \u2192 OFF \n**a: OFF, b: OFF, c: OFF, d: ON**\n\n---\n\n### 31. Dee flips c \nc: OFF \u2192 ON \n**a: OFF, b: OFF, c: ON, d: ON**\n\n---\n\n## **Final State After All Flips:**\n- **a:** OFF \n- **b:** OFF \n- **c:** ON \n- **d:** ON \n\n**Question:** Is light **a** on or off now?\n\n---\n\nAnswer: **off**", "pred": "off", "correct": false, "leaked": false, "n_gen": 1105, "n_prompt": 308, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 10, "filler": 0, "answer": "on", "output": "Let's track the state of each light (A, B, C, D) step by step. \n**Initial state:** \nA: ON \nB: OFF \nC: OFF \nD: ON \n\nWe'll process each flip in order, updating the state after each action.\n\n---\n\n### 1. Cal flips **B** \nB: OFF \u2192 ON \n**A: ON | B: ON | C: OFF | D: ON**\n\n---\n\n### 2. Ben flips **B** \nB: ON \u2192 OFF \n**A: ON | B: OFF | C: OFF | D: ON**\n\n---\n\n### 3. Ann flips **B** \nB: OFF \u2192 ON \n**A: ON | B: ON | C: OFF | D: ON**\n\n---\n\n### 4. Dee flips **D** \nD: ON \u2192 OFF \n**A: ON | B: ON | C: OFF | D: OFF**\n\n---\n\n### 5. Gus flips **C** \nC: OFF \u2192 ON \n**A: ON | B: ON | C: ON | D: OFF**\n\n---\n\n### 6. Ida flips **C** \nC: ON \u2192 OFF \n**A: ON | B: ON | C: OFF | D: OFF**\n\n---\n\n### 7. Gus flips **C** \nC: OFF \u2192 ON \n**A: ON | B: ON | C: ON | D: OFF**\n\n---\n\n### 8. Jo flips **D** \nD: OFF \u2192 ON \n**A: ON | B: ON | C: ON | D: ON**\n\n---\n\n### 9. Cal flips **C** \nC: ON \u2192 OFF \n**A: ON | B: ON | C: OFF | D: ON**\n\n---\n\n### 10. Ann flips **D** \nD: ON \u2192 OFF \n**A: ON | B: ON | C: OFF | D: OFF**\n\n---\n\n### 11. Ann flips **A** \nA: ON \u2192 OFF \n**A: OFF | B: ON | C: OFF | D: OFF**\n\n---\n\n### 12. Fay flips **C** \nC: OFF \u2192 ON \n**A: OFF | B: ON | C: ON | D: OFF**\n\n---\n\n### 13. Hal flips **B** \nB: ON \u2192 OFF \n**A: OFF | B: OFF | C: ON | D: OFF**\n\n---\n\n### 14. Eve flips **B** \nB: OFF \u2192 ON \n**A: OFF | B: ON | C: ON | D: OFF**\n\n---\n\n### 15. Ben flips **C** \nC: ON \u2192 OFF \n**A: OFF | B: ON | C: OFF | D: OFF**\n\n---\n\n### 16. Jo flips **B** \nB: ON \u2192 OFF \n**A: OFF | B: OFF | C: OFF | D: OFF**\n\n---\n\n### 17. Ann flips **C** \nC: OFF \u2192 ON \n**A: OFF | B: OFF | C: ON | D: OFF**\n\n---\n\n### 18. Ann flips **C** \nC: ON \u2192 OFF \n**A: OFF | B: OFF | C: OFF | D: OFF**\n\n---\n\n### 19. Fay flips **A** \nA: OFF \u2192 ON \n**A: ON | B: OFF | C: OFF | D: OFF**\n\n---\n\n### 20. Dee flips **D** \nD: OFF \u2192 ON \n**A: ON | B: OFF | C: OFF | D: ON**\n\n---\n\n### 21. Eve flips **C** \nC: OFF \u2192 ON \n**A: ON | B: OFF | C: ON | D: ON**\n\n---\n\n### 22. Dee flips **C** \nC: ON \u2192 OFF \n**A: ON | B: OFF | C: OFF | D: ON**\n\n---\n\n### 23. Gus flips **B** \nB: OFF \u2192 ON \n**A: ON | B: ON | C: OFF | D: ON**\n\n---\n\n### 24. Cal flips **D** \nD: ON \u2192 OFF \n**A: ON | B: ON | C: OFF | D: OFF**\n\n---\n\n### 25. Fay flips **D** \nD: OFF \u2192 ON \n**A: ON | B: ON | C: OFF | D: ON**\n\n---\n\n### 26. Eve flips **C** \nC: OFF \u2192 ON \n**A: ON | B: ON | C: ON | D: ON**\n\n---\n\n### 27. Dee flips **C** \nC: ON \u2192 OFF \n**A: ON | B: ON | C: OFF | D: ON**\n\n---\n\n### 28. Gus flips **D** \nD: ON \u2192 OFF \n**A: ON | B: ON | C: OFF | D: OFF**\n\n---\n\n### 29. Fay flips **D** \nD: OFF \u2192 ON \n**A: ON | B: ON | C: OFF | D: ON**\n\n---\n\n### 30. Cal flips **C** \nC: OFF \u2192 ON \n**A: ON | B: ON | C: ON | D: ON**\n\n---\n\n### 31. Eve flips **D** \nD: ON \u2192 OFF \n**A: ON | B: ON | C: ON | D: OFF**\n\n---\n\n### 32. Hal flips **D** \nD: OFF \u2192 ON \n**A: ON | B: ON | C: ON | D: ON**\n\n---\n\n## **Final State:**\n- **A:** ON \n- **B:** ON \n- **C:** ON \n- **D:** ON \n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 1183, "n_prompt": 305, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 11, "filler": 0, "answer": "off", "output": "Let's track the state of each light (a, b, c, d) step by step. \n**Initial state:** \na: ON \nb: ON \nc: ON \nd: ON \n\nWe'll process each flip in order, toggling the specified light (ON\u2192OFF or OFF\u2192ON). \nI'll use 1=ON, 0=OFF for clarity.\n\n---\n\n### Step-by-step flips\n\n| Step | Person | Switch | Current State | After Flip |\n|------|--------|--------|---------------|------------|\n| 1 | Ben | b | b=1 \u2192 0 | a:1, b:0, c:1, d:1 |\n| 2 | Dee | a | a=1 \u2192 0 | a:0, b:0, c:1, d:1 |\n| 3 | Ben | b | b=0 \u2192 1 | a:0, b:1, c:1, d:1 |\n| 4 | Hal | a | a=0 \u2192 1 | a:1, b:1, c:1, d:1 |\n| 5 | Gus | b | b=1 \u2192 0 | a:1, b:0, c:1, d:1 |\n| 6 | Fay | b | b=0 \u2192 1 | a:1, b:1, c:1, d:1 |\n| 7 | Eve | d | d=1 \u2192 0 | a:1, b:1, c:1, d:0 |\n| 8 | Jo | b | b=1 \u2192 0 | a:1, b:0, c:1, d:0 |\n| 9 | Ida | a | a=1 \u2192 0 | a:0, b:0, c:1, d:0 |\n|10 | Jo | b | b=0 \u2192 1 | a:0, b:1, c:1, d:0 |\n|11 | Ida | c | c=1 \u2192 0 | a:0, b:1, c:0, d:0 |\n|12 | Ben | a | a=0 \u2192 1 | a:1, b:1, c:0, d:0 |\n|13 | Ann | c | c=0 \u2192 1 | a:1, b:1, c:1, d:0 |\n|14 | Cal | b | b=1 \u2192 0 | a:1, b:0, c:1, d:0 |\n|15 | Eve | a | a=1 \u2192 0 | a:0, b:0, c:1, d:0 |\n|16 | Ben | d | d=0 \u2192 1 | a:0, b:0, c:1, d:1 |\n|17 | Hal | a | a=0 \u2192 1 | a:1, b:0, c:1, d:1 |\n|18 | Ben | c | c=1 \u2192 0 | a:1, b:0, c:0, d:1 |\n|19 | Eve | b | b=0 \u2192 1 | a:1, b:1, c:0, d:1 |\n|20 | Eve | d | d=1 \u2192 0 | a:1, b:1, c:0, d:0 |\n|21 | Eve | d | d=0 \u2192 1 | a:1, b:1, c:0, d:1 |\n|22 | Hal | b | b=1 \u2192 0 | a:1, b:0, c:0, d:1 |\n|23 | Ida | a | a=1 \u2192 0 | a:0, b:0, c:0, d:1 |\n|24 | Jo | d | d=1 \u2192 0 | a:0, b:0, c:0, d:0 |\n|25 | Jo | a | a=0 \u2192 1 | a:1, b:0, c:0, d:0 |\n|26 | Fay | a | a=1 \u2192 0 | a:0, b:0, c:0, d:0 |\n|27 | Fay | a | a=0 \u2192 1 | a:1, b:0, c:0, d:0 |\n|28 | Ann | b | b=0 \u2192 1 | a:1, b:1, c:0, d:0 |\n|29 | Ida | a | a=1 \u2192 0 | a:0, b:1, c:0, d:0 |\n\n---\n\n**Final states after all flips:** \na: **OFF** \nb: ON \nc: OFF \nd: OFF \n\n---\n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 1144, "n_prompt": 305, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 12, "filler": 0, "answer": "off", "output": "Let's track the state of light **d** through each flip. \n**Initial state:** \n- a: ON \n- b: OFF \n- c: ON \n- d: ON \n\nWe'll list every flip involving **d**, and update its state step by step.\n\n---\n\n### **Flips affecting d (in order):**\n1. **Gus flips d** \n d: ON \u2192 OFF \n (d is now OFF)\n\n2. **Dee flips c** \n (d unchanged)\n\n3. **Fay flips c** \n (d unchanged)\n\n4. **Ida flips d** \n d: OFF \u2192 ON \n (d is now ON)\n\n5. **Jo flips c** \n (d unchanged)\n\n6. **Hal flips c** \n (d unchanged)\n\n7. **Eve flips a** \n (d unchanged)\n\n8. **Dee flips d** \n d: ON \u2192 OFF \n (d is now OFF)\n\n9. **Hal flips c** \n (d unchanged)\n\n10. **Eve flips a** \n (d unchanged)\n\n11. **Dee flips a** \n (d unchanged)\n\n12. **Cal flips d** \n d: OFF \u2192 ON \n (d is now ON)\n\n13. **Hal flips a** \n (d unchanged)\n\n14. **Hal flips c** \n (d unchanged)\n\n15. **Dee flips c** \n (d unchanged)\n\n16. **Gus flips b** \n (d unchanged)\n\n17. **Eve flips d** \n d: ON \u2192 OFF \n (d is now OFF)\n\n18. **Ida flips c** \n (d unchanged)\n\n19. **Eve flips d** \n d: OFF \u2192 ON \n (d is now ON)\n\n20. **Hal flips c** \n (d unchanged)\n\n21. **Hal flips b** \n (d unchanged)\n\n22. **Jo flips d** \n d: ON \u2192 OFF \n (d is now OFF)\n\n23. **Cal flips b** \n (d unchanged)\n\n24. **Eve flips d** \n d: OFF \u2192 ON \n (d is now ON)\n\n25. **Ida flips c** \n (d unchanged)\n\n26. **Eve flips d** \n d: ON \u2192 OFF \n (d is now OFF)\n\n27. **Hal flips c** \n (d unchanged)\n\n28. **Hal flips b** \n (d unchanged)\n\n29. **Jo flips d** \n d: OFF \u2192 ON \n (d is now ON)\n\n---\n\n### **Final state of d:** \nAfter the **last flip (Jo flips d)**, **light d is ON**.\n\n---\n\n**Answer: on**", "pred": "on", "correct": false, "leaked": false, "n_gen": 585, "n_prompt": 307, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 13, "filler": 0, "answer": "on", "output": "Let's track the state of light **d** through each flip that affects it. \nInitially: **d = off**.\n\nWe'll list **every flip of switch d** (and note the current state before/after):\n\n---\n\n### 1. **Cal flips switch d** \n- **Before:** d = off \n- **After:** d = **on**\n\n---\n\n### 2. **Hal flips switch d** \n- **Before:** d = on \n- **After:** d = **off**\n\n---\n\n### 3. **Ida flips switch d** \n- **Before:** d = off \n- **After:** d = **on**\n\n---\n\n### 4. **Hal flips switch d** \n- **Before:** d = on \n- **After:** d = **off**\n\n---\n\n#### **No other flips of switch d occur after this point** (the rest are flips of a, b, or c).\n\n---\n\n## **Final State of Light d**\nAfter the last flip (Hal flips d), **light d is OFF**.\n\n---\n\n**Answer: off**", "pred": "off", "correct": false, "leaked": false, "n_gen": 221, "n_prompt": 308, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 14, "filler": 0, "answer": "on", "output": "Let's track the state of each light (A=a, B=b, C=c, D=d) step by step. \n**Initial state:** \nA: ON \nB: OFF \nC: OFF \nD: ON \n\nWe'll process each flip in order, updating the state after each one.\n\n---\n\n### 1. Hal flips **c**\n- C: OFF \u2192 ON \n**A:ON, B:OFF, C:ON, D:ON**\n\n---\n\n### 2. Ben flips **d**\n- D: ON \u2192 OFF \n**A:ON, B:OFF, C:ON, D:OFF**\n\n---\n\n### 3. Ida flips **a**\n- A: ON \u2192 OFF \n**A:OFF, B:OFF, C:ON, D:OFF**\n\n---\n\n### 4. Ida flips **a** (again)\n- A: OFF \u2192 ON \n**A:ON, B:OFF, C:ON, D:OFF**\n\n---\n\n### 5. Jo flips **d**\n- D: OFF \u2192 ON \n**A:ON, B:OFF, C:ON, D:ON**\n\n---\n\n### 6. Ida flips **d**\n- D: ON \u2192 OFF \n**A:ON, B:OFF, C:ON, D:OFF**\n\n---\n\n### 7. Cal flips **a**\n- A: ON \u2192 OFF \n**A:OFF, B:OFF, C:ON, D:OFF**\n\n---\n\n### 8. Fay flips **a**\n- A: OFF \u2192 ON \n**A:ON, B:OFF, C:ON, D:OFF**\n\n---\n\n### 9. Ben flips **b**\n- B: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:OFF**\n\n---\n\n### 10. Ida flips **b**\n- B: ON \u2192 OFF \n**A:ON, B:OFF, C:ON, D:OFF**\n\n---\n\n### 11. Cal flips **a**\n- A: ON \u2192 OFF \n**A:OFF, B:OFF, C:ON, D:OFF**\n\n---\n\n### 12. Hal flips **d**\n- D: OFF \u2192 ON \n**A:OFF, B:OFF, C:ON, D:ON**\n\n---\n\n### 13. Eve flips **b**\n- B: OFF \u2192 ON \n**A:OFF, B:ON, C:ON, D:ON**\n\n---\n\n### 14. Ann flips **d**\n- D: ON \u2192 OFF \n**A:OFF, B:ON, C:ON, D:OFF**\n\n---\n\n### 15. Ida flips **c**\n- C: ON \u2192 OFF \n**A:OFF, B:ON, C:OFF, D:OFF**\n\n---\n\n### 16. Eve flips **d**\n- D: OFF \u2192 ON \n**A:OFF, B:ON, C:OFF, D:ON**\n\n---\n\n### 17. Gus flips **c**\n- C: OFF \u2192 ON \n**A:OFF, B:ON, C:ON, D:ON**\n\n---\n\n### 18. Gus flips **b**\n- B: ON \u2192 OFF \n**A:OFF, B:OFF, C:ON, D:ON**\n\n---\n\n### 19. Cal flips **c**\n- C: ON \u2192 OFF \n**A:OFF, B:OFF, C:OFF, D:ON**\n\n---\n\n### 20. Cal flips **a**\n- A: OFF \u2192 ON \n**A:ON, B:OFF, C:OFF, D:ON**\n\n---\n\n### 21. Gus flips **b**\n- B: OFF \u2192 ON \n**A:ON, B:ON, C:OFF, D:ON**\n\n---\n\n### 22. Ann flips **c**\n- C: OFF \u2192 ON \n**A:ON, B:ON, C:ON, D:ON**\n\n---\n\n### 23. Ann flips **c** (again)\n- C: ON \u2192 OFF \n**A:ON, B:ON, C:OFF, D:ON**\n\n---\n\n### 24. Eve flips **b**\n- B: ON \u2192 OFF \n**A:ON, B:OFF, C:OFF, D:ON**\n\n---\n\n### 25. Ann flips **a**\n- A: ON \u2192 OFF \n**A:OFF, B:OFF, C:OFF, D:ON**\n\n---\n\n### 26. Eve flips **b**\n- B: OFF \u2192 ON \n**A:OFF, B:ON, C:OFF, D:ON**\n\n---\n\n### 27. Jo flips **b**\n- B: ON \u2192 OFF \n**A:OFF, B:OFF, C:OFF, D:ON**\n\n---\n\n### 28. Ann flips **a**\n- A: OFF \u2192 ON \n**A:ON, B:OFF, C:OFF, D:ON**\n\n---\n\n### 29. Eve flips **b**\n- B: OFF \u2192 ON \n**A:ON, B:ON, C:OFF, D:ON**\n\n---\n\n### 30. Ann flips **a**\n- A: ON \u2192 OFF \n**A:OFF, B:ON, C:OFF, D:ON**\n\n---\n\n### 31. Fay flips **d**\n- D: ON \u2192 OFF \n**A:OFF, B:ON, C:OFF, D:OFF**\n\n---\n\n### 32. Dee flips **d**\n- D: OFF \u2192 ON \n**A:OFF, B:ON, C:OFF, D:ON**\n\n---\n\n## **Final State:**\n- **A (light a): OFF**\n- **B (light b): ON**\n- **C (light c): OFF**\n- **D (light d): ON**\n\n**Question:** Is light **b** on or off now?\n\n**Answer: on**", "pred": "on", "correct": true, "leaked": false, "n_gen": 1222, "n_prompt": 306, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 15, "filler": 0, "answer": "off", "output": "Let's track the state of light **c** through each flip involving it. \nWe'll list every time someone flips **c**, and note its state before/after.\n\n**Initial state:** \na: off \nb: off \nc: off \nd: off \n\n---\n\n### **Flips on c (in order):**\n1. **Dee** flips c \n - c: off \u2192 **on** \n2. **Ben** flips c \n - c: on \u2192 **off** \n3. **Ann** flips c \n - c: off \u2192 **on** \n4. **Ann** flips c \n - c: on \u2192 **off** \n5. **Fay** flips c \n - c: off \u2192 **on** \n6. **Fay** flips c \n - c: on \u2192 **off** \n7. **Cal** flips c \n - c: off \u2192 **on** \n8. **Ann** flips c \n - c: on \u2192 **off** \n\n---\n\n### **Summary of flips on c:**\n- **On:** Dee (1), Ann (3), Fay (5), Fay (5 again? Wait, let's recount carefully\u2014see below for exact sequence) \n- **Off:** Ben (2), Ann (4), Fay (6), Cal (7), Ann (8)\n\nBut let's **number each flip involving c** and track step by step:\n\n#### **Step-by-step flips on c:**\n1. **Dee** flips c: off \u2192 **on** \n2. **Ben** flips c: on \u2192 **off** \n3. **Ann** flips c: off \u2192 **on** \n4. **Ann** flips c: on \u2192 **off** \n5. **Fay** flips c: off \u2192 **on** \n6. **Fay** flips c: on \u2192 **off** \n7. **Cal** flips c: off \u2192 **on** \n8. **Ann** flips c: on \u2192 **off** \n\nSo after **8 flips** on c, the final state is **off**.\n\n---\n\n### **Final check:**\n- Number of flips on c: **8** (even number)\n- Each flip toggles the state.\n- Starting from **off**, after an **even** number of toggles \u2192 **off**.\n\n---\n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 497, "n_prompt": 303, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 16, "filler": 0, "answer": "off", "output": "Let's track the state of light **d** through each flip. \n**Initial state:** d = ON (1)\n\nWe'll list only the flips that affect **d**, with the flipper and the action (flip = toggle):\n\n1. **Fay:** flips a \u2192 d unchanged \n2. **Cal:** flips d \u2192 d = OFF (0) \n3. **Hal:** flips c \u2192 d unchanged \n4. **Jo:** flips b \u2192 d unchanged \n5. **Eve:** flips b \u2192 d unchanged \n6. **Ann:** flips a \u2192 d unchanged \n7. **Gus:** flips d \u2192 d = ON (1) \n8. **Jo:** flips d \u2192 d = OFF (0) \n9. **Cal:** flips d \u2192 d = ON (1) \n10. **Hal:** flips b \u2192 d unchanged \n11. **Ben:** flips c \u2192 d unchanged \n12. **Cal:** flips b \u2192 d unchanged \n13. **Gus:** flips b \u2192 d unchanged \n14. **Eve:** flips a \u2192 d unchanged \n15. **Ben:** flips c \u2192 d unchanged \n16. **Ann:** flips a \u2192 d unchanged \n17. **Ann:** flips a \u2192 d unchanged \n18. **Jo:** flips b \u2192 d unchanged \n19. **Hal:** flips a \u2192 d unchanged \n20. **Gus:** flips d \u2192 d = OFF (0) \n21. **Jo:** flips d \u2192 d = ON (1) \n22. **Cal:** flips a \u2192 d unchanged \n23. **Ida:** flips d \u2192 d = OFF (0) \n24. **Cal:** flips c \u2192 d unchanged \n25. **Fay:** flips c \u2192 d unchanged \n26. **Fay:** flips d \u2192 d = ON (1) \n27. **Cal:** flips a \u2192 d unchanged \n\n**Final state of d:** **ON**\n\nAnswer: on", "pred": "on", "correct": false, "leaked": false, "n_gen": 398, "n_prompt": 300, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 17, "filler": 0, "answer": "off", "output": "Let's track the state of **light b** through each flip. We'll only focus on flips involving **b** and tally the total number of times it's toggled (each flip toggles it: on\u2192off or off\u2192on).\n\n### Initial state:\n- **b:** OFF\n\n---\n\n### List of flips involving **b** (with order):\n\n1. **Ann** flips **b** \n \u2192 **b:** ON\n\n2. **Ida** flips **a** (no effect on b)\n\n3. **Ida** flips **d** (no effect on b)\n\n4. **Ann** flips **d** (no effect on b)\n\n5. **Dee** flips **d** (no effect on b)\n\n6. **Ann** flips **b** \n \u2192 **b:** OFF\n\n7. **Dee** flips **d** (no effect on b)\n\n8. **Ann** flips **b** \n \u2192 **b:** ON\n\n9. **Dee** flips **b** \n \u2192 **b:** OFF\n\n10. **Ben** flips **b** \n \u2192 **b:** ON\n\n11. **Jo** flips **c** (no effect on b)\n\n12. **Hal** flips **b** \n \u2192 **b:** OFF\n\n13. **Ann** flips **d** (no effect on b)\n\n14. **Dee** flips **d** (no effect on b)\n\n15. **Ida** flips **d** (no effect on b)\n\n16. **Eve** flips **b** \n \u2192 **b:** ON\n\n17. **Ida** flips **b** \n \u2192 **b:** OFF\n\n18. **Eve** flips **b** \n \u2192 **b:** ON\n\n19. **Hal** flips **a** (no effect on b)\n\n20. **Hal** flips **a** (no effect on b)\n\n21. **Hal** flips **d** (no effect on b)\n\n22. **Ida** flips **a** (no effect on b)\n\n23. **Ida** flips **d** (no effect on b)\n\n24. **Ben** flips **c** (no effect on b)\n\n25. **Ben** flips **b** \n \u2192 **b:** OFF\n\n26. **Dee** flips **b** \n \u2192 **b:** ON\n\n27. **Jo** flips **a** (no effect on b)\n\n28. **Eve** flips **b** \n \u2192 **b:** OFF\n\n29. **Ann** flips **b** \n \u2192 **b:** ON\n\n30. **Gus** flips **c** (no effect on b)\n\n31. **Fay** flips **b** \n \u2192 **b:** OFF\n\n32. **Ben** flips **b** \n \u2192 **b:** ON\n\n33. **Jo** flips **c** (no effect on b)\n\n34. **Ann** flips **a** (no effect on b)\n\n35. **Gus** flips **c** (no effect on b)\n\n36. **Fay** flips **b** \n \u2192 **b:** ON\n\n---\n\n### **Final tally for light b:**\nLet's count the flips that toggled **b** (each \"flip b\" toggles it):\n\n1. Ann (1) \u2192 ON \n2. Ann (6) \u2192 OFF \n3. Ann (8) \u2192 ON \n4. Dee (9) \u2192 OFF \n5. Ben (10) \u2192 ON \n6. Hal (12) \u2192 OFF \n7. Eve (16) \u2192 ON \n8. Ida (17) \u2192 OFF \n9. Eve (18) \u2192 ON \n10. Ben (25) \u2192 OFF \n11. Dee (26) \u2192 ON \n12. Eve (28) \u2192 OFF \n13. Ann (29) \u2192 ON \n14. Fay (31) \u2192 OFF \n15. Ben (32) \u2192 ON \n\n**Total flips on b:** 15 \n**Number of toggles:** 15 (odd) \n**Start:** OFF \n**After odd toggles:** **ON**\n\n---\n\n**Answer: on**", "pred": "on", "correct": false, "leaked": false, "n_gen": 871, "n_prompt": 304, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 18, "filler": 0, "answer": "off", "output": "Let's track the state of light **c** through each flip that affects it. \nInitially: **c = off**.\n\nWe'll list **only the flips that affect light c** (i.e., when someone flips **switch c**):\n\n1. **Ann** flips **c** \u2192 **c = on** \n2. **Cal** flips **c** (later) \u2192 **c = off** \n3. **Hal** flips **c** \u2192 **c = on** \n4. **Ann** flips **c** (again) \u2192 **c = off** \n\nNow, let's go through the full list and mark every time **switch c** is flipped:\n\n### Pass-by-by list (with only c-flips noted):\n\n1. Ann \u2014 **c** (on) \n2. Cal \u2014 d \n3. Ida \u2014 d \n4. Hal \u2014 d \n5. Cal \u2014 a \n6. Fay \u2014 b \n7. Cal \u2014 a \n8. Dee \u2014 d \n9. Gus \u2014 b \n10. Cal \u2014 d \n11. Hal \u2014 b \n12. Cal \u2014 **c** (off) \n13. Gus \u2014 d \n14. Cal \u2014 b \n15. Gus \u2014 d \n16. Eve \u2014 d \n17. Fay \u2014 d \n18. Eve \u2014 b \n19. Dee \u2014 b \n20. Cal \u2014 d \n21. Cal \u2014 d \n22. Ann \u2014 **c** (off \u2192 on) \n23. Ida \u2014 a \n24. Hal \u2014 c (on \u2192 off) \n25. Cal \u2014 b \n26. Ann \u2014 b \n27. Ben \u2014 d \n28. Jo \u2014 b \n29. Gus \u2014 a \n30. Eve \u2014 b \n31. Ida \u2014 b \n32. Hal \u2014 b \n\n---\n\n### Step-by-step tally for **light c**:\n\n| Step | Who | Action | c state before | c state after |\n|------|---------|-------------|----------------|---------------|\n| 1 | Ann | c | off | **on** |\n| 12 | Cal | c | on | **off** |\n| 22 | Ann | c | off | **on** |\n| 24 | Hal | c | on | **off** |\n\n**No further flips to c after step 24.**\n\n---\n\n### Final state of **light c**:\nAfter the **last flip** (step 24), **c is OFF**.\n\n---\n\n**Answer: off**", "pred": "off", "correct": true, "leaked": false, "n_gen": 531, "n_prompt": 303, "truncated": false}
+{"task": "T5", "fmt": "nl", "n": 32, "idx": 19, "filler": 0, "answer": "off", "output": "Let's track the state of light **d** step by step through the sequence of flips. We'll only focus on **d** and note each time it is flipped (from its current state):\n\n**Initial state:** \nd = **off**\n\nNow, process each flip involving **d** in order, updating its state:\n\n1. **Eve flips d:** \n off \u2192 **on**\n\n2. **Jo flips c** (no effect on d)\n\n3. **Ben flips b** (no effect on d)\n\n4. **Jo flips d:** \n on \u2192 **off**\n\n5. **Hal flips d:** \n off \u2192 **on**\n\n6. **Gus flips a** (no effect on d)\n\n7. **Eve flips a** (no effect on d)\n\n8. **Fay flips d:** \n on \u2192 **off**\n\n9. **Jo flips b** (no effect on d)\n\n10. **Eve flips d:** \n off \u2192 **on**\n\n11. **Ann flips b** (no effect on d)\n\n12. **Jo flips b** (no effect on d)\n\n13. **Jo flips d:** \n on \u2192 **off**\n\n14. **Ann flips a** (no effect on d)\n\n15. **Ida flips c** (no effect on d)\n\n16. **Ben flips a** (no effect on d)\n\n17. **Fay flips b** (no effect on d)\n\n18. **Jo flips d:** \n off \u2192 **on**\n\n19. **Jo flips a** (no effect on d)\n\n20. **Fay flips a** (no effect on d)\n\n21. **Dee flips d:** \n on \u2192 **off**\n\n22. **Ann flips a** (no effect on d)\n\n23. **Hal flips c** (no effect on d)\n\n24. **Hal flips d:** \n off \u2192 **on**\n\n25. **Jo flips a** (no effect on d)\n\n26. **Eve flips a** (no effect on d)\n\n27. **Hal flips c** (no effect on d)\n\n28. **Ann flips b** (no effect on d)\n\n29. **Ida flips b** (no effect on d)\n\n30. **Jo flips d:** \n on \u2192 **off**\n\n31. **Hal flips a** (no effect on d)\n\n32. **Eve flips a** (no effect on d)\n\n33. **Hal flips c** (no effect on d)\n\n34. **Ann flips b** (no effect on d)\n\n35. **Ida flips b** (no effect on d)\n\n36. **Jo flips d:** \n off \u2192 **on**\n\n37. **Hal flips a** (no effect on d)\n\n38. **Eve flips a** (no effect on d)\n\n39. **Hal flips c** (no effect on d)\n\n40. **Ann flips b** (no effect on d)\n\n41. **Ida flips b** (no effect on d)\n\n42. **Jo flips d:** \n on \u2192 **off**\n\n43. **Hal flips a** (no effect on d)\n\n44. **Eve flips a** (no effect on d)\n\n45. **Hal flips c** (no effect on d)\n\n46. **Ann flips b** (no effect on d)\n\n47. **Ida flips b** (no effect on d)\n\n48. **Jo flips d:** \n off \u2192 **on**\n\n---\n\n**Final state after all flips:** \n**d = on**\n\n---\n\n**Answer: on**", "pred": "on", "correct": false, "leaked": false, "n_gen": 740, "n_prompt": 301, "truncated": false}
diff --git a/research/hidden-reasoning/results/ft/seeds_table.md b/research/hidden-reasoning/results/ft/seeds_table.md
index 848945a..5a06001 100644
--- a/research/hidden-reasoning/results/ft/seeds_table.md
+++ b/research/hidden-reasoning/results/ft/seeds_table.md
@@ -1,7 +1,11 @@
+Answer-only accuracy after fine-tuning (n = 100 per cell, symbolic format), mean (range) over seeds. Generated by `python -m hcot.seeds results/ft t5`. Olmo-Hybrid T2 arms have 6 seeds each since follow-up 3 (2026-10-22); T5 = multi-switch tracking (follow-up 3).
+
+## T2 parity
+
| run | seeds | 16 | 64 | 96 | 128 | 144 | 192 | 256 | 512 |
|---|---|---|---|---|---|---|---|---|---|
-| Olmo-Hybrid β≤2 (stock) | 3 | 1.00 (1.00–1.00) | 0.92 (0.75–1.00) | 0.85 (0.56–1.00) | 0.80 (0.53–0.97) | 0.74 (0.43–0.90) | 0.60 (0.50–0.68) | 0.51 (0.40–0.57) | 0.48 (0.46–0.49) |
-| Olmo-Hybrid β≤1 (cap) | 3 | 0.99 (0.99–0.99) | 0.79 (0.57–0.92) | 0.56 (0.44–0.69) | 0.52 (0.50–0.54) | 0.48 (0.44–0.56) | 0.49 (0.47–0.50) | 0.52 (0.46–0.57) | 0.50 (0.49–0.51) |
+| Olmo-Hybrid β≤2 (stock) | 6 | 1.00 (1.00–1.00) | 0.96 (0.75–1.00) | 0.92 (0.56–1.00) | 0.89 (0.53–1.00) | 0.86 (0.43–1.00) | 0.71 (0.50–0.88) | 0.54 (0.40–0.67) | 0.49 (0.44–0.57) |
+| Olmo-Hybrid β≤1 (cap) | 6 | 0.91 (0.51–1.00) | 0.73 (0.55–0.92) | 0.55 (0.44–0.69) | 0.52 (0.49–0.56) | 0.47 (0.43–0.56) | 0.50 (0.47–0.55) | 0.55 (0.46–0.59) | 0.49 (0.46–0.51) |
| Qwen3.5 β≤1 (stock) | 3 | 0.99 (0.97–1.00) | 0.80 (0.46–1.00) | 0.64 (0.53–0.70) | 0.55 (0.53–0.57) | 0.43 (0.43–0.44) | 0.48 (0.47–0.49) | 0.58 (0.57–0.58) | 0.49 (0.48–0.49) |
| Olmo-3 dense | 3 | 0.96 (0.89–1.00) | 0.60 (0.47–0.67) | 0.56 (0.50–0.62) | 0.54 (0.49–0.57) | 0.48 (0.46–0.51) | 0.52 | 0.57 | 0.48 |
@@ -12,12 +16,48 @@ Per seed (checkpoint picked on the selection set; selection accuracy best / fina
| Olmo-Hybrid β≤2 (stock) | olmoh_T2 | best | 1.00 / 1.00 | 1.00 | 1.00 | 0.98 | 0.97 | 0.90 | 0.68 | 0.55 | 0.48 |
| Olmo-Hybrid β≤2 (stock) | olmoh_T2_stock_s1 | final | 0.49 / 0.68 | 1.00 | 0.75 | 0.56 | 0.53 | 0.43 | 0.50 | 0.57 | 0.49 |
| Olmo-Hybrid β≤2 (stock) | olmoh_T2_stock_s2 | best | 1.00 / 1.00 | 1.00 | 1.00 | 1.00 | 0.89 | 0.90 | 0.63 | 0.40 | 0.46 |
+| Olmo-Hybrid β≤2 (stock) | olmoh_T2_stock_s3 | best | 1.00 / 1.00 | 1.00 | 1.00 | 1.00 | 0.97 | 0.99 | 0.81 | 0.59 | 0.52 |
+| Olmo-Hybrid β≤2 (stock) | olmoh_T2_stock_s4 | best | 1.00 / 1.00 | 1.00 | 1.00 | 1.00 | 0.99 | 0.97 | 0.73 | 0.46 | 0.44 |
+| Olmo-Hybrid β≤2 (stock) | olmoh_T2_stock_s5 | best | 1.00 / 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.88 | 0.67 | 0.57 |
| Olmo-Hybrid β≤1 (cap) | olmoh_T2_cap_min_s0 | final | 0.50 / 0.86 | 0.99 | 0.87 | 0.44 | 0.53 | 0.56 | 0.47 | 0.46 | 0.51 |
| Olmo-Hybrid β≤1 (cap) | olmoh_T2_cap_min_s1 | final | 0.44 / 0.68 | 0.99 | 0.57 | 0.55 | 0.54 | 0.44 | 0.50 | 0.57 | 0.49 |
| Olmo-Hybrid β≤1 (cap) | olmoh_T2_cap_min_s2 | final | 0.52 / 0.95 | 0.99 | 0.92 | 0.69 | 0.50 | 0.45 | 0.49 | — | — |
+| Olmo-Hybrid β≤1 (cap) | olmoh_T2_cap_min_s3 | final | 0.59 / 0.82 | 1.00 | 0.79 | 0.60 | 0.56 | 0.43 | 0.51 | 0.57 | 0.49 |
+| Olmo-Hybrid β≤1 (cap) | olmoh_T2_cap_min_s4 | final | 0.50 / 0.73 | 0.97 | 0.69 | 0.50 | 0.50 | 0.47 | 0.48 | 0.59 | 0.48 |
+| Olmo-Hybrid β≤1 (cap) | olmoh_T2_cap_min_s5 | best | 0.54 / 0.52 | 0.51 | 0.55 | 0.54 | 0.49 | 0.50 | 0.55 | 0.54 | 0.46 |
| Qwen3.5 β≤1 (stock) | q35_T2 | final | 0.94 / 0.97 | 1.00 | 1.00 | 0.70 | 0.57 | 0.44 | 0.49 | 0.57 | 0.49 |
| Qwen3.5 β≤1 (stock) | q35_T2_stock_s1 | final | 0.53 / 0.58 | 0.97 | 0.46 | 0.53 | 0.53 | 0.43 | 0.47 | 0.58 | 0.48 |
| Qwen3.5 β≤1 (stock) | q35_T2_stock_s2 | best | 0.97 / 0.97 | 1.00 | 0.95 | 0.70 | 0.56 | 0.43 | 0.48 | 0.58 | 0.49 |
| Olmo-3 dense | olmo3_T2 | final | 0.51 / 0.54 | 0.89 | 0.47 | 0.50 | 0.57 | 0.46 | 0.52 | 0.57 | 0.48 |
| Olmo-3 dense | olmo3_T2_stock_s1 | final | 0.55 / 0.70 | 1.00 | 0.66 | 0.57 | 0.55 | 0.46 | — | — | — |
| Olmo-3 dense | olmo3_T2_stock_s2 | final | 0.54 / 0.79 | 0.99 | 0.67 | 0.62 | 0.49 | 0.51 | — | — | — |
+
+Counts (fit = >= 0.85 at 64; generalise = fit and >= 0.80 at 128):
+
+- Olmo-Hybrid β≤2 (stock): 5/6 fit 64; of those, 5/5 generalise to 128
+- Olmo-Hybrid β≤1 (cap): 2/6 fit 64; of those, 0/2 generalise to 128
+- Qwen3.5 β≤1 (stock): 2/3 fit 64; of those, 0/2 generalise to 128
+- Olmo-3 dense: 0/3 fit 64; of those, 0/0 generalise to 128
+
+## T5 multi-switch
+
+| run | seeds | 16 | 64 | 96 | 128 | 144 | 192 | 256 | 512 |
+|---|---|---|---|---|---|---|---|---|---|
+| T5 Olmo-Hybrid β≤2 (stock) | 3 | 0.76 (0.37–0.96) | 0.46 (0.45–0.47) | 0.51 (0.48–0.52) | 0.50 (0.49–0.51) | 0.52 (0.46–0.55) | 0.50 (0.50–0.50) | 0.51 (0.47–0.53) | 0.49 (0.48–0.52) |
+| T5 Olmo-Hybrid β≤1 (cap) | 3 | 0.83 (0.50–1.00) | 0.44 (0.37–0.49) | 0.51 (0.49–0.52) | 0.50 (0.46–0.52) | 0.51 (0.49–0.54) | 0.48 (0.44–0.50) | 0.51 (0.47–0.53) | 0.51 (0.48–0.52) |
+
+Per seed (checkpoint picked on the selection set; selection accuracy best / final):
+
+| run | seed run | checkpoint | selection acc (best / final) | 16 | 64 | 96 | 128 | 144 | 192 | 256 | 512 |
+|---|---|---|---|---|---|---|---|---|---|---|---|
+| T5 Olmo-Hybrid β≤2 (stock) | olmoh_T5_stock_s0 | final | 0.47 / 0.51 | 0.95 | 0.45 | 0.52 | 0.49 | 0.46 | 0.50 | 0.47 | 0.52 |
+| T5 Olmo-Hybrid β≤2 (stock) | olmoh_T5_stock_s1 | best | 0.53 / 0.45 | 0.37 | 0.46 | 0.48 | 0.51 | 0.55 | 0.50 | 0.53 | 0.48 |
+| T5 Olmo-Hybrid β≤2 (stock) | olmoh_T5_stock_s2 | final | 0.40 / 0.61 | 0.96 | 0.47 | 0.52 | 0.51 | 0.54 | 0.50 | 0.53 | 0.48 |
+| T5 Olmo-Hybrid β≤1 (cap) | olmoh_T5_cap_min_s0 | final | 0.38 / 0.54 | 1.00 | 0.37 | 0.49 | 0.46 | 0.49 | 0.50 | 0.47 | 0.52 |
+| T5 Olmo-Hybrid β≤1 (cap) | olmoh_T5_cap_min_s1 | best | 0.48 / 0.39 | 0.50 | 0.46 | 0.51 | 0.52 | 0.51 | 0.44 | 0.52 | 0.52 |
+| T5 Olmo-Hybrid β≤1 (cap) | olmoh_T5_cap_min_s2 | final | 0.43 / 0.61 | 1.00 | 0.49 | 0.52 | 0.51 | 0.54 | 0.50 | 0.53 | 0.48 |
+
+Counts (fit = >= 0.85 at 64; generalise = fit and >= 0.80 at 128):
+
+- T5 Olmo-Hybrid β≤2 (stock): 0/3 fit 64; of those, 0/0 generalise to 128
+- T5 Olmo-Hybrid β≤1 (cap): 0/3 fit 64; of those, 0/0 generalise to 128
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T2_cap_min_s3.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_cap_min_s3.json
new file mode 100644
index 0000000..8363ee1
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_cap_min_s3.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T2",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T2_cap_min_s3",
+ "seed": 3,
+ "beta_mode": "cap_min",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.8,
+ "max_len": 4,
+ "loss": 1.7116,
+ "train_acc": 0.315,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 1.7,
+ "max_len": 4,
+ "loss": 0.1321,
+ "train_acc": 0.86,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 2.6,
+ "max_len": 4,
+ "loss": 0.0091,
+ "train_acc": 0.998,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 3.4,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 4.3,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 5.2,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 6.1,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 7.0,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 7.9,
+ "max_len": 8,
+ "loss": 0.558,
+ "train_acc": 0.63,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 8.8,
+ "max_len": 8,
+ "loss": 0.2266,
+ "train_acc": 0.743,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 9.7,
+ "max_len": 8,
+ "loss": 0.147,
+ "train_acc": 0.815,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 10.6,
+ "max_len": 8,
+ "loss": 0.1043,
+ "train_acc": 0.873,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 11.5,
+ "max_len": 8,
+ "loss": 0.1348,
+ "train_acc": 0.885,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 12.4,
+ "max_len": 8,
+ "loss": 0.1069,
+ "train_acc": 0.877,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 13.3,
+ "max_len": 8,
+ "loss": 0.1274,
+ "train_acc": 0.912,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 14.2,
+ "max_len": 8,
+ "loss": 0.0641,
+ "train_acc": 0.955,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 15.2,
+ "max_len": 16,
+ "loss": 0.2799,
+ "train_acc": 0.72,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 16.1,
+ "max_len": 16,
+ "loss": 0.2151,
+ "train_acc": 0.713,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 17.1,
+ "max_len": 16,
+ "loss": 0.1829,
+ "train_acc": 0.777,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 18.1,
+ "max_len": 16,
+ "loss": 0.2241,
+ "train_acc": 0.775,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 19.0,
+ "max_len": 16,
+ "loss": 0.1903,
+ "train_acc": 0.765,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 20.0,
+ "max_len": 16,
+ "loss": 0.2036,
+ "train_acc": 0.762,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 21.0,
+ "max_len": 16,
+ "loss": 0.1729,
+ "train_acc": 0.805,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 21.9,
+ "max_len": 16,
+ "loss": 0.1689,
+ "train_acc": 0.787,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 22.9,
+ "max_len": 16,
+ "loss": 0.1209,
+ "train_acc": 0.855,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 23.9,
+ "max_len": 16,
+ "loss": 0.1493,
+ "train_acc": 0.9,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 24.8,
+ "max_len": 16,
+ "loss": 0.1179,
+ "train_acc": 0.892,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 25.8,
+ "max_len": 16,
+ "loss": 0.0832,
+ "train_acc": 0.925,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 26.9,
+ "max_len": 32,
+ "loss": 0.2586,
+ "train_acc": 0.635,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 28.0,
+ "max_len": 32,
+ "loss": 0.2584,
+ "train_acc": 0.69,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 29.1,
+ "max_len": 32,
+ "loss": 0.2524,
+ "train_acc": 0.7,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 30.2,
+ "max_len": 32,
+ "loss": 0.2368,
+ "train_acc": 0.715,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 31.3,
+ "max_len": 32,
+ "loss": 0.2286,
+ "train_acc": 0.723,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 32.4,
+ "max_len": 32,
+ "loss": 0.2337,
+ "train_acc": 0.725,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 33.5,
+ "max_len": 32,
+ "loss": 0.2519,
+ "train_acc": 0.685,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 34.6,
+ "max_len": 32,
+ "loss": 0.261,
+ "train_acc": 0.677,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 35.7,
+ "max_len": 32,
+ "loss": 0.2227,
+ "train_acc": 0.745,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 36.7,
+ "max_len": 32,
+ "loss": 0.193,
+ "train_acc": 0.807,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 37.8,
+ "max_len": 32,
+ "loss": 0.1753,
+ "train_acc": 0.818,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 38.9,
+ "max_len": 32,
+ "loss": 0.1331,
+ "train_acc": 0.86,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 40.0,
+ "max_len": 32,
+ "loss": 0.2019,
+ "train_acc": 0.82,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 41.1,
+ "max_len": 32,
+ "loss": 0.1381,
+ "train_acc": 0.805,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 42.2,
+ "max_len": 32,
+ "loss": 0.1307,
+ "train_acc": 0.875,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 43.3,
+ "max_len": 32,
+ "loss": 0.1035,
+ "train_acc": 0.9,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 44.8,
+ "max_len": 64,
+ "loss": 0.242,
+ "train_acc": 0.66,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 46.3,
+ "max_len": 64,
+ "loss": 0.2406,
+ "train_acc": 0.73,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 47.9,
+ "max_len": 64,
+ "loss": 0.2622,
+ "train_acc": 0.682,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 49.4,
+ "max_len": 64,
+ "loss": 0.2461,
+ "train_acc": 0.677,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 50.9,
+ "max_len": 64,
+ "loss": 0.2855,
+ "train_acc": 0.645,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 52.5,
+ "max_len": 64,
+ "loss": 0.2442,
+ "train_acc": 0.662,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 54.0,
+ "max_len": 64,
+ "loss": 0.2473,
+ "train_acc": 0.672,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 55.5,
+ "max_len": 64,
+ "loss": 0.2129,
+ "train_acc": 0.74,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 57.1,
+ "max_len": 64,
+ "loss": 0.2526,
+ "train_acc": 0.682,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 58.6,
+ "max_len": 64,
+ "loss": 0.2073,
+ "train_acc": 0.755,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 60.1,
+ "max_len": 64,
+ "loss": 0.2208,
+ "train_acc": 0.762,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 61.6,
+ "max_len": 64,
+ "loss": 0.2017,
+ "train_acc": 0.743,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 63.2,
+ "max_len": 64,
+ "loss": 0.2144,
+ "train_acc": 0.745,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 64.7,
+ "max_len": 64,
+ "loss": 0.2385,
+ "train_acc": 0.73,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 66.2,
+ "max_len": 64,
+ "loss": 0.1814,
+ "train_acc": 0.785,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 67.7,
+ "max_len": 64,
+ "loss": 0.2803,
+ "train_acc": 0.718,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 69.2,
+ "max_len": 64,
+ "loss": 0.1899,
+ "train_acc": 0.752,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 70.8,
+ "max_len": 64,
+ "loss": 0.1958,
+ "train_acc": 0.787,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 72.3,
+ "max_len": 64,
+ "loss": 0.1913,
+ "train_acc": 0.775,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 73.8,
+ "max_len": 64,
+ "loss": 0.1558,
+ "train_acc": 0.795,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 75.3,
+ "max_len": 64,
+ "loss": 0.1454,
+ "train_acc": 0.83,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 76.8,
+ "max_len": 64,
+ "loss": 0.1462,
+ "train_acc": 0.828,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 78.4,
+ "max_len": 64,
+ "loss": 0.1558,
+ "train_acc": 0.865,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 79.9,
+ "max_len": 64,
+ "loss": 0.1154,
+ "train_acc": 0.885,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 81.4,
+ "max_len": 64,
+ "loss": 0.1155,
+ "train_acc": 0.88,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 82.9,
+ "max_len": 64,
+ "loss": 0.106,
+ "train_acc": 0.88,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 84.5,
+ "max_len": 64,
+ "loss": 0.1249,
+ "train_acc": 0.87,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 86.0,
+ "max_len": 64,
+ "loss": 0.1225,
+ "train_acc": 0.88,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 87.5,
+ "max_len": 64,
+ "loss": 0.0943,
+ "train_acc": 0.88,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 89.1,
+ "max_len": 64,
+ "loss": 0.137,
+ "train_acc": 0.853,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 90.6,
+ "max_len": 64,
+ "loss": 0.1055,
+ "train_acc": 0.877,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 92.1,
+ "max_len": 64,
+ "loss": 0.1297,
+ "train_acc": 0.865,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 93.6,
+ "max_len": 64,
+ "loss": 0.1091,
+ "train_acc": 0.897,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 95.2,
+ "max_len": 64,
+ "loss": 0.1403,
+ "train_acc": 0.89,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 96.7,
+ "max_len": 64,
+ "loss": 0.0954,
+ "train_acc": 0.887,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 98.2,
+ "max_len": 64,
+ "loss": 0.0802,
+ "train_acc": 0.895,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T2_cap_min_s4.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_cap_min_s4.json
new file mode 100644
index 0000000..61445ec
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_cap_min_s4.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T2",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T2_cap_min_s4",
+ "seed": 4,
+ "beta_mode": "cap_min",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.6,
+ "max_len": 4,
+ "loss": 1.6797,
+ "train_acc": 0.3,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 1.3,
+ "max_len": 4,
+ "loss": 0.1958,
+ "train_acc": 0.795,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 1.9,
+ "max_len": 4,
+ "loss": 0.045,
+ "train_acc": 0.98,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 2.6,
+ "max_len": 4,
+ "loss": 0.0002,
+ "train_acc": 1.0,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 3.2,
+ "max_len": 4,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 3.9,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 4.6,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 5.2,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 5.9,
+ "max_len": 8,
+ "loss": 0.2683,
+ "train_acc": 0.705,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 6.6,
+ "max_len": 8,
+ "loss": 0.1743,
+ "train_acc": 0.807,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 7.2,
+ "max_len": 8,
+ "loss": 0.1146,
+ "train_acc": 0.858,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 7.9,
+ "max_len": 8,
+ "loss": 0.1004,
+ "train_acc": 0.875,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 8.6,
+ "max_len": 8,
+ "loss": 0.0897,
+ "train_acc": 0.902,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 9.3,
+ "max_len": 8,
+ "loss": 0.076,
+ "train_acc": 0.92,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 9.9,
+ "max_len": 8,
+ "loss": 0.0503,
+ "train_acc": 0.938,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 10.6,
+ "max_len": 8,
+ "loss": 0.0543,
+ "train_acc": 0.943,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 11.3,
+ "max_len": 16,
+ "loss": 0.2724,
+ "train_acc": 0.645,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 12.0,
+ "max_len": 16,
+ "loss": 0.239,
+ "train_acc": 0.667,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 12.8,
+ "max_len": 16,
+ "loss": 0.2477,
+ "train_acc": 0.708,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 13.5,
+ "max_len": 16,
+ "loss": 0.2424,
+ "train_acc": 0.708,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 14.2,
+ "max_len": 16,
+ "loss": 0.2429,
+ "train_acc": 0.725,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 14.9,
+ "max_len": 16,
+ "loss": 0.2071,
+ "train_acc": 0.792,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 15.6,
+ "max_len": 16,
+ "loss": 0.1644,
+ "train_acc": 0.81,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 16.3,
+ "max_len": 16,
+ "loss": 0.1422,
+ "train_acc": 0.802,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 17.1,
+ "max_len": 16,
+ "loss": 0.1556,
+ "train_acc": 0.845,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 17.8,
+ "max_len": 16,
+ "loss": 0.2428,
+ "train_acc": 0.79,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 18.5,
+ "max_len": 16,
+ "loss": 0.1097,
+ "train_acc": 0.895,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 19.2,
+ "max_len": 16,
+ "loss": 0.1002,
+ "train_acc": 0.922,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 20.0,
+ "max_len": 32,
+ "loss": 0.2709,
+ "train_acc": 0.7,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 20.8,
+ "max_len": 32,
+ "loss": 0.2907,
+ "train_acc": 0.632,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 21.6,
+ "max_len": 32,
+ "loss": 0.2868,
+ "train_acc": 0.632,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 22.4,
+ "max_len": 32,
+ "loss": 0.278,
+ "train_acc": 0.665,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 23.4,
+ "max_len": 32,
+ "loss": 0.2762,
+ "train_acc": 0.67,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 24.4,
+ "max_len": 32,
+ "loss": 0.2691,
+ "train_acc": 0.65,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 25.5,
+ "max_len": 32,
+ "loss": 0.2399,
+ "train_acc": 0.688,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 26.6,
+ "max_len": 32,
+ "loss": 0.2028,
+ "train_acc": 0.728,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 27.7,
+ "max_len": 32,
+ "loss": 0.2907,
+ "train_acc": 0.698,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 28.8,
+ "max_len": 32,
+ "loss": 0.2381,
+ "train_acc": 0.7,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 29.9,
+ "max_len": 32,
+ "loss": 0.211,
+ "train_acc": 0.77,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 30.9,
+ "max_len": 32,
+ "loss": 0.2134,
+ "train_acc": 0.755,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 32.0,
+ "max_len": 32,
+ "loss": 0.2132,
+ "train_acc": 0.755,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 33.1,
+ "max_len": 32,
+ "loss": 0.2162,
+ "train_acc": 0.77,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 34.2,
+ "max_len": 32,
+ "loss": 0.2329,
+ "train_acc": 0.772,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 35.3,
+ "max_len": 32,
+ "loss": 0.2196,
+ "train_acc": 0.72,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 36.8,
+ "max_len": 64,
+ "loss": 0.277,
+ "train_acc": 0.64,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 38.3,
+ "max_len": 64,
+ "loss": 0.2701,
+ "train_acc": 0.662,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 39.9,
+ "max_len": 64,
+ "loss": 0.3053,
+ "train_acc": 0.58,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 41.4,
+ "max_len": 64,
+ "loss": 0.2924,
+ "train_acc": 0.61,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 42.9,
+ "max_len": 64,
+ "loss": 0.2964,
+ "train_acc": 0.58,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 44.5,
+ "max_len": 64,
+ "loss": 0.2901,
+ "train_acc": 0.6,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 46.0,
+ "max_len": 64,
+ "loss": 0.2851,
+ "train_acc": 0.618,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 47.6,
+ "max_len": 64,
+ "loss": 0.2877,
+ "train_acc": 0.623,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 49.1,
+ "max_len": 64,
+ "loss": 0.2763,
+ "train_acc": 0.615,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 50.6,
+ "max_len": 64,
+ "loss": 0.2701,
+ "train_acc": 0.635,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 52.2,
+ "max_len": 64,
+ "loss": 0.2567,
+ "train_acc": 0.69,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 53.7,
+ "max_len": 64,
+ "loss": 0.2647,
+ "train_acc": 0.64,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 55.3,
+ "max_len": 64,
+ "loss": 0.2695,
+ "train_acc": 0.662,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 56.8,
+ "max_len": 64,
+ "loss": 0.3116,
+ "train_acc": 0.67,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 58.3,
+ "max_len": 64,
+ "loss": 0.2669,
+ "train_acc": 0.627,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 59.9,
+ "max_len": 64,
+ "loss": 0.2499,
+ "train_acc": 0.64,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 61.4,
+ "max_len": 64,
+ "loss": 0.2396,
+ "train_acc": 0.698,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 63.0,
+ "max_len": 64,
+ "loss": 0.2601,
+ "train_acc": 0.708,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 64.5,
+ "max_len": 64,
+ "loss": 0.2426,
+ "train_acc": 0.67,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 66.0,
+ "max_len": 64,
+ "loss": 0.2355,
+ "train_acc": 0.723,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 67.6,
+ "max_len": 64,
+ "loss": 0.235,
+ "train_acc": 0.677,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 69.1,
+ "max_len": 64,
+ "loss": 0.2475,
+ "train_acc": 0.698,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 70.7,
+ "max_len": 64,
+ "loss": 0.214,
+ "train_acc": 0.745,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 72.2,
+ "max_len": 64,
+ "loss": 0.2071,
+ "train_acc": 0.777,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 73.7,
+ "max_len": 64,
+ "loss": 0.203,
+ "train_acc": 0.797,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 75.3,
+ "max_len": 64,
+ "loss": 0.2463,
+ "train_acc": 0.718,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 76.8,
+ "max_len": 64,
+ "loss": 0.2039,
+ "train_acc": 0.735,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 78.3,
+ "max_len": 64,
+ "loss": 0.2175,
+ "train_acc": 0.728,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 79.9,
+ "max_len": 64,
+ "loss": 0.2019,
+ "train_acc": 0.757,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 81.4,
+ "max_len": 64,
+ "loss": 0.1918,
+ "train_acc": 0.772,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 82.9,
+ "max_len": 64,
+ "loss": 0.189,
+ "train_acc": 0.79,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 84.4,
+ "max_len": 64,
+ "loss": 0.1626,
+ "train_acc": 0.81,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 86.0,
+ "max_len": 64,
+ "loss": 0.2018,
+ "train_acc": 0.757,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 87.5,
+ "max_len": 64,
+ "loss": 0.1823,
+ "train_acc": 0.812,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 89.0,
+ "max_len": 64,
+ "loss": 0.1932,
+ "train_acc": 0.785,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 90.5,
+ "max_len": 64,
+ "loss": 0.161,
+ "train_acc": 0.828,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T2_cap_min_s5.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_cap_min_s5.json
new file mode 100644
index 0000000..21c1643
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_cap_min_s5.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T2",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T2_cap_min_s5",
+ "seed": 5,
+ "beta_mode": "cap_min",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.8,
+ "max_len": 4,
+ "loss": 1.7057,
+ "train_acc": 0.318,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 1.7,
+ "max_len": 4,
+ "loss": 0.1458,
+ "train_acc": 0.85,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 2.6,
+ "max_len": 4,
+ "loss": 0.0104,
+ "train_acc": 0.988,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 3.5,
+ "max_len": 4,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 4.3,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 5.2,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 6.1,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 7.0,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 7.9,
+ "max_len": 8,
+ "loss": 0.3911,
+ "train_acc": 0.67,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 8.8,
+ "max_len": 8,
+ "loss": 0.2647,
+ "train_acc": 0.777,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 9.7,
+ "max_len": 8,
+ "loss": 0.1391,
+ "train_acc": 0.877,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 10.6,
+ "max_len": 8,
+ "loss": 0.0991,
+ "train_acc": 0.92,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 11.5,
+ "max_len": 8,
+ "loss": 0.0568,
+ "train_acc": 0.953,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 12.4,
+ "max_len": 8,
+ "loss": 0.0823,
+ "train_acc": 0.897,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 13.3,
+ "max_len": 8,
+ "loss": 0.0737,
+ "train_acc": 0.95,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 14.2,
+ "max_len": 8,
+ "loss": 0.0702,
+ "train_acc": 0.953,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 15.1,
+ "max_len": 16,
+ "loss": 0.2526,
+ "train_acc": 0.627,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 16.1,
+ "max_len": 16,
+ "loss": 0.2445,
+ "train_acc": 0.65,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 17.1,
+ "max_len": 16,
+ "loss": 0.241,
+ "train_acc": 0.642,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 18.0,
+ "max_len": 16,
+ "loss": 0.2838,
+ "train_acc": 0.645,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 19.0,
+ "max_len": 16,
+ "loss": 0.2283,
+ "train_acc": 0.647,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 19.9,
+ "max_len": 16,
+ "loss": 0.2289,
+ "train_acc": 0.688,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 20.9,
+ "max_len": 16,
+ "loss": 0.2218,
+ "train_acc": 0.698,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 21.9,
+ "max_len": 16,
+ "loss": 0.2443,
+ "train_acc": 0.637,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 22.8,
+ "max_len": 16,
+ "loss": 0.2529,
+ "train_acc": 0.672,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 23.8,
+ "max_len": 16,
+ "loss": 0.2199,
+ "train_acc": 0.7,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 24.8,
+ "max_len": 16,
+ "loss": 0.2042,
+ "train_acc": 0.77,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 25.7,
+ "max_len": 16,
+ "loss": 0.2207,
+ "train_acc": 0.7,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 26.8,
+ "max_len": 32,
+ "loss": 0.3091,
+ "train_acc": 0.522,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 27.9,
+ "max_len": 32,
+ "loss": 0.3136,
+ "train_acc": 0.565,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 29.0,
+ "max_len": 32,
+ "loss": 0.3145,
+ "train_acc": 0.555,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 30.1,
+ "max_len": 32,
+ "loss": 0.2975,
+ "train_acc": 0.55,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 31.0,
+ "max_len": 32,
+ "loss": 0.3087,
+ "train_acc": 0.588,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 32.1,
+ "max_len": 32,
+ "loss": 0.3074,
+ "train_acc": 0.585,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 33.0,
+ "max_len": 32,
+ "loss": 0.2983,
+ "train_acc": 0.598,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 34.0,
+ "max_len": 32,
+ "loss": 0.2909,
+ "train_acc": 0.59,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 35.0,
+ "max_len": 32,
+ "loss": 0.297,
+ "train_acc": 0.532,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 35.8,
+ "max_len": 32,
+ "loss": 0.2921,
+ "train_acc": 0.58,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 36.6,
+ "max_len": 32,
+ "loss": 0.288,
+ "train_acc": 0.578,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 37.5,
+ "max_len": 32,
+ "loss": 0.2902,
+ "train_acc": 0.605,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 38.3,
+ "max_len": 32,
+ "loss": 0.2722,
+ "train_acc": 0.63,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 39.1,
+ "max_len": 32,
+ "loss": 0.2947,
+ "train_acc": 0.613,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 39.9,
+ "max_len": 32,
+ "loss": 0.2967,
+ "train_acc": 0.59,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 40.7,
+ "max_len": 32,
+ "loss": 0.2863,
+ "train_acc": 0.623,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 41.8,
+ "max_len": 64,
+ "loss": 0.3224,
+ "train_acc": 0.535,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 43.0,
+ "max_len": 64,
+ "loss": 0.3168,
+ "train_acc": 0.547,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 44.1,
+ "max_len": 64,
+ "loss": 0.3205,
+ "train_acc": 0.562,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 45.3,
+ "max_len": 64,
+ "loss": 0.3082,
+ "train_acc": 0.56,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 46.4,
+ "max_len": 64,
+ "loss": 0.3153,
+ "train_acc": 0.532,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 47.6,
+ "max_len": 64,
+ "loss": 0.3149,
+ "train_acc": 0.532,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 48.8,
+ "max_len": 64,
+ "loss": 0.3188,
+ "train_acc": 0.578,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 49.9,
+ "max_len": 64,
+ "loss": 0.3131,
+ "train_acc": 0.522,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 51.1,
+ "max_len": 64,
+ "loss": 0.3129,
+ "train_acc": 0.57,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 52.2,
+ "max_len": 64,
+ "loss": 0.3089,
+ "train_acc": 0.578,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 53.4,
+ "max_len": 64,
+ "loss": 0.3079,
+ "train_acc": 0.565,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 54.5,
+ "max_len": 64,
+ "loss": 0.3139,
+ "train_acc": 0.555,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 55.7,
+ "max_len": 64,
+ "loss": 0.3139,
+ "train_acc": 0.55,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 56.8,
+ "max_len": 64,
+ "loss": 0.3141,
+ "train_acc": 0.542,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 58.0,
+ "max_len": 64,
+ "loss": 0.3209,
+ "train_acc": 0.54,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 59.1,
+ "max_len": 64,
+ "loss": 0.3056,
+ "train_acc": 0.59,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 60.3,
+ "max_len": 64,
+ "loss": 0.3171,
+ "train_acc": 0.482,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 61.5,
+ "max_len": 64,
+ "loss": 0.3083,
+ "train_acc": 0.573,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 62.6,
+ "max_len": 64,
+ "loss": 0.3019,
+ "train_acc": 0.595,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 63.8,
+ "max_len": 64,
+ "loss": 0.3076,
+ "train_acc": 0.555,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 64.9,
+ "max_len": 64,
+ "loss": 0.3099,
+ "train_acc": 0.562,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 66.1,
+ "max_len": 64,
+ "loss": 0.3208,
+ "train_acc": 0.52,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 67.2,
+ "max_len": 64,
+ "loss": 0.317,
+ "train_acc": 0.522,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 68.4,
+ "max_len": 64,
+ "loss": 0.3066,
+ "train_acc": 0.575,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 69.5,
+ "max_len": 64,
+ "loss": 0.297,
+ "train_acc": 0.595,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 70.7,
+ "max_len": 64,
+ "loss": 0.3087,
+ "train_acc": 0.565,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 71.8,
+ "max_len": 64,
+ "loss": 0.3045,
+ "train_acc": 0.605,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 72.9,
+ "max_len": 64,
+ "loss": 0.311,
+ "train_acc": 0.512,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 73.9,
+ "max_len": 64,
+ "loss": 0.3066,
+ "train_acc": 0.58,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 75.1,
+ "max_len": 64,
+ "loss": 0.2999,
+ "train_acc": 0.545,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 76.3,
+ "max_len": 64,
+ "loss": 0.3045,
+ "train_acc": 0.588,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 77.4,
+ "max_len": 64,
+ "loss": 0.3056,
+ "train_acc": 0.54,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 78.2,
+ "max_len": 64,
+ "loss": 0.3102,
+ "train_acc": 0.547,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 79.1,
+ "max_len": 64,
+ "loss": 0.3104,
+ "train_acc": 0.57,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 80.2,
+ "max_len": 64,
+ "loss": 0.3127,
+ "train_acc": 0.542,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 81.1,
+ "max_len": 64,
+ "loss": 0.3089,
+ "train_acc": 0.535,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T2_stock_s3.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_stock_s3.json
new file mode 100644
index 0000000..044edd0
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_stock_s3.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T2",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T2_stock_s3",
+ "seed": 3,
+ "beta_mode": "stock",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.4,
+ "max_len": 4,
+ "loss": 1.2731,
+ "train_acc": 0.335,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 0.9,
+ "max_len": 4,
+ "loss": 0.1515,
+ "train_acc": 0.838,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 1.3,
+ "max_len": 4,
+ "loss": 0.002,
+ "train_acc": 1.0,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 1.7,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 2.2,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 2.6,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 3.1,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 3.5,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 4.0,
+ "max_len": 8,
+ "loss": 0.3584,
+ "train_acc": 0.698,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 4.5,
+ "max_len": 8,
+ "loss": 0.1615,
+ "train_acc": 0.843,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 5.2,
+ "max_len": 8,
+ "loss": 0.128,
+ "train_acc": 0.877,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 5.9,
+ "max_len": 8,
+ "loss": 0.0602,
+ "train_acc": 0.94,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 6.5,
+ "max_len": 8,
+ "loss": 0.0498,
+ "train_acc": 0.978,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 7.2,
+ "max_len": 8,
+ "loss": 0.0035,
+ "train_acc": 0.998,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 7.9,
+ "max_len": 8,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 8.6,
+ "max_len": 8,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 9.3,
+ "max_len": 16,
+ "loss": 0.2092,
+ "train_acc": 0.885,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 10.0,
+ "max_len": 16,
+ "loss": 0.0198,
+ "train_acc": 0.993,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 10.7,
+ "max_len": 16,
+ "loss": 0.0107,
+ "train_acc": 0.998,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 11.5,
+ "max_len": 16,
+ "loss": 0.019,
+ "train_acc": 0.995,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 12.2,
+ "max_len": 16,
+ "loss": 0.0003,
+ "train_acc": 1.0,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 12.9,
+ "max_len": 16,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 13.7,
+ "max_len": 16,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 14.4,
+ "max_len": 16,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 15.1,
+ "max_len": 16,
+ "loss": 0.0027,
+ "train_acc": 0.998,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 15.8,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 16.6,
+ "max_len": 16,
+ "loss": 0.0251,
+ "train_acc": 0.99,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 17.3,
+ "max_len": 16,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 18.2,
+ "max_len": 32,
+ "loss": 0.0108,
+ "train_acc": 0.993,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 19.0,
+ "max_len": 32,
+ "loss": 0.0205,
+ "train_acc": 0.995,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 19.8,
+ "max_len": 32,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 20.6,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 21.5,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 22.3,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 23.2,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 24.0,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 24.8,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 25.6,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 26.5,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 27.4,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 28.5,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 29.6,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 30.7,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 31.8,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 33.3,
+ "max_len": 64,
+ "loss": 0.0312,
+ "train_acc": 0.988,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 34.8,
+ "max_len": 64,
+ "loss": 0.0097,
+ "train_acc": 0.998,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 36.4,
+ "max_len": 64,
+ "loss": 0.0005,
+ "train_acc": 1.0,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 37.9,
+ "max_len": 64,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 39.5,
+ "max_len": 64,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 41.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 42.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 44.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 45.7,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 47.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 48.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 50.3,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 51.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 53.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 55.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 56.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 58.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 59.7,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 61.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 62.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 64.3,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 65.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 67.4,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 69.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 70.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 72.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 73.7,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 75.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 76.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 78.3,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 79.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 81.4,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 82.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 84.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 86.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 87.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T2_stock_s4.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_stock_s4.json
new file mode 100644
index 0000000..520d1cd
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_stock_s4.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T2",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T2_stock_s4",
+ "seed": 4,
+ "beta_mode": "stock",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.8,
+ "max_len": 4,
+ "loss": 1.2731,
+ "train_acc": 0.312,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 1.7,
+ "max_len": 4,
+ "loss": 0.1758,
+ "train_acc": 0.81,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 2.6,
+ "max_len": 4,
+ "loss": 0.0238,
+ "train_acc": 0.99,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 3.5,
+ "max_len": 4,
+ "loss": 0.0022,
+ "train_acc": 0.998,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 4.3,
+ "max_len": 4,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 5.2,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 6.1,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 7.0,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 7.9,
+ "max_len": 8,
+ "loss": 0.3334,
+ "train_acc": 0.66,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 8.8,
+ "max_len": 8,
+ "loss": 0.1858,
+ "train_acc": 0.797,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 9.7,
+ "max_len": 8,
+ "loss": 0.0543,
+ "train_acc": 0.958,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 10.6,
+ "max_len": 8,
+ "loss": 0.0014,
+ "train_acc": 0.998,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 11.5,
+ "max_len": 8,
+ "loss": 0.0158,
+ "train_acc": 0.998,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 12.4,
+ "max_len": 8,
+ "loss": 0.0004,
+ "train_acc": 1.0,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 13.3,
+ "max_len": 8,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 14.2,
+ "max_len": 8,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 15.2,
+ "max_len": 16,
+ "loss": 0.0816,
+ "train_acc": 0.963,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 16.2,
+ "max_len": 16,
+ "loss": 0.0226,
+ "train_acc": 0.993,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 17.1,
+ "max_len": 16,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 18.1,
+ "max_len": 16,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 19.1,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 20.1,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 21.0,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 22.0,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 23.0,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 24.0,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 24.9,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 25.9,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 27.0,
+ "max_len": 32,
+ "loss": 0.075,
+ "train_acc": 0.98,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 28.1,
+ "max_len": 32,
+ "loss": 0.0201,
+ "train_acc": 0.995,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 29.2,
+ "max_len": 32,
+ "loss": 0.0003,
+ "train_acc": 1.0,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 30.3,
+ "max_len": 32,
+ "loss": 0.0027,
+ "train_acc": 0.998,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 31.4,
+ "max_len": 32,
+ "loss": 0.0081,
+ "train_acc": 0.998,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 32.5,
+ "max_len": 32,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 33.7,
+ "max_len": 32,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 34.8,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 35.9,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 37.0,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 38.0,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 39.0,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 40.0,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 41.0,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 42.0,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 42.9,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 44.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 45.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 46.3,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 47.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 48.7,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 49.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 51.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 52.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 53.4,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 54.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 55.7,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 56.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 58.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 59.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 60.4,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 61.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 62.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 63.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 65.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 66.3,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 67.4,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 68.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 69.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 71.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 72.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 73.3,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 74.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 75.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 76.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 78.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 79.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 80.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 81.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 82.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 83.7,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 84.7,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T2_stock_s5.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_stock_s5.json
new file mode 100644
index 0000000..0c4d167
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T2_stock_s5.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T2",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T2_stock_s5",
+ "seed": 5,
+ "beta_mode": "stock",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.4,
+ "max_len": 4,
+ "loss": 1.2834,
+ "train_acc": 0.355,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 0.9,
+ "max_len": 4,
+ "loss": 0.1327,
+ "train_acc": 0.873,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 1.3,
+ "max_len": 4,
+ "loss": 0.0163,
+ "train_acc": 0.99,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 1.7,
+ "max_len": 4,
+ "loss": 0.0099,
+ "train_acc": 0.995,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 2.2,
+ "max_len": 4,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 2.6,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 3.1,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 3.6,
+ "max_len": 4,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 4.0,
+ "max_len": 8,
+ "loss": 0.3397,
+ "train_acc": 0.708,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 4.5,
+ "max_len": 8,
+ "loss": 0.1463,
+ "train_acc": 0.833,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 4.9,
+ "max_len": 8,
+ "loss": 0.1253,
+ "train_acc": 0.855,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 5.4,
+ "max_len": 8,
+ "loss": 0.0844,
+ "train_acc": 0.93,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 5.8,
+ "max_len": 8,
+ "loss": 0.0544,
+ "train_acc": 0.978,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 6.3,
+ "max_len": 8,
+ "loss": 0.0569,
+ "train_acc": 0.953,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 6.7,
+ "max_len": 8,
+ "loss": 0.0273,
+ "train_acc": 0.978,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 7.2,
+ "max_len": 8,
+ "loss": 0.0206,
+ "train_acc": 0.995,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 7.7,
+ "max_len": 16,
+ "loss": 0.1211,
+ "train_acc": 0.943,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 8.2,
+ "max_len": 16,
+ "loss": 0.0005,
+ "train_acc": 1.0,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 8.7,
+ "max_len": 16,
+ "loss": 0.016,
+ "train_acc": 0.995,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 9.2,
+ "max_len": 16,
+ "loss": 0.0048,
+ "train_acc": 0.998,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 9.7,
+ "max_len": 16,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 10.2,
+ "max_len": 16,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 10.7,
+ "max_len": 16,
+ "loss": 0.0017,
+ "train_acc": 0.998,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 11.1,
+ "max_len": 16,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 11.6,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 12.1,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 12.6,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 13.1,
+ "max_len": 16,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 13.7,
+ "max_len": 32,
+ "loss": 0.0161,
+ "train_acc": 0.993,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 14.2,
+ "max_len": 32,
+ "loss": 0.0096,
+ "train_acc": 0.998,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 14.8,
+ "max_len": 32,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 15.4,
+ "max_len": 32,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 15.9,
+ "max_len": 32,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 16.5,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 17.1,
+ "max_len": 32,
+ "loss": 0.0118,
+ "train_acc": 0.998,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 17.6,
+ "max_len": 32,
+ "loss": 0.0003,
+ "train_acc": 1.0,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 18.2,
+ "max_len": 32,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 18.7,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 19.3,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 19.8,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 20.4,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 21.0,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 21.5,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 22.1,
+ "max_len": 32,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 22.8,
+ "max_len": 64,
+ "loss": 0.0196,
+ "train_acc": 0.993,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 23.6,
+ "max_len": 64,
+ "loss": 0.0062,
+ "train_acc": 0.998,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 24.4,
+ "max_len": 64,
+ "loss": 0.0001,
+ "train_acc": 1.0,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 25.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 26.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 26.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 27.4,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 27.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 28.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 28.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 29.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 30.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 30.4,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 30.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 31.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 31.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 31.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 32.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 32.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 33.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 33.3,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 33.7,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 34.1,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 34.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 34.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 35.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 35.6,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 35.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 36.3,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 36.7,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 37.0,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 37.4,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 37.8,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 38.2,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 38.5,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 38.9,
+ "max_len": 64,
+ "loss": 0.0,
+ "train_acc": 1.0,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T5_cap_min_s0.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_cap_min_s0.json
new file mode 100644
index 0000000..df0db20
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_cap_min_s0.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T5",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T5_cap_min_s0",
+ "seed": 0,
+ "beta_mode": "cap_min",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 1.3,
+ "max_len": 4,
+ "loss": 2.0107,
+ "train_acc": 0.32,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 2.6,
+ "max_len": 4,
+ "loss": 0.1665,
+ "train_acc": 0.855,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 4.0,
+ "max_len": 4,
+ "loss": 0.0804,
+ "train_acc": 0.932,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 5.3,
+ "max_len": 4,
+ "loss": 0.0432,
+ "train_acc": 0.98,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 6.7,
+ "max_len": 4,
+ "loss": 0.036,
+ "train_acc": 0.978,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 8.0,
+ "max_len": 4,
+ "loss": 0.0518,
+ "train_acc": 0.978,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 9.4,
+ "max_len": 4,
+ "loss": 0.0294,
+ "train_acc": 0.983,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 10.8,
+ "max_len": 4,
+ "loss": 0.0279,
+ "train_acc": 0.983,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 12.2,
+ "max_len": 8,
+ "loss": 0.1257,
+ "train_acc": 0.86,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 13.6,
+ "max_len": 8,
+ "loss": 0.0808,
+ "train_acc": 0.927,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 15.1,
+ "max_len": 8,
+ "loss": 0.0529,
+ "train_acc": 0.963,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 16.5,
+ "max_len": 8,
+ "loss": 0.0268,
+ "train_acc": 0.975,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 17.9,
+ "max_len": 8,
+ "loss": 0.0332,
+ "train_acc": 0.98,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 19.3,
+ "max_len": 8,
+ "loss": 0.0314,
+ "train_acc": 0.98,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 20.8,
+ "max_len": 8,
+ "loss": 0.0133,
+ "train_acc": 0.983,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 22.2,
+ "max_len": 8,
+ "loss": 0.0189,
+ "train_acc": 0.988,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 23.8,
+ "max_len": 16,
+ "loss": 0.2024,
+ "train_acc": 0.797,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 25.3,
+ "max_len": 16,
+ "loss": 0.2109,
+ "train_acc": 0.805,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 26.8,
+ "max_len": 16,
+ "loss": 0.1514,
+ "train_acc": 0.85,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 28.4,
+ "max_len": 16,
+ "loss": 0.1427,
+ "train_acc": 0.9,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 29.9,
+ "max_len": 16,
+ "loss": 0.2246,
+ "train_acc": 0.757,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 31.5,
+ "max_len": 16,
+ "loss": 0.1537,
+ "train_acc": 0.848,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 33.0,
+ "max_len": 16,
+ "loss": 0.1031,
+ "train_acc": 0.912,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 34.5,
+ "max_len": 16,
+ "loss": 0.1124,
+ "train_acc": 0.902,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 36.1,
+ "max_len": 16,
+ "loss": 0.1303,
+ "train_acc": 0.897,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 37.6,
+ "max_len": 16,
+ "loss": 0.0687,
+ "train_acc": 0.943,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 39.2,
+ "max_len": 16,
+ "loss": 0.0606,
+ "train_acc": 0.953,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 40.7,
+ "max_len": 16,
+ "loss": 0.1335,
+ "train_acc": 0.897,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 42.5,
+ "max_len": 32,
+ "loss": 0.3129,
+ "train_acc": 0.655,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 44.2,
+ "max_len": 32,
+ "loss": 0.2499,
+ "train_acc": 0.667,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 46.0,
+ "max_len": 32,
+ "loss": 0.2621,
+ "train_acc": 0.652,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 47.8,
+ "max_len": 32,
+ "loss": 0.2374,
+ "train_acc": 0.667,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 49.5,
+ "max_len": 32,
+ "loss": 0.2104,
+ "train_acc": 0.718,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 51.3,
+ "max_len": 32,
+ "loss": 0.2228,
+ "train_acc": 0.698,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 53.1,
+ "max_len": 32,
+ "loss": 0.2174,
+ "train_acc": 0.708,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 54.8,
+ "max_len": 32,
+ "loss": 0.1857,
+ "train_acc": 0.765,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 56.6,
+ "max_len": 32,
+ "loss": 0.2022,
+ "train_acc": 0.765,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 58.4,
+ "max_len": 32,
+ "loss": 0.2078,
+ "train_acc": 0.75,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 60.1,
+ "max_len": 32,
+ "loss": 0.1773,
+ "train_acc": 0.82,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 61.9,
+ "max_len": 32,
+ "loss": 0.1325,
+ "train_acc": 0.828,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 63.7,
+ "max_len": 32,
+ "loss": 0.1387,
+ "train_acc": 0.833,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 65.5,
+ "max_len": 32,
+ "loss": 0.176,
+ "train_acc": 0.82,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 67.2,
+ "max_len": 32,
+ "loss": 0.1304,
+ "train_acc": 0.86,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 69.0,
+ "max_len": 32,
+ "loss": 0.1512,
+ "train_acc": 0.838,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 71.4,
+ "max_len": 64,
+ "loss": 0.2895,
+ "train_acc": 0.62,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 73.9,
+ "max_len": 64,
+ "loss": 0.2873,
+ "train_acc": 0.585,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 76.5,
+ "max_len": 64,
+ "loss": 0.3068,
+ "train_acc": 0.583,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 79.0,
+ "max_len": 64,
+ "loss": 0.315,
+ "train_acc": 0.588,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 81.5,
+ "max_len": 64,
+ "loss": 0.2905,
+ "train_acc": 0.57,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 84.0,
+ "max_len": 64,
+ "loss": 0.2811,
+ "train_acc": 0.58,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 86.5,
+ "max_len": 64,
+ "loss": 0.292,
+ "train_acc": 0.595,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 89.0,
+ "max_len": 64,
+ "loss": 0.2783,
+ "train_acc": 0.568,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 91.6,
+ "max_len": 64,
+ "loss": 0.2795,
+ "train_acc": 0.59,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 94.1,
+ "max_len": 64,
+ "loss": 0.3014,
+ "train_acc": 0.555,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 96.6,
+ "max_len": 64,
+ "loss": 0.276,
+ "train_acc": 0.61,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 99.1,
+ "max_len": 64,
+ "loss": 0.2779,
+ "train_acc": 0.623,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 101.6,
+ "max_len": 64,
+ "loss": 0.2844,
+ "train_acc": 0.588,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 104.2,
+ "max_len": 64,
+ "loss": 0.2761,
+ "train_acc": 0.585,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 106.7,
+ "max_len": 64,
+ "loss": 0.2737,
+ "train_acc": 0.58,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 109.2,
+ "max_len": 64,
+ "loss": 0.2568,
+ "train_acc": 0.618,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 111.7,
+ "max_len": 64,
+ "loss": 0.2799,
+ "train_acc": 0.585,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 114.2,
+ "max_len": 64,
+ "loss": 0.2689,
+ "train_acc": 0.637,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 116.8,
+ "max_len": 64,
+ "loss": 0.2855,
+ "train_acc": 0.588,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 119.3,
+ "max_len": 64,
+ "loss": 0.272,
+ "train_acc": 0.583,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 121.8,
+ "max_len": 64,
+ "loss": 0.279,
+ "train_acc": 0.6,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 124.3,
+ "max_len": 64,
+ "loss": 0.2692,
+ "train_acc": 0.64,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 126.8,
+ "max_len": 64,
+ "loss": 0.2694,
+ "train_acc": 0.652,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 129.4,
+ "max_len": 64,
+ "loss": 0.266,
+ "train_acc": 0.615,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 131.9,
+ "max_len": 64,
+ "loss": 0.2716,
+ "train_acc": 0.652,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 134.4,
+ "max_len": 64,
+ "loss": 0.2676,
+ "train_acc": 0.642,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 136.9,
+ "max_len": 64,
+ "loss": 0.2759,
+ "train_acc": 0.57,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 139.4,
+ "max_len": 64,
+ "loss": 0.2629,
+ "train_acc": 0.645,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 142.0,
+ "max_len": 64,
+ "loss": 0.2683,
+ "train_acc": 0.605,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 144.5,
+ "max_len": 64,
+ "loss": 0.2507,
+ "train_acc": 0.652,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 147.0,
+ "max_len": 64,
+ "loss": 0.243,
+ "train_acc": 0.665,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 149.5,
+ "max_len": 64,
+ "loss": 0.2458,
+ "train_acc": 0.637,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 152.0,
+ "max_len": 64,
+ "loss": 0.2739,
+ "train_acc": 0.59,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 154.6,
+ "max_len": 64,
+ "loss": 0.2497,
+ "train_acc": 0.598,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 157.1,
+ "max_len": 64,
+ "loss": 0.2633,
+ "train_acc": 0.608,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 159.6,
+ "max_len": 64,
+ "loss": 0.2595,
+ "train_acc": 0.63,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T5_cap_min_s1.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_cap_min_s1.json
new file mode 100644
index 0000000..27d71ff
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_cap_min_s1.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T5",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T5_cap_min_s1",
+ "seed": 1,
+ "beta_mode": "cap_min",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.4,
+ "max_len": 4,
+ "loss": 2.0317,
+ "train_acc": 0.305,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 0.8,
+ "max_len": 4,
+ "loss": 0.141,
+ "train_acc": 0.868,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 1.2,
+ "max_len": 4,
+ "loss": 0.052,
+ "train_acc": 0.96,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 1.5,
+ "max_len": 4,
+ "loss": 0.0473,
+ "train_acc": 0.97,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 1.9,
+ "max_len": 4,
+ "loss": 0.0361,
+ "train_acc": 0.973,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 2.3,
+ "max_len": 4,
+ "loss": 0.031,
+ "train_acc": 0.985,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 2.7,
+ "max_len": 4,
+ "loss": 0.0043,
+ "train_acc": 0.998,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 3.1,
+ "max_len": 4,
+ "loss": 0.0065,
+ "train_acc": 0.998,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 3.5,
+ "max_len": 8,
+ "loss": 0.2014,
+ "train_acc": 0.875,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 3.9,
+ "max_len": 8,
+ "loss": 0.0847,
+ "train_acc": 0.938,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 4.3,
+ "max_len": 8,
+ "loss": 0.0514,
+ "train_acc": 0.938,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 4.7,
+ "max_len": 8,
+ "loss": 0.1032,
+ "train_acc": 0.945,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 5.1,
+ "max_len": 8,
+ "loss": 0.0265,
+ "train_acc": 0.978,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 5.5,
+ "max_len": 8,
+ "loss": 0.0709,
+ "train_acc": 0.965,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 5.9,
+ "max_len": 8,
+ "loss": 0.0179,
+ "train_acc": 0.983,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 6.3,
+ "max_len": 8,
+ "loss": 0.0282,
+ "train_acc": 0.993,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 6.7,
+ "max_len": 16,
+ "loss": 0.2968,
+ "train_acc": 0.698,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 7.2,
+ "max_len": 16,
+ "loss": 0.2149,
+ "train_acc": 0.715,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 7.6,
+ "max_len": 16,
+ "loss": 0.1763,
+ "train_acc": 0.787,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 8.0,
+ "max_len": 16,
+ "loss": 0.188,
+ "train_acc": 0.797,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 8.4,
+ "max_len": 16,
+ "loss": 0.1278,
+ "train_acc": 0.848,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 8.9,
+ "max_len": 16,
+ "loss": 0.1203,
+ "train_acc": 0.863,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 9.3,
+ "max_len": 16,
+ "loss": 0.1467,
+ "train_acc": 0.84,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 9.7,
+ "max_len": 16,
+ "loss": 0.1054,
+ "train_acc": 0.87,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 10.1,
+ "max_len": 16,
+ "loss": 0.1036,
+ "train_acc": 0.917,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 10.5,
+ "max_len": 16,
+ "loss": 0.0919,
+ "train_acc": 0.89,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 11.0,
+ "max_len": 16,
+ "loss": 0.1639,
+ "train_acc": 0.882,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 11.4,
+ "max_len": 16,
+ "loss": 0.055,
+ "train_acc": 0.948,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 11.9,
+ "max_len": 32,
+ "loss": 0.2793,
+ "train_acc": 0.69,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 12.4,
+ "max_len": 32,
+ "loss": 0.2293,
+ "train_acc": 0.69,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 12.9,
+ "max_len": 32,
+ "loss": 0.2885,
+ "train_acc": 0.662,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 13.4,
+ "max_len": 32,
+ "loss": 0.2764,
+ "train_acc": 0.63,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 13.9,
+ "max_len": 32,
+ "loss": 0.2526,
+ "train_acc": 0.69,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 14.4,
+ "max_len": 32,
+ "loss": 0.2388,
+ "train_acc": 0.68,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 14.8,
+ "max_len": 32,
+ "loss": 0.2208,
+ "train_acc": 0.75,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 15.3,
+ "max_len": 32,
+ "loss": 0.2461,
+ "train_acc": 0.685,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 15.8,
+ "max_len": 32,
+ "loss": 0.2196,
+ "train_acc": 0.733,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 16.3,
+ "max_len": 32,
+ "loss": 0.1954,
+ "train_acc": 0.765,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 16.8,
+ "max_len": 32,
+ "loss": 0.3125,
+ "train_acc": 0.73,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 17.3,
+ "max_len": 32,
+ "loss": 0.1564,
+ "train_acc": 0.82,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 17.8,
+ "max_len": 32,
+ "loss": 0.1827,
+ "train_acc": 0.795,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 18.3,
+ "max_len": 32,
+ "loss": 0.1419,
+ "train_acc": 0.818,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 18.8,
+ "max_len": 32,
+ "loss": 0.1368,
+ "train_acc": 0.858,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 19.3,
+ "max_len": 32,
+ "loss": 0.1448,
+ "train_acc": 0.845,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 20.0,
+ "max_len": 64,
+ "loss": 0.3528,
+ "train_acc": 0.645,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 20.7,
+ "max_len": 64,
+ "loss": 0.3262,
+ "train_acc": 0.53,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 21.4,
+ "max_len": 64,
+ "loss": 0.3006,
+ "train_acc": 0.615,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 22.1,
+ "max_len": 64,
+ "loss": 0.2866,
+ "train_acc": 0.615,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 22.8,
+ "max_len": 64,
+ "loss": 0.2808,
+ "train_acc": 0.655,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 23.5,
+ "max_len": 64,
+ "loss": 0.3164,
+ "train_acc": 0.623,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 24.2,
+ "max_len": 64,
+ "loss": 0.3016,
+ "train_acc": 0.578,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 24.9,
+ "max_len": 64,
+ "loss": 0.2931,
+ "train_acc": 0.57,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 25.6,
+ "max_len": 64,
+ "loss": 0.2904,
+ "train_acc": 0.588,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 26.4,
+ "max_len": 64,
+ "loss": 0.2901,
+ "train_acc": 0.575,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 27.1,
+ "max_len": 64,
+ "loss": 0.2812,
+ "train_acc": 0.652,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 27.8,
+ "max_len": 64,
+ "loss": 0.2717,
+ "train_acc": 0.635,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 28.5,
+ "max_len": 64,
+ "loss": 0.2675,
+ "train_acc": 0.64,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 29.2,
+ "max_len": 64,
+ "loss": 0.2786,
+ "train_acc": 0.598,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 29.9,
+ "max_len": 64,
+ "loss": 0.2713,
+ "train_acc": 0.642,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 30.6,
+ "max_len": 64,
+ "loss": 0.2636,
+ "train_acc": 0.615,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 31.3,
+ "max_len": 64,
+ "loss": 0.2564,
+ "train_acc": 0.652,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 32.0,
+ "max_len": 64,
+ "loss": 0.2757,
+ "train_acc": 0.62,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 32.7,
+ "max_len": 64,
+ "loss": 0.252,
+ "train_acc": 0.635,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 33.4,
+ "max_len": 64,
+ "loss": 0.2668,
+ "train_acc": 0.632,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 34.1,
+ "max_len": 64,
+ "loss": 0.2639,
+ "train_acc": 0.64,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 34.8,
+ "max_len": 64,
+ "loss": 0.263,
+ "train_acc": 0.637,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 35.5,
+ "max_len": 64,
+ "loss": 0.2405,
+ "train_acc": 0.655,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 36.2,
+ "max_len": 64,
+ "loss": 0.2427,
+ "train_acc": 0.677,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 36.9,
+ "max_len": 64,
+ "loss": 0.2441,
+ "train_acc": 0.642,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 37.6,
+ "max_len": 64,
+ "loss": 0.2386,
+ "train_acc": 0.65,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 38.3,
+ "max_len": 64,
+ "loss": 0.2361,
+ "train_acc": 0.672,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 39.0,
+ "max_len": 64,
+ "loss": 0.2554,
+ "train_acc": 0.625,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 39.7,
+ "max_len": 64,
+ "loss": 0.2592,
+ "train_acc": 0.625,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 40.4,
+ "max_len": 64,
+ "loss": 0.2464,
+ "train_acc": 0.662,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 41.1,
+ "max_len": 64,
+ "loss": 0.2427,
+ "train_acc": 0.645,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 41.8,
+ "max_len": 64,
+ "loss": 0.2818,
+ "train_acc": 0.623,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 42.6,
+ "max_len": 64,
+ "loss": 0.2295,
+ "train_acc": 0.67,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 43.3,
+ "max_len": 64,
+ "loss": 0.2399,
+ "train_acc": 0.705,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 44.0,
+ "max_len": 64,
+ "loss": 0.2474,
+ "train_acc": 0.645,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 44.7,
+ "max_len": 64,
+ "loss": 0.2391,
+ "train_acc": 0.698,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T5_cap_min_s2.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_cap_min_s2.json
new file mode 100644
index 0000000..e581ce6
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_cap_min_s2.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T5",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T5_cap_min_s2",
+ "seed": 2,
+ "beta_mode": "cap_min",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.4,
+ "max_len": 4,
+ "loss": 1.9626,
+ "train_acc": 0.31,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 0.8,
+ "max_len": 4,
+ "loss": 0.1664,
+ "train_acc": 0.82,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 1.1,
+ "max_len": 4,
+ "loss": 0.1165,
+ "train_acc": 0.92,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 1.5,
+ "max_len": 4,
+ "loss": 0.043,
+ "train_acc": 0.97,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 1.9,
+ "max_len": 4,
+ "loss": 0.0258,
+ "train_acc": 0.985,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 2.3,
+ "max_len": 4,
+ "loss": 0.0072,
+ "train_acc": 0.993,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 2.7,
+ "max_len": 4,
+ "loss": 0.008,
+ "train_acc": 0.993,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 3.1,
+ "max_len": 4,
+ "loss": 0.0007,
+ "train_acc": 1.0,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 3.5,
+ "max_len": 8,
+ "loss": 0.0736,
+ "train_acc": 0.94,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 3.9,
+ "max_len": 8,
+ "loss": 0.0858,
+ "train_acc": 0.945,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 4.3,
+ "max_len": 8,
+ "loss": 0.0475,
+ "train_acc": 0.958,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 4.7,
+ "max_len": 8,
+ "loss": 0.0529,
+ "train_acc": 0.965,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 5.1,
+ "max_len": 8,
+ "loss": 0.0326,
+ "train_acc": 0.98,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 5.5,
+ "max_len": 8,
+ "loss": 0.0286,
+ "train_acc": 0.97,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 5.9,
+ "max_len": 8,
+ "loss": 0.0185,
+ "train_acc": 0.99,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 6.3,
+ "max_len": 8,
+ "loss": 0.0359,
+ "train_acc": 0.975,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 6.8,
+ "max_len": 16,
+ "loss": 0.3157,
+ "train_acc": 0.625,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 7.2,
+ "max_len": 16,
+ "loss": 0.2514,
+ "train_acc": 0.733,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 7.6,
+ "max_len": 16,
+ "loss": 0.1802,
+ "train_acc": 0.807,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 8.0,
+ "max_len": 16,
+ "loss": 0.1674,
+ "train_acc": 0.815,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 8.4,
+ "max_len": 16,
+ "loss": 0.1469,
+ "train_acc": 0.855,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 8.9,
+ "max_len": 16,
+ "loss": 0.1072,
+ "train_acc": 0.89,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 9.3,
+ "max_len": 16,
+ "loss": 0.0973,
+ "train_acc": 0.905,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 9.7,
+ "max_len": 16,
+ "loss": 0.1277,
+ "train_acc": 0.882,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 10.1,
+ "max_len": 16,
+ "loss": 0.1005,
+ "train_acc": 0.877,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 10.5,
+ "max_len": 16,
+ "loss": 0.1245,
+ "train_acc": 0.895,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 11.0,
+ "max_len": 16,
+ "loss": 0.0894,
+ "train_acc": 0.89,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 11.4,
+ "max_len": 16,
+ "loss": 0.0847,
+ "train_acc": 0.917,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 11.9,
+ "max_len": 32,
+ "loss": 0.2896,
+ "train_acc": 0.688,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 12.4,
+ "max_len": 32,
+ "loss": 0.2523,
+ "train_acc": 0.662,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 12.9,
+ "max_len": 32,
+ "loss": 0.2504,
+ "train_acc": 0.718,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 13.4,
+ "max_len": 32,
+ "loss": 0.2528,
+ "train_acc": 0.667,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 13.9,
+ "max_len": 32,
+ "loss": 0.2406,
+ "train_acc": 0.66,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 14.4,
+ "max_len": 32,
+ "loss": 0.2298,
+ "train_acc": 0.698,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 14.9,
+ "max_len": 32,
+ "loss": 0.2412,
+ "train_acc": 0.68,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 15.4,
+ "max_len": 32,
+ "loss": 0.2552,
+ "train_acc": 0.695,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 15.9,
+ "max_len": 32,
+ "loss": 0.2488,
+ "train_acc": 0.693,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 16.4,
+ "max_len": 32,
+ "loss": 0.2644,
+ "train_acc": 0.672,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 16.8,
+ "max_len": 32,
+ "loss": 0.2045,
+ "train_acc": 0.725,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 17.3,
+ "max_len": 32,
+ "loss": 0.1898,
+ "train_acc": 0.79,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 17.8,
+ "max_len": 32,
+ "loss": 0.1783,
+ "train_acc": 0.8,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 18.3,
+ "max_len": 32,
+ "loss": 0.1839,
+ "train_acc": 0.772,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 18.8,
+ "max_len": 32,
+ "loss": 0.199,
+ "train_acc": 0.735,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 19.3,
+ "max_len": 32,
+ "loss": 0.1683,
+ "train_acc": 0.78,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 20.0,
+ "max_len": 64,
+ "loss": 0.2679,
+ "train_acc": 0.627,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 20.7,
+ "max_len": 64,
+ "loss": 0.2848,
+ "train_acc": 0.605,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 21.4,
+ "max_len": 64,
+ "loss": 0.2982,
+ "train_acc": 0.57,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 22.1,
+ "max_len": 64,
+ "loss": 0.2869,
+ "train_acc": 0.605,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 22.8,
+ "max_len": 64,
+ "loss": 0.287,
+ "train_acc": 0.593,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 23.5,
+ "max_len": 64,
+ "loss": 0.2888,
+ "train_acc": 0.645,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 24.2,
+ "max_len": 64,
+ "loss": 0.2911,
+ "train_acc": 0.542,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 24.9,
+ "max_len": 64,
+ "loss": 0.2641,
+ "train_acc": 0.603,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 25.6,
+ "max_len": 64,
+ "loss": 0.2927,
+ "train_acc": 0.578,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 26.3,
+ "max_len": 64,
+ "loss": 0.2816,
+ "train_acc": 0.585,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 27.0,
+ "max_len": 64,
+ "loss": 0.2631,
+ "train_acc": 0.625,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 27.7,
+ "max_len": 64,
+ "loss": 0.3045,
+ "train_acc": 0.625,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 28.4,
+ "max_len": 64,
+ "loss": 0.2713,
+ "train_acc": 0.635,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 29.1,
+ "max_len": 64,
+ "loss": 0.2901,
+ "train_acc": 0.58,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 29.8,
+ "max_len": 64,
+ "loss": 0.2709,
+ "train_acc": 0.58,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 30.5,
+ "max_len": 64,
+ "loss": 0.2757,
+ "train_acc": 0.608,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 31.2,
+ "max_len": 64,
+ "loss": 0.276,
+ "train_acc": 0.58,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 31.9,
+ "max_len": 64,
+ "loss": 0.2785,
+ "train_acc": 0.585,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 32.6,
+ "max_len": 64,
+ "loss": 0.2762,
+ "train_acc": 0.58,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 33.4,
+ "max_len": 64,
+ "loss": 0.2547,
+ "train_acc": 0.642,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 34.1,
+ "max_len": 64,
+ "loss": 0.2411,
+ "train_acc": 0.665,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 34.8,
+ "max_len": 64,
+ "loss": 0.2611,
+ "train_acc": 0.637,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 35.5,
+ "max_len": 64,
+ "loss": 0.2667,
+ "train_acc": 0.603,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 36.2,
+ "max_len": 64,
+ "loss": 0.2709,
+ "train_acc": 0.613,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 36.9,
+ "max_len": 64,
+ "loss": 0.2725,
+ "train_acc": 0.642,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 37.6,
+ "max_len": 64,
+ "loss": 0.2644,
+ "train_acc": 0.615,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 38.3,
+ "max_len": 64,
+ "loss": 0.2541,
+ "train_acc": 0.63,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 39.0,
+ "max_len": 64,
+ "loss": 0.2508,
+ "train_acc": 0.62,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 39.7,
+ "max_len": 64,
+ "loss": 0.2535,
+ "train_acc": 0.613,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 40.4,
+ "max_len": 64,
+ "loss": 0.2735,
+ "train_acc": 0.635,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 41.1,
+ "max_len": 64,
+ "loss": 0.2511,
+ "train_acc": 0.61,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 41.8,
+ "max_len": 64,
+ "loss": 0.2443,
+ "train_acc": 0.642,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 42.5,
+ "max_len": 64,
+ "loss": 0.2606,
+ "train_acc": 0.657,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 43.2,
+ "max_len": 64,
+ "loss": 0.249,
+ "train_acc": 0.65,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 43.9,
+ "max_len": 64,
+ "loss": 0.2313,
+ "train_acc": 0.682,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 44.7,
+ "max_len": 64,
+ "loss": 0.2588,
+ "train_acc": 0.645,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T5_stock_s0.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_stock_s0.json
new file mode 100644
index 0000000..e703abe
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_stock_s0.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T5",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T5_stock_s0",
+ "seed": 0,
+ "beta_mode": "stock",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.2,
+ "max_len": 4,
+ "loss": 1.6207,
+ "train_acc": 0.36,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 0.5,
+ "max_len": 4,
+ "loss": 0.1507,
+ "train_acc": 0.838,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 0.7,
+ "max_len": 4,
+ "loss": 0.1106,
+ "train_acc": 0.91,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 0.9,
+ "max_len": 4,
+ "loss": 0.0341,
+ "train_acc": 0.983,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 1.1,
+ "max_len": 4,
+ "loss": 0.0223,
+ "train_acc": 0.983,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 1.3,
+ "max_len": 4,
+ "loss": 0.0156,
+ "train_acc": 0.993,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 1.5,
+ "max_len": 4,
+ "loss": 0.0145,
+ "train_acc": 0.99,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 1.8,
+ "max_len": 4,
+ "loss": 0.0036,
+ "train_acc": 0.998,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 2.0,
+ "max_len": 8,
+ "loss": 0.1461,
+ "train_acc": 0.877,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 2.2,
+ "max_len": 8,
+ "loss": 0.0906,
+ "train_acc": 0.925,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 2.5,
+ "max_len": 8,
+ "loss": 0.1511,
+ "train_acc": 0.927,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 2.7,
+ "max_len": 8,
+ "loss": 0.0284,
+ "train_acc": 0.97,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 2.9,
+ "max_len": 8,
+ "loss": 0.0654,
+ "train_acc": 0.97,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 3.1,
+ "max_len": 8,
+ "loss": 0.0606,
+ "train_acc": 0.953,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 3.3,
+ "max_len": 8,
+ "loss": 0.0384,
+ "train_acc": 0.968,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 3.7,
+ "max_len": 8,
+ "loss": 0.0357,
+ "train_acc": 0.975,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 4.2,
+ "max_len": 16,
+ "loss": 0.1932,
+ "train_acc": 0.777,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 4.7,
+ "max_len": 16,
+ "loss": 0.1602,
+ "train_acc": 0.833,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 5.2,
+ "max_len": 16,
+ "loss": 0.1318,
+ "train_acc": 0.848,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 5.7,
+ "max_len": 16,
+ "loss": 0.1359,
+ "train_acc": 0.892,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 6.2,
+ "max_len": 16,
+ "loss": 0.1596,
+ "train_acc": 0.868,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 6.7,
+ "max_len": 16,
+ "loss": 0.1126,
+ "train_acc": 0.9,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 7.2,
+ "max_len": 16,
+ "loss": 0.1339,
+ "train_acc": 0.88,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 7.7,
+ "max_len": 16,
+ "loss": 0.0722,
+ "train_acc": 0.935,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 8.4,
+ "max_len": 16,
+ "loss": 0.1184,
+ "train_acc": 0.897,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 9.2,
+ "max_len": 16,
+ "loss": 0.1071,
+ "train_acc": 0.9,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 9.9,
+ "max_len": 16,
+ "loss": 0.0882,
+ "train_acc": 0.897,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 10.6,
+ "max_len": 16,
+ "loss": 0.0666,
+ "train_acc": 0.935,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 11.5,
+ "max_len": 32,
+ "loss": 0.4133,
+ "train_acc": 0.623,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 12.3,
+ "max_len": 32,
+ "loss": 0.2761,
+ "train_acc": 0.575,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 13.2,
+ "max_len": 32,
+ "loss": 0.2694,
+ "train_acc": 0.627,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 14.0,
+ "max_len": 32,
+ "loss": 0.2621,
+ "train_acc": 0.665,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 14.9,
+ "max_len": 32,
+ "loss": 0.2586,
+ "train_acc": 0.635,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 15.7,
+ "max_len": 32,
+ "loss": 0.223,
+ "train_acc": 0.695,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 16.6,
+ "max_len": 32,
+ "loss": 0.2615,
+ "train_acc": 0.647,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 17.5,
+ "max_len": 32,
+ "loss": 0.2629,
+ "train_acc": 0.66,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 18.3,
+ "max_len": 32,
+ "loss": 0.2608,
+ "train_acc": 0.657,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 19.2,
+ "max_len": 32,
+ "loss": 0.2388,
+ "train_acc": 0.645,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 20.0,
+ "max_len": 32,
+ "loss": 0.2244,
+ "train_acc": 0.667,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 20.9,
+ "max_len": 32,
+ "loss": 0.2062,
+ "train_acc": 0.713,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 21.7,
+ "max_len": 32,
+ "loss": 0.2187,
+ "train_acc": 0.69,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 22.6,
+ "max_len": 32,
+ "loss": 0.2309,
+ "train_acc": 0.688,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 23.5,
+ "max_len": 32,
+ "loss": 0.2465,
+ "train_acc": 0.672,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 24.3,
+ "max_len": 32,
+ "loss": 0.2367,
+ "train_acc": 0.667,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 25.5,
+ "max_len": 64,
+ "loss": 0.2969,
+ "train_acc": 0.588,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 26.7,
+ "max_len": 64,
+ "loss": 0.308,
+ "train_acc": 0.573,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 27.9,
+ "max_len": 64,
+ "loss": 0.2953,
+ "train_acc": 0.552,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 29.1,
+ "max_len": 64,
+ "loss": 0.2893,
+ "train_acc": 0.588,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 30.3,
+ "max_len": 64,
+ "loss": 0.285,
+ "train_acc": 0.593,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 31.8,
+ "max_len": 64,
+ "loss": 0.2864,
+ "train_acc": 0.537,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 33.4,
+ "max_len": 64,
+ "loss": 0.2923,
+ "train_acc": 0.595,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 35.0,
+ "max_len": 64,
+ "loss": 0.2828,
+ "train_acc": 0.6,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 36.6,
+ "max_len": 64,
+ "loss": 0.2889,
+ "train_acc": 0.58,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 38.2,
+ "max_len": 64,
+ "loss": 0.2942,
+ "train_acc": 0.555,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 39.8,
+ "max_len": 64,
+ "loss": 0.2779,
+ "train_acc": 0.613,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 41.4,
+ "max_len": 64,
+ "loss": 0.2805,
+ "train_acc": 0.623,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 43.0,
+ "max_len": 64,
+ "loss": 0.2956,
+ "train_acc": 0.57,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 44.6,
+ "max_len": 64,
+ "loss": 0.2826,
+ "train_acc": 0.608,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 46.2,
+ "max_len": 64,
+ "loss": 0.2886,
+ "train_acc": 0.615,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 47.9,
+ "max_len": 64,
+ "loss": 0.2729,
+ "train_acc": 0.62,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 49.5,
+ "max_len": 64,
+ "loss": 0.2833,
+ "train_acc": 0.605,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 51.1,
+ "max_len": 64,
+ "loss": 0.285,
+ "train_acc": 0.623,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 52.7,
+ "max_len": 64,
+ "loss": 0.2878,
+ "train_acc": 0.575,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 54.3,
+ "max_len": 64,
+ "loss": 0.2757,
+ "train_acc": 0.598,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 55.9,
+ "max_len": 64,
+ "loss": 0.2835,
+ "train_acc": 0.593,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 57.6,
+ "max_len": 64,
+ "loss": 0.2783,
+ "train_acc": 0.637,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 59.2,
+ "max_len": 64,
+ "loss": 0.2765,
+ "train_acc": 0.637,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 60.8,
+ "max_len": 64,
+ "loss": 0.2741,
+ "train_acc": 0.61,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 62.4,
+ "max_len": 64,
+ "loss": 0.2809,
+ "train_acc": 0.637,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 64.0,
+ "max_len": 64,
+ "loss": 0.2721,
+ "train_acc": 0.61,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 65.6,
+ "max_len": 64,
+ "loss": 0.283,
+ "train_acc": 0.59,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 67.3,
+ "max_len": 64,
+ "loss": 0.2807,
+ "train_acc": 0.63,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 68.9,
+ "max_len": 64,
+ "loss": 0.2777,
+ "train_acc": 0.578,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 70.5,
+ "max_len": 64,
+ "loss": 0.2685,
+ "train_acc": 0.632,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 72.1,
+ "max_len": 64,
+ "loss": 0.2622,
+ "train_acc": 0.595,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 73.7,
+ "max_len": 64,
+ "loss": 0.2593,
+ "train_acc": 0.61,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 75.3,
+ "max_len": 64,
+ "loss": 0.284,
+ "train_acc": 0.62,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 77.0,
+ "max_len": 64,
+ "loss": 0.2701,
+ "train_acc": 0.615,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 78.6,
+ "max_len": 64,
+ "loss": 0.2741,
+ "train_acc": 0.618,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 80.2,
+ "max_len": 64,
+ "loss": 0.2733,
+ "train_acc": 0.618,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T5_stock_s1.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_stock_s1.json
new file mode 100644
index 0000000..8819461
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_stock_s1.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T5",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T5_stock_s1",
+ "seed": 1,
+ "beta_mode": "stock",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.9,
+ "max_len": 4,
+ "loss": 1.6671,
+ "train_acc": 0.352,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 1.8,
+ "max_len": 4,
+ "loss": 0.1747,
+ "train_acc": 0.81,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 2.7,
+ "max_len": 4,
+ "loss": 0.0627,
+ "train_acc": 0.945,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 3.7,
+ "max_len": 4,
+ "loss": 0.0726,
+ "train_acc": 0.97,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 4.6,
+ "max_len": 4,
+ "loss": 0.0093,
+ "train_acc": 0.993,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 5.5,
+ "max_len": 4,
+ "loss": 0.021,
+ "train_acc": 0.99,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 6.4,
+ "max_len": 4,
+ "loss": 0.0448,
+ "train_acc": 0.988,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 7.4,
+ "max_len": 4,
+ "loss": 0.0327,
+ "train_acc": 0.983,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 8.3,
+ "max_len": 8,
+ "loss": 0.1233,
+ "train_acc": 0.907,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 9.3,
+ "max_len": 8,
+ "loss": 0.0938,
+ "train_acc": 0.935,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 10.3,
+ "max_len": 8,
+ "loss": 0.0558,
+ "train_acc": 0.95,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 11.2,
+ "max_len": 8,
+ "loss": 0.0563,
+ "train_acc": 0.96,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 12.1,
+ "max_len": 8,
+ "loss": 0.038,
+ "train_acc": 0.975,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 13.1,
+ "max_len": 8,
+ "loss": 0.0194,
+ "train_acc": 0.985,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 14.1,
+ "max_len": 8,
+ "loss": 0.0699,
+ "train_acc": 0.948,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 15.0,
+ "max_len": 8,
+ "loss": 0.0295,
+ "train_acc": 0.983,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 16.0,
+ "max_len": 16,
+ "loss": 0.2628,
+ "train_acc": 0.735,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 17.0,
+ "max_len": 16,
+ "loss": 0.1923,
+ "train_acc": 0.787,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 18.0,
+ "max_len": 16,
+ "loss": 0.1553,
+ "train_acc": 0.848,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 19.0,
+ "max_len": 16,
+ "loss": 0.1273,
+ "train_acc": 0.848,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 20.0,
+ "max_len": 16,
+ "loss": 0.1012,
+ "train_acc": 0.897,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 21.0,
+ "max_len": 16,
+ "loss": 0.097,
+ "train_acc": 0.9,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 21.9,
+ "max_len": 16,
+ "loss": 0.1036,
+ "train_acc": 0.927,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 22.9,
+ "max_len": 16,
+ "loss": 0.1162,
+ "train_acc": 0.902,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 23.9,
+ "max_len": 16,
+ "loss": 0.0844,
+ "train_acc": 0.922,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 24.9,
+ "max_len": 16,
+ "loss": 0.1205,
+ "train_acc": 0.915,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 25.9,
+ "max_len": 16,
+ "loss": 0.0738,
+ "train_acc": 0.912,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 26.9,
+ "max_len": 16,
+ "loss": 0.0582,
+ "train_acc": 0.95,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 28.0,
+ "max_len": 32,
+ "loss": 0.3885,
+ "train_acc": 0.615,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 29.2,
+ "max_len": 32,
+ "loss": 0.2485,
+ "train_acc": 0.693,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 30.3,
+ "max_len": 32,
+ "loss": 0.2294,
+ "train_acc": 0.7,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 31.5,
+ "max_len": 32,
+ "loss": 0.2405,
+ "train_acc": 0.688,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 32.6,
+ "max_len": 32,
+ "loss": 0.2127,
+ "train_acc": 0.703,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 33.8,
+ "max_len": 32,
+ "loss": 0.2003,
+ "train_acc": 0.738,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 34.9,
+ "max_len": 32,
+ "loss": 0.1904,
+ "train_acc": 0.767,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 36.1,
+ "max_len": 32,
+ "loss": 0.2171,
+ "train_acc": 0.71,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 37.2,
+ "max_len": 32,
+ "loss": 0.2482,
+ "train_acc": 0.695,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 38.4,
+ "max_len": 32,
+ "loss": 0.1873,
+ "train_acc": 0.748,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 39.5,
+ "max_len": 32,
+ "loss": 0.2074,
+ "train_acc": 0.792,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 40.7,
+ "max_len": 32,
+ "loss": 0.1707,
+ "train_acc": 0.777,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 41.8,
+ "max_len": 32,
+ "loss": 0.2046,
+ "train_acc": 0.76,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 43.0,
+ "max_len": 32,
+ "loss": 0.2361,
+ "train_acc": 0.725,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 44.2,
+ "max_len": 32,
+ "loss": 0.188,
+ "train_acc": 0.78,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 45.3,
+ "max_len": 32,
+ "loss": 0.1445,
+ "train_acc": 0.835,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 46.9,
+ "max_len": 64,
+ "loss": 0.3101,
+ "train_acc": 0.578,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 48.5,
+ "max_len": 64,
+ "loss": 0.3068,
+ "train_acc": 0.578,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 49.9,
+ "max_len": 64,
+ "loss": 0.2815,
+ "train_acc": 0.632,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 51.3,
+ "max_len": 64,
+ "loss": 0.281,
+ "train_acc": 0.632,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 52.8,
+ "max_len": 64,
+ "loss": 0.2812,
+ "train_acc": 0.662,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 54.0,
+ "max_len": 64,
+ "loss": 0.2831,
+ "train_acc": 0.64,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 55.2,
+ "max_len": 64,
+ "loss": 0.2845,
+ "train_acc": 0.613,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 56.4,
+ "max_len": 64,
+ "loss": 0.2728,
+ "train_acc": 0.63,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 57.6,
+ "max_len": 64,
+ "loss": 0.2883,
+ "train_acc": 0.603,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 58.9,
+ "max_len": 64,
+ "loss": 0.2919,
+ "train_acc": 0.61,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 60.1,
+ "max_len": 64,
+ "loss": 0.2725,
+ "train_acc": 0.645,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 61.3,
+ "max_len": 64,
+ "loss": 0.269,
+ "train_acc": 0.64,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 62.5,
+ "max_len": 64,
+ "loss": 0.2858,
+ "train_acc": 0.632,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 63.7,
+ "max_len": 64,
+ "loss": 0.2677,
+ "train_acc": 0.575,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 64.9,
+ "max_len": 64,
+ "loss": 0.2702,
+ "train_acc": 0.618,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 66.1,
+ "max_len": 64,
+ "loss": 0.2648,
+ "train_acc": 0.627,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 67.3,
+ "max_len": 64,
+ "loss": 0.2579,
+ "train_acc": 0.66,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 68.6,
+ "max_len": 64,
+ "loss": 0.2675,
+ "train_acc": 0.608,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 69.8,
+ "max_len": 64,
+ "loss": 0.2546,
+ "train_acc": 0.647,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 71.0,
+ "max_len": 64,
+ "loss": 0.2668,
+ "train_acc": 0.623,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 72.2,
+ "max_len": 64,
+ "loss": 0.2581,
+ "train_acc": 0.642,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 73.4,
+ "max_len": 64,
+ "loss": 0.2629,
+ "train_acc": 0.662,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 74.6,
+ "max_len": 64,
+ "loss": 0.2686,
+ "train_acc": 0.64,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 75.8,
+ "max_len": 64,
+ "loss": 0.2578,
+ "train_acc": 0.623,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 77.1,
+ "max_len": 64,
+ "loss": 0.2443,
+ "train_acc": 0.67,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 78.3,
+ "max_len": 64,
+ "loss": 0.2524,
+ "train_acc": 0.625,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 79.5,
+ "max_len": 64,
+ "loss": 0.2538,
+ "train_acc": 0.645,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 80.7,
+ "max_len": 64,
+ "loss": 0.2696,
+ "train_acc": 0.603,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 81.9,
+ "max_len": 64,
+ "loss": 0.2682,
+ "train_acc": 0.603,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 83.1,
+ "max_len": 64,
+ "loss": 0.2611,
+ "train_acc": 0.615,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 84.3,
+ "max_len": 64,
+ "loss": 0.2587,
+ "train_acc": 0.665,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 85.5,
+ "max_len": 64,
+ "loss": 0.261,
+ "train_acc": 0.588,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 86.8,
+ "max_len": 64,
+ "loss": 0.2569,
+ "train_acc": 0.62,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 88.0,
+ "max_len": 64,
+ "loss": 0.2609,
+ "train_acc": 0.635,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 89.2,
+ "max_len": 64,
+ "loss": 0.2676,
+ "train_acc": 0.618,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 90.4,
+ "max_len": 64,
+ "loss": 0.2607,
+ "train_acc": 0.623,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/results/ft/train_log_olmoh_T5_stock_s2.json b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_stock_s2.json
new file mode 100644
index 0000000..7486d86
--- /dev/null
+++ b/research/hidden-reasoning/results/ft/train_log_olmoh_T5_stock_s2.json
@@ -0,0 +1,654 @@
+{
+ "model": "olmoh",
+ "task": "T5",
+ "fmt": "sym",
+ "minutes": 400.0,
+ "steps": 2002,
+ "bs": 16,
+ "lr": 5e-05,
+ "out": "adapters/olmoh_T5_stock_s2",
+ "seed": 2,
+ "beta_mode": "stock",
+ "log": [
+ {
+ "step": 25,
+ "minutes": 0.5,
+ "max_len": 4,
+ "loss": 1.6083,
+ "train_acc": 0.315,
+ "lr": 4.165337088039502e-05
+ },
+ {
+ "step": 50,
+ "minutes": 1.0,
+ "max_len": 4,
+ "loss": 0.1869,
+ "train_acc": 0.812,
+ "lr": 4.9933518272758475e-05
+ },
+ {
+ "step": 75,
+ "minutes": 1.5,
+ "max_len": 4,
+ "loss": 0.1051,
+ "train_acc": 0.887,
+ "lr": 4.984846969910435e-05
+ },
+ {
+ "step": 100,
+ "minutes": 2.2,
+ "max_len": 4,
+ "loss": 0.0717,
+ "train_acc": 0.975,
+ "lr": 4.97290302123968e-05
+ },
+ {
+ "step": 125,
+ "minutes": 2.7,
+ "max_len": 4,
+ "loss": 0.0311,
+ "train_acc": 0.983,
+ "lr": 4.957538361193204e-05
+ },
+ {
+ "step": 150,
+ "minutes": 3.3,
+ "max_len": 4,
+ "loss": 0.0224,
+ "train_acc": 0.993,
+ "lr": 4.93877663365781e-05
+ },
+ {
+ "step": 175,
+ "minutes": 3.9,
+ "max_len": 4,
+ "loss": 0.0046,
+ "train_acc": 0.998,
+ "lr": 4.916646710093113e-05
+ },
+ {
+ "step": 200,
+ "minutes": 4.1,
+ "max_len": 4,
+ "loss": 0.001,
+ "train_acc": 1.0,
+ "lr": 4.8911826451027364e-05
+ },
+ {
+ "step": 225,
+ "minutes": 4.3,
+ "max_len": 8,
+ "loss": 0.1032,
+ "train_acc": 0.935,
+ "lr": 4.8624236240294295e-05
+ },
+ {
+ "step": 250,
+ "minutes": 4.6,
+ "max_len": 8,
+ "loss": 0.0737,
+ "train_acc": 0.932,
+ "lr": 4.830413902654755e-05
+ },
+ {
+ "step": 275,
+ "minutes": 4.8,
+ "max_len": 8,
+ "loss": 0.0287,
+ "train_acc": 0.973,
+ "lr": 4.7952027390961336e-05
+ },
+ {
+ "step": 300,
+ "minutes": 5.1,
+ "max_len": 8,
+ "loss": 0.0644,
+ "train_acc": 0.955,
+ "lr": 4.756844318006062e-05
+ },
+ {
+ "step": 325,
+ "minutes": 5.3,
+ "max_len": 8,
+ "loss": 0.0506,
+ "train_acc": 0.963,
+ "lr": 4.715397667190126e-05
+ },
+ {
+ "step": 350,
+ "minutes": 5.6,
+ "max_len": 8,
+ "loss": 0.0418,
+ "train_acc": 0.95,
+ "lr": 4.6709265667721474e-05
+ },
+ {
+ "step": 375,
+ "minutes": 6.0,
+ "max_len": 8,
+ "loss": 0.0473,
+ "train_acc": 0.965,
+ "lr": 4.623499451046214e-05
+ },
+ {
+ "step": 400,
+ "minutes": 6.3,
+ "max_len": 8,
+ "loss": 0.0304,
+ "train_acc": 0.965,
+ "lr": 4.5731893031666675e-05
+ },
+ {
+ "step": 425,
+ "minutes": 6.6,
+ "max_len": 16,
+ "loss": 0.285,
+ "train_acc": 0.72,
+ "lr": 4.520073542838065e-05
+ },
+ {
+ "step": 450,
+ "minutes": 6.9,
+ "max_len": 16,
+ "loss": 0.17,
+ "train_acc": 0.81,
+ "lr": 4.464233907177974e-05
+ },
+ {
+ "step": 475,
+ "minutes": 7.4,
+ "max_len": 16,
+ "loss": 0.1371,
+ "train_acc": 0.85,
+ "lr": 4.4057563249359115e-05
+ },
+ {
+ "step": 500,
+ "minutes": 7.7,
+ "max_len": 16,
+ "loss": 0.129,
+ "train_acc": 0.868,
+ "lr": 4.344730784262011e-05
+ },
+ {
+ "step": 525,
+ "minutes": 7.9,
+ "max_len": 16,
+ "loss": 0.164,
+ "train_acc": 0.845,
+ "lr": 4.281251194228866e-05
+ },
+ {
+ "step": 550,
+ "minutes": 8.2,
+ "max_len": 16,
+ "loss": 0.1021,
+ "train_acc": 0.907,
+ "lr": 4.215415240319682e-05
+ },
+ {
+ "step": 575,
+ "minutes": 8.4,
+ "max_len": 16,
+ "loss": 0.1247,
+ "train_acc": 0.917,
+ "lr": 4.147324234105104e-05
+ },
+ {
+ "step": 600,
+ "minutes": 8.7,
+ "max_len": 16,
+ "loss": 0.1186,
+ "train_acc": 0.895,
+ "lr": 4.0770829573400335e-05
+ },
+ {
+ "step": 625,
+ "minutes": 8.9,
+ "max_len": 16,
+ "loss": 0.1196,
+ "train_acc": 0.863,
+ "lr": 4.004799500720366e-05
+ },
+ {
+ "step": 650,
+ "minutes": 9.2,
+ "max_len": 16,
+ "loss": 0.1035,
+ "train_acc": 0.9,
+ "lr": 3.930585097547768e-05
+ },
+ {
+ "step": 675,
+ "minutes": 9.7,
+ "max_len": 16,
+ "loss": 0.0887,
+ "train_acc": 0.907,
+ "lr": 3.854553952558456e-05
+ },
+ {
+ "step": 700,
+ "minutes": 10.0,
+ "max_len": 16,
+ "loss": 0.1281,
+ "train_acc": 0.885,
+ "lr": 3.776823066179387e-05
+ },
+ {
+ "step": 725,
+ "minutes": 10.2,
+ "max_len": 32,
+ "loss": 0.2509,
+ "train_acc": 0.682,
+ "lr": 3.697512054482313e-05
+ },
+ {
+ "step": 750,
+ "minutes": 10.8,
+ "max_len": 32,
+ "loss": 0.2642,
+ "train_acc": 0.665,
+ "lr": 3.616742965112741e-05
+ },
+ {
+ "step": 775,
+ "minutes": 11.1,
+ "max_len": 32,
+ "loss": 0.2222,
+ "train_acc": 0.718,
+ "lr": 3.5346400894770746e-05
+ },
+ {
+ "step": 800,
+ "minutes": 11.4,
+ "max_len": 32,
+ "loss": 0.2218,
+ "train_acc": 0.68,
+ "lr": 3.451329771476954e-05
+ },
+ {
+ "step": 825,
+ "minutes": 11.7,
+ "max_len": 32,
+ "loss": 0.2652,
+ "train_acc": 0.675,
+ "lr": 3.366940213085102e-05
+ },
+ {
+ "step": 850,
+ "minutes": 12.0,
+ "max_len": 32,
+ "loss": 0.2084,
+ "train_acc": 0.755,
+ "lr": 3.2816012770618925e-05
+ },
+ {
+ "step": 875,
+ "minutes": 12.6,
+ "max_len": 32,
+ "loss": 0.2491,
+ "train_acc": 0.688,
+ "lr": 3.1954442871162146e-05
+ },
+ {
+ "step": 900,
+ "minutes": 13.4,
+ "max_len": 32,
+ "loss": 0.2922,
+ "train_acc": 0.568,
+ "lr": 3.1086018258181534e-05
+ },
+ {
+ "step": 925,
+ "minutes": 14.0,
+ "max_len": 32,
+ "loss": 0.2611,
+ "train_acc": 0.642,
+ "lr": 3.021207530574477e-05
+ },
+ {
+ "step": 950,
+ "minutes": 14.8,
+ "max_len": 32,
+ "loss": 0.2549,
+ "train_acc": 0.64,
+ "lr": 2.9333958879808927e-05
+ },
+ {
+ "step": 975,
+ "minutes": 15.5,
+ "max_len": 32,
+ "loss": 0.2599,
+ "train_acc": 0.642,
+ "lr": 2.8453020268675244e-05
+ },
+ {
+ "step": 1000,
+ "minutes": 16.0,
+ "max_len": 32,
+ "loss": 0.2284,
+ "train_acc": 0.698,
+ "lr": 2.7570615103560933e-05
+ },
+ {
+ "step": 1025,
+ "minutes": 16.3,
+ "max_len": 32,
+ "loss": 0.2158,
+ "train_acc": 0.705,
+ "lr": 2.6688101272487852e-05
+ },
+ {
+ "step": 1050,
+ "minutes": 16.6,
+ "max_len": 32,
+ "loss": 0.25,
+ "train_acc": 0.645,
+ "lr": 2.5806836830698344e-05
+ },
+ {
+ "step": 1075,
+ "minutes": 16.9,
+ "max_len": 32,
+ "loss": 0.2377,
+ "train_acc": 0.642,
+ "lr": 2.492817791081366e-05
+ },
+ {
+ "step": 1100,
+ "minutes": 17.1,
+ "max_len": 32,
+ "loss": 0.2241,
+ "train_acc": 0.713,
+ "lr": 2.405347663595118e-05
+ },
+ {
+ "step": 1125,
+ "minutes": 17.5,
+ "max_len": 64,
+ "loss": 0.2829,
+ "train_acc": 0.62,
+ "lr": 2.3184079039011403e-05
+ },
+ {
+ "step": 1150,
+ "minutes": 18.0,
+ "max_len": 64,
+ "loss": 0.3005,
+ "train_acc": 0.565,
+ "lr": 2.232132299133711e-05
+ },
+ {
+ "step": 1175,
+ "minutes": 18.8,
+ "max_len": 64,
+ "loss": 0.3056,
+ "train_acc": 0.57,
+ "lr": 2.1466536143931783e-05
+ },
+ {
+ "step": 1200,
+ "minutes": 19.6,
+ "max_len": 64,
+ "loss": 0.2984,
+ "train_acc": 0.593,
+ "lr": 2.0621033884405567e-05
+ },
+ {
+ "step": 1225,
+ "minutes": 20.4,
+ "max_len": 64,
+ "loss": 0.3194,
+ "train_acc": 0.56,
+ "lr": 1.9786117312792842e-05
+ },
+ {
+ "step": 1250,
+ "minutes": 21.1,
+ "max_len": 64,
+ "loss": 0.2959,
+ "train_acc": 0.635,
+ "lr": 1.8963071239356134e-05
+ },
+ {
+ "step": 1275,
+ "minutes": 21.9,
+ "max_len": 64,
+ "loss": 0.2997,
+ "train_acc": 0.53,
+ "lr": 1.815316220745756e-05
+ },
+ {
+ "step": 1300,
+ "minutes": 22.7,
+ "max_len": 64,
+ "loss": 0.2795,
+ "train_acc": 0.615,
+ "lr": 1.7357636544540202e-05
+ },
+ {
+ "step": 1325,
+ "minutes": 23.5,
+ "max_len": 64,
+ "loss": 0.2924,
+ "train_acc": 0.613,
+ "lr": 1.6577718444218818e-05
+ },
+ {
+ "step": 1350,
+ "minutes": 24.3,
+ "max_len": 64,
+ "loss": 0.3105,
+ "train_acc": 0.58,
+ "lr": 1.58146080824311e-05
+ },
+ {
+ "step": 1375,
+ "minutes": 25.1,
+ "max_len": 64,
+ "loss": 0.285,
+ "train_acc": 0.598,
+ "lr": 1.5069479770548506e-05
+ },
+ {
+ "step": 1400,
+ "minutes": 25.9,
+ "max_len": 64,
+ "loss": 0.2792,
+ "train_acc": 0.608,
+ "lr": 1.4343480148288763e-05
+ },
+ {
+ "step": 1425,
+ "minutes": 26.7,
+ "max_len": 64,
+ "loss": 0.2923,
+ "train_acc": 0.615,
+ "lr": 1.3637726419210877e-05
+ },
+ {
+ "step": 1450,
+ "minutes": 27.5,
+ "max_len": 64,
+ "loss": 0.3017,
+ "train_acc": 0.568,
+ "lr": 1.2953304631507885e-05
+ },
+ {
+ "step": 1475,
+ "minutes": 28.3,
+ "max_len": 64,
+ "loss": 0.2973,
+ "train_acc": 0.578,
+ "lr": 1.2291268006743027e-05
+ },
+ {
+ "step": 1500,
+ "minutes": 29.0,
+ "max_len": 64,
+ "loss": 0.281,
+ "train_acc": 0.608,
+ "lr": 1.1652635319101177e-05
+ },
+ {
+ "step": 1525,
+ "minutes": 29.8,
+ "max_len": 64,
+ "loss": 0.2797,
+ "train_acc": 0.588,
+ "lr": 1.1038389327649468e-05
+ },
+ {
+ "step": 1550,
+ "minutes": 30.6,
+ "max_len": 64,
+ "loss": 0.2912,
+ "train_acc": 0.56,
+ "lr": 1.044947526401987e-05
+ },
+ {
+ "step": 1575,
+ "minutes": 31.4,
+ "max_len": 64,
+ "loss": 0.2828,
+ "train_acc": 0.583,
+ "lr": 9.886799377840693e-06
+ },
+ {
+ "step": 1600,
+ "minutes": 32.2,
+ "max_len": 64,
+ "loss": 0.2689,
+ "train_acc": 0.665,
+ "lr": 9.351227542155574e-06
+ },
+ {
+ "step": 1625,
+ "minutes": 33.0,
+ "max_len": 64,
+ "loss": 0.2777,
+ "train_acc": 0.61,
+ "lr": 8.843583920975867e-06
+ },
+ {
+ "step": 1650,
+ "minutes": 33.7,
+ "max_len": 64,
+ "loss": 0.2668,
+ "train_acc": 0.608,
+ "lr": 8.36464970101695e-06
+ },
+ {
+ "step": 1675,
+ "minutes": 34.5,
+ "max_len": 64,
+ "loss": 0.2833,
+ "train_acc": 0.578,
+ "lr": 7.915161889570102e-06
+ },
+ {
+ "step": 1700,
+ "minutes": 35.3,
+ "max_len": 64,
+ "loss": 0.2822,
+ "train_acc": 0.595,
+ "lr": 7.495812180359772e-06
+ },
+ {
+ "step": 1725,
+ "minutes": 36.1,
+ "max_len": 64,
+ "loss": 0.2774,
+ "train_acc": 0.618,
+ "lr": 7.107245889131627e-06
+ },
+ {
+ "step": 1750,
+ "minutes": 36.9,
+ "max_len": 64,
+ "loss": 0.2767,
+ "train_acc": 0.61,
+ "lr": 6.75006096060927e-06
+ },
+ {
+ "step": 1775,
+ "minutes": 37.7,
+ "max_len": 64,
+ "loss": 0.2688,
+ "train_acc": 0.598,
+ "lr": 6.424807048347785e-06
+ },
+ {
+ "step": 1800,
+ "minutes": 38.5,
+ "max_len": 64,
+ "loss": 0.2671,
+ "train_acc": 0.613,
+ "lr": 6.131984668900095e-06
+ },
+ {
+ "step": 1825,
+ "minutes": 39.3,
+ "max_len": 64,
+ "loss": 0.2651,
+ "train_acc": 0.627,
+ "lr": 5.872044431597726e-06
+ },
+ {
+ "step": 1850,
+ "minutes": 40.1,
+ "max_len": 64,
+ "loss": 0.2757,
+ "train_acc": 0.61,
+ "lr": 5.645386345131224e-06
+ },
+ {
+ "step": 1875,
+ "minutes": 40.9,
+ "max_len": 64,
+ "loss": 0.2609,
+ "train_acc": 0.63,
+ "lr": 5.452359201997326e-06
+ },
+ {
+ "step": 1900,
+ "minutes": 41.7,
+ "max_len": 64,
+ "loss": 0.257,
+ "train_acc": 0.632,
+ "lr": 5.293260041760069e-06
+ },
+ {
+ "step": 1925,
+ "minutes": 42.5,
+ "max_len": 64,
+ "loss": 0.279,
+ "train_acc": 0.657,
+ "lr": 5.168333693951877e-06
+ },
+ {
+ "step": 1950,
+ "minutes": 43.3,
+ "max_len": 64,
+ "loss": 0.2752,
+ "train_acc": 0.613,
+ "lr": 5.077772401317924e-06
+ },
+ {
+ "step": 1975,
+ "minutes": 44.1,
+ "max_len": 64,
+ "loss": 0.2525,
+ "train_acc": 0.645,
+ "lr": 5.021715523983666e-06
+ },
+ {
+ "step": 2000,
+ "minutes": 44.9,
+ "max_len": 64,
+ "loss": 0.2816,
+ "train_acc": 0.618,
+ "lr": 5.000249325000688e-06
+ }
+ ]
+}
\ No newline at end of file
diff --git a/research/hidden-reasoning/scripts/ft_eval4.sh b/research/hidden-reasoning/scripts/ft_eval4.sh
index 18315ae..2947e80 100644
--- a/research/hidden-reasoning/scripts/ft_eval4.sh
+++ b/research/hidden-reasoning/scripts/ft_eval4.sh
@@ -10,4 +10,4 @@ $P --adapter adapters/$N --lengths 16 64 96 128 144 192 256 512 --n 100 --out re
$P --adapter adapters/${N}_final --lengths 16 64 96 128 144 192 256 512 --n 100 --out results/ft/${N}_final_answer.jsonl >> logs/evalf_$N.log 2>&1
for X in $N ${N}_final; do $P --adapter adapters/$X --lengths 64 --n 100 --seed 99 --out results/ft/${X}_val.jsonl >> logs/evalf_$N.log 2>&1; done
n=$(cat results/ft/${N}_answer.jsonl results/ft/${N}_final_answer.jsonl results/ft/${N}_val.jsonl results/ft/${N}_final_val.jsonl 2>/dev/null | wc -l)
-[ "$n" = 2000 ] && echo done > logs/ft_$N.done || echo "incomplete $n rows" > logs/ft_$N.incomplete
+[ "$n" = 1800 ] && echo done > logs/ft_$N.done || echo "incomplete $n rows" > logs/ft_$N.incomplete