Skip to content

Find code by asking what it does. A CLI for coding agents that uses Jev to discover relevant files and source context.

Record the restored Requests checkpoint and start frozen quality confirmation

David Zhang209d3fe22490
diff --git a/specs/jevgrep/README.md b/specs/jevgrep/README.md
index f7d2702..d3cecf7 100644
--- a/specs/jevgrep/README.md
+++ b/specs/jevgrep/README.md
@@ -7,28 +7,31 @@ Jev classification through Vercel AI Gateway. This is the build plan; production
## Next Agent Prompt
You are implementing this spec. Status: **implementing**, updated **2026-09-26**.
-Next: finish the restored package's supported-runtime verification, then freeze
-one new official cohort using the existing baselines.
+Next: finish and grade the frozen `installed-jg-reference-parity-v1` cohort,
+account for every attempt, and compare its traces with the fixed baselines.
The user explicitly rejected architecture changes disguised as implementation
-cleanup. No further paid treatment should start before this parity gate passes.
+cleanup. The deterministic parity and supported-runtime gates now pass.
Selection, discovery, parser fallback, output, skill and guidance repairs are
integrated. Matched HTTP comparisons exercise the production entry point against
the frozen winner; the preservation matrix records their scope and limits.
+The exact archive passed macOS arm64 and Linux amd64/arm64 checks. Requests
+officially solved but exceeded baseline cost. The other nine cells are running
+sequentially, with no policy changes or baseline reruns.
The changed-policy cohort `installed-jg-final-cohort-v1` was stopped and marked
superseded, retaining completed outcomes and interrupted traces. It is not a
release acceptance cohort. Never rerun saved baselines or pool candidates.
Report Jev observed API costs separately from scored full Sol cost.
-Restore reference expansion, discovery inputs/order, excerpt presentation, scoped
+Keep the restored expansion, discovery inputs/order, excerpt presentation, scoped
guidance and exact accepted skill (only rename executable to `jg`). Required
Node-only runtime, auth, cache, filesystem protections and truthful failure
handling remain, but must not silently change healthy retrieval decisions.
The earlier deterministic and platform gates passed for the deviating port;
they do not prove parity. See [parity restoration](assets/parity-restoration.md) and the
[source-budget investigation](assets/source-budget-decision.md).
-After parity: frozen quality confirmation, affected runtime gates, whole-spec
-review and close-spec. See [contracts](contracts.md) for the corrected contract.
+Remaining: frozen quality confirmation, whole-spec review and close-spec.
+See [contracts](contracts.md) for the corrected contract.
No user decision blocks starting. External verification dependencies are a working
Docker daemon, explicit Gateway credentials for live tests, retained official task
@@ -45,7 +48,7 @@ not claims about the current scaffold.
- [x] [01 — Reference and real HTTP fixture](slices/01-reference.md)
- [x] [02 — Bundled parser parity](slices/02-parser.md)
- [x] [03 — Filesystem eligibility and snapshots](slices/03-filesystem.md)
-- [ ] [04 — Installed CLI + skill + first real task](slices/04-checkpoint.md)
+- [x] [04 — Installed CLI + skill + first real task](slices/04-checkpoint.md)
- [x] [05 — Faults, cancellation and partial results](slices/05-failures.md)
- [x] [06 — Default-on fresh cache](slices/06-cache.md)
- [x] [07 — Preserved output policy](slices/07-output-policy.md)
diff --git a/specs/jevgrep/assets/parity-restoration.md b/specs/jevgrep/assets/parity-restoration.md
index 6c78a3b..bab2336 100644
--- a/specs/jevgrep/assets/parity-restoration.md
+++ b/specs/jevgrep/assets/parity-restoration.md
@@ -92,8 +92,27 @@ policy. Treating the selection ceiling as permission to classify text fragments
instead was another unvalidated behavioral change; it can multiply requests and
remove the class anchor that reconsiders skipped directories.
-The superseded production platform checks do not cover the restored artifact.
-Before the next paid cohort, finish parser parity, run the installed and native
-gates on the restored package, and record its immutable archive hash. The final
-quality gate remains one frozen ten-task cohort with every baseline solve
-preserved and at least seven solved strict Sol-cost wins; Jev billing is separate.
+## Restored live confirmation
+
+The new frozen study is
+`evals/runs/swebench/installed-jg-reference-parity-v1/plan.json`. All ten no-call
+validations passed before paid execution. Requests ran first; the remaining
+cells run sequentially under the same package and prompt. Completed attempts are
+retained, never rerun by continuation.
+
+Requests officially resolved. Full Sol cost was **$0.3331174** across 11 billed
+generations versus **$0.2685004** baseline: a solve, but not a cost win. Observed
+Jev cost was **$0.01031814**, separately reported for all 63 client calls
+(245,670 input and 7,911 output tokens; 69 provider attempts). Jev is excluded
+from scored task cost.
+
+The live source blocks match the accepted spike packet exactly. The restored
+packet reports complete discovery, adds two reading leads, and returns
+`requests/api.py` where the accepted packet returned `requests/utils.py`.
+Historical live answers were not retained, and the coding agent generated its
+own query, so these live differences alone do not establish a port mismatch or
+explain the cost increase. Full traces and patch are retained for comparison.
+
+The quality gate remains every baseline solve preserved and at least seven
+solved strict Sol-cost wins in this single frozen ten-task cohort. One restored
+solve and deterministic parity do not satisfy it.
diff --git a/specs/jevgrep/slices/04-checkpoint.md b/specs/jevgrep/slices/04-checkpoint.md
index 5889320..1d07d7d 100644
--- a/specs/jevgrep/slices/04-checkpoint.md
+++ b/specs/jevgrep/slices/04-checkpoint.md
@@ -1,6 +1,7 @@
# Deliver the installed CLI and agent workflow
-Status: reopened for faithful end-to-end reference parity. Depends on: 01, 02, 03. Read [contracts](../contracts.md) first.
+Status: verified on the restored package (2026-09-26). Depends on: 01, 02, 03.
+Read [contracts](../contracts.md) first.
## Contract and owner
@@ -24,6 +25,12 @@ needed. CLI transcripts replace visual/screenshot gates for this product.
Docker fixture exercises installed auth, help, doctor, query, skill and partial output with empty stderr and isolated HOME/XDG. Pack excludes evals, secrets and workspace dependencies. Run one explicit live Jev query, then Sol through installed skill/CLI on the saved Requests task; inspect query, stdout, subsequent reads, patch, official grade and full bill. Reuse baseline; do not rerun it. One pass proves integration only, not cohort quality.
+The restored frozen cohort's Requests cell officially resolved with complete
+Sol and Jev billing. Its source blocks match the accepted spike packet; the
+live file/lead decisions differ. This verifies installed integration, not a
+cost advantage. [Restoration evidence](../assets/parity-restoration.md) owns the
+artifact identity and measured costs.
+
## Delegated decisions
Internal naming and command implementation, packaging mechanics; public contract and chosen checkpoint task are fixed.