Find code by asking what it does. A CLI for coding agents that uses Jev to discover relevant files and source context.
TypeScript ai-sdkclaude-codeclicode-searchcodexcoding-agentscontext-retrievaldeveloper-toolsjevsemantic-searchtypescriptvercel-ai-gateway
Record the restored Requests checkpoint and start frozen quality confirmation
David Zhang209d3fe22490
diff --git a/specs/jevgrep/README.md b/specs/jevgrep/README.mdindex f7d2702..d3cecf7 100644--- a/specs/jevgrep/README.md+++ b/specs/jevgrep/README.md@@ -7,28 +7,31 @@ Jev classification through Vercel AI Gateway. This is the build plan; production## Next Agent PromptYou are implementing this spec. Status: **implementing**, updated **2026-09-26**.-Next: finish the restored package's supported-runtime verification, then freeze-one new official cohort using the existing baselines.+Next: finish and grade the frozen `installed-jg-reference-parity-v1` cohort,+account for every attempt, and compare its traces with the fixed baselines.The user explicitly rejected architecture changes disguised as implementation-cleanup. No further paid treatment should start before this parity gate passes.+cleanup. The deterministic parity and supported-runtime gates now pass.Selection, discovery, parser fallback, output, skill and guidance repairs areintegrated. Matched HTTP comparisons exercise the production entry point againstthe frozen winner; the preservation matrix records their scope and limits.+The exact archive passed macOS arm64 and Linux amd64/arm64 checks. Requests+officially solved but exceeded baseline cost. The other nine cells are running+sequentially, with no policy changes or baseline reruns.The changed-policy cohort `installed-jg-final-cohort-v1` was stopped and markedsuperseded, retaining completed outcomes and interrupted traces. It is not arelease acceptance cohort. Never rerun saved baselines or pool candidates.Report Jev observed API costs separately from scored full Sol cost.-Restore reference expansion, discovery inputs/order, excerpt presentation, scoped+Keep the restored expansion, discovery inputs/order, excerpt presentation, scopedguidance and exact accepted skill (only rename executable to `jg`). RequiredNode-only runtime, auth, cache, filesystem protections and truthful failurehandling remain, but must not silently change healthy retrieval decisions.The earlier deterministic and platform gates passed for the deviating port;they do not prove parity. See [parity restoration](assets/parity-restoration.md) and the[source-budget investigation](assets/source-budget-decision.md).-After parity: frozen quality confirmation, affected runtime gates, whole-spec-review and close-spec. See [contracts](contracts.md) for the corrected contract.+Remaining: frozen quality confirmation, whole-spec review and close-spec.+See [contracts](contracts.md) for the corrected contract.No user decision blocks starting. External verification dependencies are a workingDocker daemon, explicit Gateway credentials for live tests, retained official task@@ -45,7 +48,7 @@ not claims about the current scaffold.- [x] [01 — Reference and real HTTP fixture](slices/01-reference.md)- [x] [02 — Bundled parser parity](slices/02-parser.md)- [x] [03 — Filesystem eligibility and snapshots](slices/03-filesystem.md)-- [ ] [04 — Installed CLI + skill + first real task](slices/04-checkpoint.md)+- [x] [04 — Installed CLI + skill + first real task](slices/04-checkpoint.md)- [x] [05 — Faults, cancellation and partial results](slices/05-failures.md)- [x] [06 — Default-on fresh cache](slices/06-cache.md)- [x] [07 — Preserved output policy](slices/07-output-policy.md)diff --git a/specs/jevgrep/assets/parity-restoration.md b/specs/jevgrep/assets/parity-restoration.mdindex 6c78a3b..bab2336 100644--- a/specs/jevgrep/assets/parity-restoration.md+++ b/specs/jevgrep/assets/parity-restoration.md@@ -92,8 +92,27 @@ policy. Treating the selection ceiling as permission to classify text fragmentsinstead was another unvalidated behavioral change; it can multiply requests andremove the class anchor that reconsiders skipped directories.-The superseded production platform checks do not cover the restored artifact.-Before the next paid cohort, finish parser parity, run the installed and native-gates on the restored package, and record its immutable archive hash. The final-quality gate remains one frozen ten-task cohort with every baseline solve-preserved and at least seven solved strict Sol-cost wins; Jev billing is separate.+## Restored live confirmation++The new frozen study is+`evals/runs/swebench/installed-jg-reference-parity-v1/plan.json`. All ten no-call+validations passed before paid execution. Requests ran first; the remaining+cells run sequentially under the same package and prompt. Completed attempts are+retained, never rerun by continuation.++Requests officially resolved. Full Sol cost was **$0.3331174** across 11 billed+generations versus **$0.2685004** baseline: a solve, but not a cost win. Observed+Jev cost was **$0.01031814**, separately reported for all 63 client calls+(245,670 input and 7,911 output tokens; 69 provider attempts). Jev is excluded+from scored task cost.++The live source blocks match the accepted spike packet exactly. The restored+packet reports complete discovery, adds two reading leads, and returns+`requests/api.py` where the accepted packet returned `requests/utils.py`.+Historical live answers were not retained, and the coding agent generated its+own query, so these live differences alone do not establish a port mismatch or+explain the cost increase. Full traces and patch are retained for comparison.++The quality gate remains every baseline solve preserved and at least seven+solved strict Sol-cost wins in this single frozen ten-task cohort. One restored+solve and deterministic parity do not satisfy it.diff --git a/specs/jevgrep/slices/04-checkpoint.md b/specs/jevgrep/slices/04-checkpoint.mdindex 5889320..1d07d7d 100644--- a/specs/jevgrep/slices/04-checkpoint.md+++ b/specs/jevgrep/slices/04-checkpoint.md@@ -1,6 +1,7 @@# Deliver the installed CLI and agent workflow-Status: reopened for faithful end-to-end reference parity. Depends on: 01, 02, 03. Read [contracts](../contracts.md) first.+Status: verified on the restored package (2026-09-26). Depends on: 01, 02, 03.+Read [contracts](../contracts.md) first.## Contract and owner@@ -24,6 +25,12 @@ needed. CLI transcripts replace visual/screenshot gates for this product.Docker fixture exercises installed auth, help, doctor, query, skill and partial output with empty stderr and isolated HOME/XDG. Pack excludes evals, secrets and workspace dependencies. Run one explicit live Jev query, then Sol through installed skill/CLI on the saved Requests task; inspect query, stdout, subsequent reads, patch, official grade and full bill. Reuse baseline; do not rerun it. One pass proves integration only, not cohort quality.+The restored frozen cohort's Requests cell officially resolved with complete+Sol and Jev billing. Its source blocks match the accepted spike packet; the+live file/lead decisions differ. This verifies installed integration, not a+cost advantage. [Restoration evidence](../assets/parity-restoration.md) owns the+artifact identity and measured costs.+## Delegated decisionsInternal naming and command implementation, packaging mechanics; public contract and chosen checkpoint task are fixed.