Find code by asking what it does. A CLI for coding agents that uses Jev to discover relevant files and source context.
TypeScript ai-sdkclaude-codeclicode-searchcodexcoding-agentscontext-retrievaldeveloper-toolsjevsemantic-searchtypescriptvercel-ai-gateway
Record frozen cohort execution and remaining release gates
David Zhangd8a6764f4724
diff --git a/specs/jevgrep/README.md b/specs/jevgrep/README.mdindex 13b47c6..87fa50e 100644--- a/specs/jevgrep/README.md+++ b/specs/jevgrep/README.md@@ -7,8 +7,10 @@ Jev classification through Vercel AI Gateway. This is the build plan; production## Next Agent PromptYou are implementing this spec. Status: **implementing**, updated **2026-09-25**.-Next: freeze the final 1,500-byte package and run all ten official treatment-cells once, then grade/account/aggregate with the frozen runner. The smaller+Next: monitor the running final cohort, then grade/account/aggregate each terminal+cell using its frozen runner. The plan is+`evals/runs/swebench/installed-jg-final-cohort-v1/plan.json`; all ten offline+preflights passed, and the treatment runner executes them sequentially. The smallerRequests trial officially solved and reduced Sol cost against uncapped, but stillcost more than baseline. See [source-budget decision](assets/source-budget-decision.md)and [the uncapped trace report](assets/installed-requests-checkpoint.md).diff --git a/specs/jevgrep/slices/08-release.md b/specs/jevgrep/slices/08-release.mdindex 4d239bc..aebeb82 100644--- a/specs/jevgrep/slices/08-release.md+++ b/specs/jevgrep/slices/08-release.md@@ -1,6 +1,6 @@# Confirm quality and the release artifact-Status: planned. Depends on: 07. Read [contracts](../contracts.md) first.+Status: verifying. Depends on: 07. Read [contracts](../contracts.md) first.## Contract and owner@@ -23,7 +23,10 @@ Cut over root eval commands to official workflow. Remove deprecated personal-evaOne frozen release-candidate dossier.-`bun run verify`; `bun run eval:swebench -- --cohort accepted-ten --candidate release --reuse-baseline`; native macOS installed smoke command documented by the harness.+`bun run verify`; the maintained runner's `prepare`, `run --all`, `grade --all`,+`account --all`, and `aggregate` operations on one frozen plan, as documented in+[the runner workflow](../../../evals/implementation/swebench/installed.md); native+macOS installed smoke command documented by the harness.Commands are implementation targets. Add them in this slice; do not imply theyalready exist. CLI transcripts replace visual/screenshot gates for this product.@@ -46,3 +49,10 @@ Show the artifact and summarize deviations. This is a non-blocking review checkpcontinue on the evidence if the user does not respond. Feedback that changes thepublic contract or acceptance measure requires updating this slice before broadeningimplementation. Record new choices and update the README handoff before ending.++The final cohort plan is frozen at+`evals/runs/swebench/installed-jg-final-cohort-v1/plan.json` with the exact tarball+from the measured output trial. All ten source/runtime/skill preflights and the+no-call run validation passed. Treatment execution is underway, not acceptance.+The plan includes all ten cells prospectively; the diagnostic Requests run is+not pooled into this cohort. Saved baselines remain unchanged.