Skip to content

Solution for long term memory for agent coding CLIs and to facilitate handoff between different agent vendors

Rust

Merge release/3.3 into coding retrieval evaluation contribution

Mihael Zamin Sousae3f0a4d7111a
diff --cc CHANGELOG.md
index d90c50f4,81ab3a74..2ad2f8d0
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@@ -13,11 -13,37 +13,30 @@@ version in [`docs/changelog/`](docs/cha
### Added
-<<<<<<< HEAD
+- Added the bundled `coding-v1` retrieval-evaluation corpus for offline checks
+ of decision rationale, resolved-error causes, correction evidence, and late
+ session details. It reuses the existing scorer and A/B reports; it measures
+ evidence retrieval, not semantic answer correctness or handoff behavior (#1686).
+
+ - `[auto_improve.eval] builtin = "structure"` runs the eval gate's structural
+ checks in process, so the gate needs no interpreter, no scorer script inside
+ the container and no timeout to hit. It checks an H1, an upper-case
+ `TODO`/`TBD` placeholder (a hard failure), a `##` section and a list of steps
+ for `procedures/`, and text beyond the heading within 2,400 characters for
+ `_rules/` — never a section name or a wording, so the wiki's language does
+ not matter. `eval_results` records `checker_name = "builtin:structure"`.
+ `builtin` and `command` are mutually exclusive; `command` is unchanged for
+ project-specific scorers (#1638).
+
-- `ai-memory llm-test --server` probes the server's own configured provider
- instead of building one from the caller's environment, through a new
- root-only `POST /admin/llm-test`. The retry hint that `status` and the health
- panel print now names it: with the server in a container or on another host
- its keys exist only there, so the old client-side hint failed with "no API
- key" or a provider `400` while the server was healthy. The probe runs one
- fixed short prompt, reports provider, model, latency and the error class, and
- scrubs the provider's message before printing it (#1639).
-||||||| d39e1165
-=======
+ - `ai-memory llm-test --server` probes the server's own configured provider
+ instead of building one from the caller's environment, through a new
+ root-only `POST /admin/llm-test`. The retry hint that `status` and the health
+ panel print now names it: with the server in a container or on another host
+ its keys exist only there, so the old client-side hint failed with "no API
+ key" or a provider `400` while the server was healthy. The probe runs one
+ fixed short prompt, reports provider, model, latency and the error class, and
+ scrubs the provider's message before printing it (#1639).
+
->>>>>>> origin/release/3.3
- Added `[handoff] deliver_on_session_start = false` to `.ai-memory.toml`. A
project that sets it no longer gets its handoff, or the continuity notice, at
session start; the handoff is still created when the session ends and stays