Skip to content

armgit / ruflo

Public Imported from GitHub
0

🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated

darwin: iter 28 β€” arguana pure-dense rejected (-1.7%), reverted

ruv754fd2454735
diff --git a/docs/darwin/log.jsonl b/docs/darwin/log.jsonl
index 0478275222..42d8b8cb9f 100644
--- a/docs/darwin/log.jsonl
+++ b/docs/darwin/log.jsonl
@@ -26,3 +26,4 @@
{"iter":25,"ts":"2026-06-26T22:37:07.367Z","dimension":"metaharness-score","change":"crates-symlink-root","measured":{"memoryUsefulness":55,"prior":53},"deltaScore":2,"action":"measured-improved","commit":"5e9d3263a","note":"crates symlink exposes existing v3/crates Rust subcrates at root for rubric detection. memoryUsefulness 53β†’55 (+3.8% rel). Cumulative iters 22-25: 40β†’55 (+15, +37.5% rel). LEGITIMATE CEILING REACHED for ruflo on this rubric (no Python/Go code, so cant add those langs honestly). taskCoverage rubric caps at 79 due to archetype surface=7 (max in metaharness archetype lib). Next iters need different dimensions."}
{"iter":26,"ts":"2026-06-26T22:41:24.129Z","dimension":"beir-arguana","change":"arguana-weights-1.5/1.0-to-1.0/0.2","measured":null,"deltaScore":null,"action":"proposed","commit":"8dd4f77d2","note":"Arguana RRF weights updated to mirror validated nfcorpus/scifact recipe (dense=1.0, bm25=0.2). BGE cache 85% built (ETA 5.5 min). Iter 27 will measure once cache ready."}
{"iter":27,"ts":"2026-06-26T23:00:51.427Z","dimension":"beir-arguana","change":"validate-stacked-iters-1-26-on-arguana","measured":{"ndcg10":0.4386,"baseline":0.4324},"deltaScore":0.0062,"action":"measured-improved","commit":"","note":"Arguana first measurement with full stack: 0.4324 β†’ 0.4386 (+0.0062, +1.4% rel). Rank still 5/11 but now TIED with GTR-XL. Gap to SOTA 0.55: 0.118 β†’ 0.111 (6% closed). Halt counter for arguana: 0/3. NOTE: surprisingly modest gain despite weights match nfcorpus/scifact recipe β€” arguana symmetric queries may favor different ratio."}
+{"iter":28,"ts":"2026-06-26T23:11:07.116Z","dimension":"beir-arguana","change":"arguana-bm25-weight-0.2-to-0.0","measured":{"ndcg10":0.4311,"prior":0.4386},"deltaScore":-0.0075,"action":"noImprovement","commit":"","note":"Pure dense REJECTED for arguana. Unlike nfcorpus/scifact, arguana symmetric retrieval benefits from BM25 lexical signal at 0.2 weight. Reverted to dense=1.0/bm25=0.2 (champion). Latest file restored. Arguana halt: 1/3. Hypothesis: scientific lexical overlap (citations, technical terms) carries information here that pure dense embeddings miss."}