Skip to content

armgit / ruflo

Public Imported from GitHub
0

🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated

darwin: iter 6 — measurement attempt hit 10min budget on BGE embedding

ruv94c5a2d18180
diff --git a/docs/darwin/log.jsonl b/docs/darwin/log.jsonl
index 7d67c8584b..e499bacab2 100644
--- a/docs/darwin/log.jsonl
+++ b/docs/darwin/log.jsonl
@@ -4,3 +4,4 @@
{"iter":3,"ts":"2026-06-26T00:00:00.000Z","dimension":"beir-arguana","change":"dataset-specific RRF weights (arguana: dense=1.5, bm25=1.0)","rationale":"Arguana is symmetric + dense-dominated (BGE=0.636 vs BM25=0.397, 1.6× gap). Current equal RRF weighting dilutes strong dense signal with weak BM25. Per-dataset weights boost dense for this regime while preserving iter1/iter2 helpers.","deltaScore":null,"action":"proposed","commit":"1b19ebd53"}
{"iter":4,"ts":"2026-06-26T00:00:00.000Z","dimension":"beir-nfcorpus","change":"dataset-specific RRF weights (nfcorpus: dense=1.0, bm25=0.7)","rationale":"Medical IR: nfcorpus dense (BGE=0.328) vs BM25 (0.325) are nearly tied, indicating lexical matching adds noise for semantic clinical queries. Downweight BM25 contribution in RRF fusion (0.7 vs 1.0) to favor dense embeddings' semantic precision. Targets +0.01–0.02 nDCG@10 gain (19–38% closure of 0.052 gap). Extends iter 3 per-dataset weighting strategy.","deltaScore":null,"action":"proposed","commit":"64fe6ad43"}
{"iter":5,"ts":"2026-06-26T16:45:30.000Z","dimension":"adr-coverage","change":"full-bold-MADR-status-style","rationale":"Fixture test: YAML frontmatter multi-line tags, full-bold MADR **Status: Value** (entire phrase bolded), hyperlinks in narrative, 3 ADRs with 3 edges (related, supersedes). Current importer regex parsed **Status:** (colon inside first **) but failed **Status: Value** (colon+value inside, whole phrase bolded)—common in MADR specs. Added second regex path to handle this case. Result: status parsing coverage 1/3→3/3 (100% on fixture).","measured":{"storedOK":3,"edges":3,"dangling":0,"statusKnown":3,"total":3,"ratio":"1.0"},"deltaScore":0.667,"action":"proposed+proven","commit":"64d0d70f2"}
+{"iter":6,"ts":"2026-06-26T20:34:48.036Z","dimension":"beir-nfcorpus","change":"attempt-measurement","measured":null,"baselineNdcg10":0.3282,"deltaScore":null,"action":"infra-incomplete","commit":"","note":"BEIR nfcorpus dataset downloaded to /tmp/beir-nfcorpus/nfcorpus, but BGE embedding cache build exceeded 10min wall budget. Next tick should batch embedding offline or use smaller embedding model."}