π The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated
TypeScript agentic-aiagentic-frameworkagentic-workflowagentsai-agentsai-assistantai-skillsautonomous-agentsclaudecodexdsh-pluginharnessmcp-servermulti-agentmulti-agent-systemsnpmskillsswarmswarm-intelligencetypescript
feat(intelligence): joint rerank re-grid + conditional defaults (ADR-083, 3.10.23)
ruvd3223dc3d996
diff --git a/docs/benchmarks/runs/grid-search-retrieval-2026-05-30T18-54-27-482Z.json b/docs/benchmarks/runs/grid-search-retrieval-2026-05-30T18-54-27-482Z.jsonnew file mode 100644index 0000000000..fe41801011--- /dev/null+++ b/docs/benchmarks/runs/grid-search-retrieval-2026-05-30T18-54-27-482Z.json@@ -0,0 +1,1162 @@+{+ "runAt": "2026-05-30T18:54:27.482Z",+ "benchmark": "grid-search-retrieval",+ "queries": 10,+ "configsEvaluated": 55,+ "grid": {+ "ALPHA_GRID": [+ 0.3,+ 0.5,+ 0.7+ ],+ "SUBJ_GRID": [+ 2,+ 3,+ 5+ ],+ "MMR_GRID": [+ 0.3,+ 0.5,+ 0.7+ ],+ "RERANK_GRID": [+ [+ 0.2,+ 0.8+ ],+ [+ 0.3,+ 0.7+ ],+ [+ 0.4,+ 0.6+ ],+ [+ 0.5,+ 0.5+ ],+ [+ 0.6,+ 0.4+ ],+ [+ 0.7,+ 0.3+ ],+ [+ 0.8,+ 0.2+ ]+ ]+ },+ "results": [+ {+ "name": "hybrid Ξ±=0.3 sw=2 mmr=0.3",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.3,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.9,+ "label_precision3": 0.5666666666666667,+ "label_ndcg3": 0.8919720789148187,+ "avgLatencyMs": 46.5360375+ }+ },+ {+ "name": "hybrid Ξ±=0.3 sw=2 mmr=0.5",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.5,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.9,+ "label_precision3": 0.5666666666666667,+ "label_ndcg3": 0.8919720789148187,+ "avgLatencyMs": 41.546275000000016+ }+ },+ {+ "name": "hybrid Ξ±=0.3 sw=2 mmr=0.7",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.9333333333333333,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.9419720789148187,+ "avgLatencyMs": 42.716383300000004+ }+ },+ {+ "name": "hybrid Ξ±=0.3 sw=3 mmr=0.3",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.3,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.85,+ "label_precision3": 0.5666666666666667,+ "label_ndcg3": 0.8613147192765458,+ "avgLatencyMs": 43.105075000000014+ }+ },+ {+ "name": "hybrid Ξ±=0.3 sw=3 mmr=0.5",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.5,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.8699999999999999,+ "label_precision3": 0.5666666666666667,+ "label_ndcg3": 0.8613147192765458,+ "avgLatencyMs": 40.62767080000001+ }+ },+ {+ "name": "hybrid Ξ±=0.3 sw=3 mmr=0.7",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 1,+ "label_mrr3": 0.9,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.9244076946336917,+ "avgLatencyMs": 37.55194580000002+ }+ },+ {+ "name": "hybrid Ξ±=0.3 sw=5 mmr=0.3",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.3,+ "subjectWeight": 5,+ "mmrLambda": 0.3,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.85,+ "label_precision3": 0.5666666666666667,+ "label_ndcg3": 0.8613147192765458,+ "avgLatencyMs": 40.06068749999999+ }+ },+ {+ "name": "hybrid Ξ±=0.3 sw=5 mmr=0.5",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.3,+ "subjectWeight": 5,+ "mmrLambda": 0.5,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.875,+ "label_precision3": 0.5666666666666667,+ "label_ndcg3": 0.8613147192765458,+ "avgLatencyMs": 40.78096660000001+ }+ },+ {+ "name": "hybrid Ξ±=0.3 sw=5 mmr=0.7",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.3,+ "subjectWeight": 5,+ "mmrLambda": 0.7,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 1,+ "label_mrr3": 0.9,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.9244076946336917,+ "avgLatencyMs": 39.84199590000003+ }+ },+ {+ "name": "hybrid Ξ±=0.5 sw=2 mmr=0.3",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.3,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.9,+ "label_precision3": 0.5333333333333333,+ "label_ndcg3": 0.8839441578296375,+ "avgLatencyMs": 49.049279100000014+ }+ },+ {+ "name": "hybrid Ξ±=0.5 sw=2 mmr=0.5",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.5,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.9333333333333333,+ "label_precision3": 0.5333333333333333,+ "label_ndcg3": 0.95,+ "avgLatencyMs": 44.84427500000002+ }+ },+ {+ "name": "hybrid Ξ±=0.5 sw=2 mmr=0.7",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.95,+ "label_precision3": 0.5333333333333333,+ "label_ndcg3": 0.9630929753571458,+ "avgLatencyMs": 44.555958399999966+ }+ },+ {+ "name": "hybrid Ξ±=0.5 sw=3 mmr=0.3",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.3,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.9,+ "label_precision3": 0.5333333333333333,+ "label_ndcg3": 0.8759162367444564,+ "avgLatencyMs": 41.23240419999993+ }+ },+ {+ "name": "hybrid Ξ±=0.5 sw=3 mmr=0.5",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.5,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.9333333333333333,+ "label_precision3": 0.5333333333333333,+ "label_ndcg3": 0.9419720789148187,+ "avgLatencyMs": 39.689941700000055+ }+ },+ {+ "name": "hybrid Ξ±=0.5 sw=3 mmr=0.7",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.95,+ "label_precision3": 0.5333333333333333,+ "label_ndcg3": 0.9550650542719644,+ "avgLatencyMs": 37.415162500000044+ }+ },+ {+ "name": "hybrid Ξ±=0.5 sw=5 mmr=0.3",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.5,+ "subjectWeight": 5,+ "mmrLambda": 0.3,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.85,+ "label_precision3": 0.4333333333333333,+ "label_ndcg3": 0.8630929753571458,+ "avgLatencyMs": 36.97860000000001+ }+ },+ {+ "name": "hybrid Ξ±=0.5 sw=5 mmr=0.5",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.5,+ "subjectWeight": 5,+ "mmrLambda": 0.5,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 1,+ "label_mrr3": 0.8833333333333334,+ "label_precision3": 0.5333333333333333,+ "label_ndcg3": 0.919342640361727,+ "avgLatencyMs": 37.53268329999992+ }+ },+ {+ "name": "hybrid Ξ±=0.5 sw=5 mmr=0.7",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.5,+ "subjectWeight": 5,+ "mmrLambda": 0.7,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 1,+ "label_mrr3": 0.9,+ "label_precision3": 0.5333333333333333,+ "label_ndcg3": 0.9324356157188728,+ "avgLatencyMs": 37.932275000000025+ }+ },+ {+ "name": "hybrid Ξ±=0.7 sw=2 mmr=0.3",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.7,+ "subjectWeight": 2,+ "mmrLambda": 0.3,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.5,+ "label_top3HitRate": 0.6,+ "label_mrr3": 0.6,+ "label_precision3": 0.3,+ "label_ndcg3": 0.5550650542719645,+ "avgLatencyMs": 40.52321250000004+ }+ },+ {+ "name": "hybrid Ξ±=0.7 sw=2 mmr=0.5",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.7,+ "subjectWeight": 2,+ "mmrLambda": 0.5,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.5,+ "label_top3HitRate": 0.6,+ "label_mrr3": 0.62,+ "label_precision3": 0.3,+ "label_ndcg3": 0.5550650542719645,+ "avgLatencyMs": 39.80015829999993+ }+ },+ {+ "name": "hybrid Ξ±=0.7 sw=2 mmr=0.7",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.7,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.5,+ "label_top3HitRate": 0.6,+ "label_mrr3": 0.615,+ "label_precision3": 0.3,+ "label_ndcg3": 0.5550650542719645,+ "avgLatencyMs": 38.89919590000009+ }+ },+ {+ "name": "hybrid Ξ±=0.7 sw=3 mmr=0.3",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.7,+ "subjectWeight": 3,+ "mmrLambda": 0.3,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.4,+ "label_top3HitRate": 0.6,+ "label_mrr3": 0.55,+ "label_precision3": 0.26666666666666666,+ "label_ndcg3": 0.5261859507142915,+ "avgLatencyMs": 37.38098339999997+ }+ },+ {+ "name": "hybrid Ξ±=0.7 sw=3 mmr=0.5",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.7,+ "subjectWeight": 3,+ "mmrLambda": 0.5,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.4,+ "label_top3HitRate": 0.6,+ "label_mrr3": 0.5700000000000001,+ "label_precision3": 0.26666666666666666,+ "label_ndcg3": 0.5261859507142915,+ "avgLatencyMs": 40.424562500000135+ }+ },+ {+ "name": "hybrid Ξ±=0.7 sw=3 mmr=0.7",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.7,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.4,+ "label_top3HitRate": 0.6,+ "label_mrr3": 0.5650000000000001,+ "label_precision3": 0.26666666666666666,+ "label_ndcg3": 0.5261859507142915,+ "avgLatencyMs": 39.245041599999965+ }+ },+ {+ "name": "hybrid Ξ±=0.7 sw=5 mmr=0.3",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.7,+ "subjectWeight": 5,+ "mmrLambda": 0.3,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.4,+ "label_top3HitRate": 0.6,+ "label_mrr3": 0.55,+ "label_precision3": 0.26666666666666666,+ "label_ndcg3": 0.5261859507142915,+ "avgLatencyMs": 37.59598330000008+ }+ },+ {+ "name": "hybrid Ξ±=0.7 sw=5 mmr=0.5",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.7,+ "subjectWeight": 5,+ "mmrLambda": 0.5,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.4,+ "label_top3HitRate": 0.6,+ "label_mrr3": 0.5700000000000001,+ "label_precision3": 0.26666666666666666,+ "label_ndcg3": 0.5261859507142915,+ "avgLatencyMs": 39.11966250000005+ }+ },+ {+ "name": "hybrid Ξ±=0.7 sw=5 mmr=0.7",+ "rerank": false,+ "params": {+ "rerank": false,+ "alpha": 0.7,+ "subjectWeight": 5,+ "mmrLambda": 0.7,+ "bodyWeight": 1,+ "typePenaltyFactor": 1+ },+ "metrics": {+ "label_top1HitRate": 0.4,+ "label_top3HitRate": 0.6,+ "label_mrr3": 0.5650000000000001,+ "label_precision3": 0.26666666666666666,+ "label_ndcg3": 0.5261859507142915,+ "avgLatencyMs": 38.87682080000013+ }+ },+ {+ "name": "rerank hw=0.2 cw=0.8 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.2,+ "ceWeight": 0.8+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7666666666666667,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 933.7481166+ }+ },+ {+ "name": "rerank hw=0.2 cw=0.8 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.2,+ "ceWeight": 0.8+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7666666666666667,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 879.4089292000001+ }+ },+ {+ "name": "rerank hw=0.2 cw=0.8 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.2,+ "ceWeight": 0.8+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 897.2303916999997+ }+ },+ {+ "name": "rerank hw=0.2 cw=0.8 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.2,+ "ceWeight": 0.8+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.875,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.8630929753571458,+ "avgLatencyMs": 861.4125707999999+ }+ },+ {+ "name": "rerank hw=0.3 cw=0.7 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.3,+ "ceWeight": 0.7+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7666666666666667,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 879.6433875000002+ }+ },+ {+ "name": "rerank hw=0.3 cw=0.7 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.3,+ "ceWeight": 0.7+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7666666666666667,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 902.5864875+ }+ },+ {+ "name": "rerank hw=0.3 cw=0.7 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.3,+ "ceWeight": 0.7+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 876.1186999999998+ }+ },+ {+ "name": "rerank hw=0.3 cw=0.7 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.3,+ "ceWeight": 0.7+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.875,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.8630929753571458,+ "avgLatencyMs": 849.2545624999999+ }+ },+ {+ "name": "rerank hw=0.4 cw=0.6 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.4,+ "ceWeight": 0.6+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 888.1055582999994+ }+ },+ {+ "name": "rerank hw=0.4 cw=0.6 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.4,+ "ceWeight": 0.6+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.8,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 911.6689583+ }+ },+ {+ "name": "rerank hw=0.4 cw=0.6 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.4,+ "ceWeight": 0.6+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 896.537950000001+ }+ },+ {+ "name": "rerank hw=0.4 cw=0.6 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.4,+ "ceWeight": 0.6+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.875,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.8630929753571458,+ "avgLatencyMs": 832.0959624999989+ }+ },+ {+ "name": "rerank hw=0.5 cw=0.5 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.5,+ "ceWeight": 0.5+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 889.6455958999999+ }+ },+ {+ "name": "rerank hw=0.5 cw=0.5 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.5,+ "ceWeight": 0.5+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.8,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 886.2357917000002+ }+ },+ {+ "name": "rerank hw=0.5 cw=0.5 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.5,+ "ceWeight": 0.5+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 881.0955125000007+ }+ },+ {+ "name": "rerank hw=0.5 cw=0.5 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.5,+ "ceWeight": 0.5+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.875,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.8630929753571458,+ "avgLatencyMs": 848.3681125000003+ }+ },+ {+ "name": "rerank hw=0.6 cw=0.4 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.6,+ "ceWeight": 0.4+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 907.0746207999997+ }+ },+ {+ "name": "rerank hw=0.6 cw=0.4 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.6,+ "ceWeight": 0.4+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 891.8464374999982+ }+ },+ {+ "name": "rerank hw=0.6 cw=0.4 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.6,+ "ceWeight": 0.4+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 880.5650875000022+ }+ },+ {+ "name": "rerank hw=0.6 cw=0.4 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.6,+ "ceWeight": 0.4+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 856.0589041+ }+ },+ {+ "name": "rerank hw=0.7 cw=0.3 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.7,+ "ceWeight": 0.3+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 882.3316709000006+ }+ },+ {+ "name": "rerank hw=0.7 cw=0.3 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.7,+ "ceWeight": 0.3+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 896.2746833000012+ }+ },+ {+ "name": "rerank hw=0.7 cw=0.3 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.7,+ "ceWeight": 0.3+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.6333333333333332,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 891.5837584000022+ }+ },+ {+ "name": "rerank hw=0.7 cw=0.3 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.7,+ "ceWeight": 0.3+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.95,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9630929753571458,+ "avgLatencyMs": 836.2012083000009+ }+ },+ {+ "name": "rerank hw=0.8 cw=0.2 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.8,+ "ceWeight": 0.2+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 898.0529125+ }+ },+ {+ "name": "rerank hw=0.8 cw=0.2 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.8,+ "ceWeight": 0.2+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.95,+ "label_precision3": 0.7666666666666666,+ "label_ndcg3": 0.9630929753571458,+ "avgLatencyMs": 885.745087500001+ }+ },+ {+ "name": "rerank hw=0.8 cw=0.2 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.8,+ "ceWeight": 0.2+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 886.3895041000011+ }+ },+ {+ "name": "rerank hw=0.8 cw=0.2 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.8,+ "ceWeight": 0.2+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.95,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9550650542719644,+ "avgLatencyMs": 859.4657124999998+ }+ }+ ],+ "winners": {+ "nDcg3": "hybrid Ξ±=0.5 sw=2 mmr=0.7",+ "top1": "hybrid Ξ±=0.5 sw=2 mmr=0.7",+ "precision3": "rerank hw=0.4 cw=0.6 Ξ±=0.3 sw=3",+ "bestNonRerank": "hybrid Ξ±=0.5 sw=2 mmr=0.7",+ "bestRerank": "rerank hw=0.7 cw=0.3 Ξ±=0.5 sw=3"+ }+}\ No newline at end of filediff --git a/docs/benchmarks/runs/grid-search-retrieval-latest.json b/docs/benchmarks/runs/grid-search-retrieval-latest.jsonindex 1159f90845..fe41801011 100644--- a/docs/benchmarks/runs/grid-search-retrieval-latest.json+++ b/docs/benchmarks/runs/grid-search-retrieval-latest.json@@ -1,8 +1,8 @@{- "runAt": "2026-05-30T18:41:02.970Z",+ "runAt": "2026-05-30T18:54:27.482Z","benchmark": "grid-search-retrieval","queries": 10,- "configsEvaluated": 32,+ "configsEvaluated": 55,"grid": {"ALPHA_GRID": [0.3,@@ -20,6 +20,10 @@0.7],"RERANK_GRID": [+ [+ 0.2,+ 0.8+ ],[0.3,0.7@@ -39,6 +43,10 @@[0.7,0.3+ ],+ [+ 0.8,+ 0.2]]},@@ -60,7 +68,7 @@"label_mrr3": 0.9,"label_precision3": 0.5666666666666667,"label_ndcg3": 0.8919720789148187,- "avgLatencyMs": 44.8147042+ "avgLatencyMs": 46.5360375}},{@@ -80,7 +88,7 @@"label_mrr3": 0.9,"label_precision3": 0.5666666666666667,"label_ndcg3": 0.8919720789148187,- "avgLatencyMs": 42.7988292+ "avgLatencyMs": 41.546275000000016}},{@@ -100,7 +108,7 @@"label_mrr3": 0.9333333333333333,"label_precision3": 0.6666666666666666,"label_ndcg3": 0.9419720789148187,- "avgLatencyMs": 39.512345800000006+ "avgLatencyMs": 42.716383300000004}},{@@ -120,7 +128,7 @@"label_mrr3": 0.85,"label_precision3": 0.5666666666666667,"label_ndcg3": 0.8613147192765458,- "avgLatencyMs": 34.2177917+ "avgLatencyMs": 43.105075000000014}},{@@ -140,7 +148,7 @@"label_mrr3": 0.8699999999999999,"label_precision3": 0.5666666666666667,"label_ndcg3": 0.8613147192765458,- "avgLatencyMs": 38.97439999999999+ "avgLatencyMs": 40.62767080000001}},{@@ -160,7 +168,7 @@"label_mrr3": 0.9,"label_precision3": 0.6666666666666666,"label_ndcg3": 0.9244076946336917,- "avgLatencyMs": 36.701479199999994+ "avgLatencyMs": 37.55194580000002}},{@@ -180,7 +188,7 @@"label_mrr3": 0.85,"label_precision3": 0.5666666666666667,"label_ndcg3": 0.8613147192765458,- "avgLatencyMs": 35.63641659999998+ "avgLatencyMs": 40.06068749999999}},{@@ -200,7 +208,7 @@"label_mrr3": 0.875,"label_precision3": 0.5666666666666667,"label_ndcg3": 0.8613147192765458,- "avgLatencyMs": 37.19082919999996+ "avgLatencyMs": 40.78096660000001}},{@@ -220,7 +228,7 @@"label_mrr3": 0.9,"label_precision3": 0.6666666666666666,"label_ndcg3": 0.9244076946336917,- "avgLatencyMs": 39.034287499999984+ "avgLatencyMs": 39.84199590000003}},{@@ -240,7 +248,7 @@"label_mrr3": 0.9,"label_precision3": 0.5333333333333333,"label_ndcg3": 0.8839441578296375,- "avgLatencyMs": 39.86475829999999+ "avgLatencyMs": 49.049279100000014}},{@@ -260,7 +268,7 @@"label_mrr3": 0.9333333333333333,"label_precision3": 0.5333333333333333,"label_ndcg3": 0.95,- "avgLatencyMs": 38.87682920000002+ "avgLatencyMs": 44.84427500000002}},{@@ -280,7 +288,7 @@"label_mrr3": 0.95,"label_precision3": 0.5333333333333333,"label_ndcg3": 0.9630929753571458,- "avgLatencyMs": 41.63309580000005+ "avgLatencyMs": 44.555958399999966}},{@@ -300,7 +308,7 @@"label_mrr3": 0.9,"label_precision3": 0.5333333333333333,"label_ndcg3": 0.8759162367444564,- "avgLatencyMs": 39.85475420000002+ "avgLatencyMs": 41.23240419999993}},{@@ -320,7 +328,7 @@"label_mrr3": 0.9333333333333333,"label_precision3": 0.5333333333333333,"label_ndcg3": 0.9419720789148187,- "avgLatencyMs": 37.078512499999945+ "avgLatencyMs": 39.689941700000055}},{@@ -340,7 +348,7 @@"label_mrr3": 0.95,"label_precision3": 0.5333333333333333,"label_ndcg3": 0.9550650542719644,- "avgLatencyMs": 37.612912500000036+ "avgLatencyMs": 37.415162500000044}},{@@ -360,7 +368,7 @@"label_mrr3": 0.85,"label_precision3": 0.4333333333333333,"label_ndcg3": 0.8630929753571458,- "avgLatencyMs": 40.55730409999997+ "avgLatencyMs": 36.97860000000001}},{@@ -380,7 +388,7 @@"label_mrr3": 0.8833333333333334,"label_precision3": 0.5333333333333333,"label_ndcg3": 0.919342640361727,- "avgLatencyMs": 39.953062499999945+ "avgLatencyMs": 37.53268329999992}},{@@ -400,7 +408,7 @@"label_mrr3": 0.9,"label_precision3": 0.5333333333333333,"label_ndcg3": 0.9324356157188728,- "avgLatencyMs": 39.32278340000003+ "avgLatencyMs": 37.932275000000025}},{@@ -418,9 +426,9 @@"label_top1HitRate": 0.5,"label_top3HitRate": 0.6,"label_mrr3": 0.6,- "label_precision3": 0.26666666666666666,- "label_ndcg3": 0.5630929753571458,- "avgLatencyMs": 43.69035830000003+ "label_precision3": 0.3,+ "label_ndcg3": 0.5550650542719645,+ "avgLatencyMs": 40.52321250000004}},{@@ -438,9 +446,9 @@"label_top1HitRate": 0.5,"label_top3HitRate": 0.6,"label_mrr3": 0.62,- "label_precision3": 0.26666666666666666,- "label_ndcg3": 0.5630929753571458,- "avgLatencyMs": 41.72429999999995+ "label_precision3": 0.3,+ "label_ndcg3": 0.5550650542719645,+ "avgLatencyMs": 39.80015829999993}},{@@ -458,9 +466,9 @@"label_top1HitRate": 0.5,"label_top3HitRate": 0.6,"label_mrr3": 0.615,- "label_precision3": 0.26666666666666666,- "label_ndcg3": 0.5630929753571458,- "avgLatencyMs": 72.73329170000007+ "label_precision3": 0.3,+ "label_ndcg3": 0.5550650542719645,+ "avgLatencyMs": 38.89919590000009}},{@@ -480,7 +488,7 @@"label_mrr3": 0.55,"label_precision3": 0.26666666666666666,"label_ndcg3": 0.5261859507142915,- "avgLatencyMs": 49.70607920000002+ "avgLatencyMs": 37.38098339999997}},{@@ -500,7 +508,7 @@"label_mrr3": 0.5700000000000001,"label_precision3": 0.26666666666666666,"label_ndcg3": 0.5261859507142915,- "avgLatencyMs": 45.67079170000015+ "avgLatencyMs": 40.424562500000135}},{@@ -520,7 +528,7 @@"label_mrr3": 0.5650000000000001,"label_precision3": 0.26666666666666666,"label_ndcg3": 0.5261859507142915,- "avgLatencyMs": 44.217941599999904+ "avgLatencyMs": 39.245041599999965}},{@@ -540,7 +548,7 @@"label_mrr3": 0.55,"label_precision3": 0.26666666666666666,"label_ndcg3": 0.5261859507142915,- "avgLatencyMs": 44.227116600000045+ "avgLatencyMs": 37.59598330000008}},{@@ -560,7 +568,7 @@"label_mrr3": 0.5700000000000001,"label_precision3": 0.26666666666666666,"label_ndcg3": 0.5261859507142915,- "avgLatencyMs": 51.73877920000014+ "avgLatencyMs": 39.11966250000005}},{@@ -580,92 +588,477 @@"label_mrr3": 0.5650000000000001,"label_precision3": 0.26666666666666666,"label_ndcg3": 0.5261859507142915,- "avgLatencyMs": 55.52428749999999+ "avgLatencyMs": 38.87682080000013+ }+ },+ {+ "name": "rerank hw=0.2 cw=0.8 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.2,+ "ceWeight": 0.8+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7666666666666667,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 933.7481166+ }+ },+ {+ "name": "rerank hw=0.2 cw=0.8 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.2,+ "ceWeight": 0.8+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7666666666666667,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 879.4089292000001+ }+ },+ {+ "name": "rerank hw=0.2 cw=0.8 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.2,+ "ceWeight": 0.8+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 897.2303916999997+ }+ },+ {+ "name": "rerank hw=0.2 cw=0.8 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.2,+ "ceWeight": 0.8+ },+ "metrics": {+ "label_top1HitRate": 0.8,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.875,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.8630929753571458,+ "avgLatencyMs": 861.4125707999999+ }+ },+ {+ "name": "rerank hw=0.3 cw=0.7 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.3,+ "ceWeight": 0.7+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7666666666666667,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 879.6433875000002+ }+ },+ {+ "name": "rerank hw=0.3 cw=0.7 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.3,+ "ceWeight": 0.7+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7666666666666667,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 902.5864875+ }+ },+ {+ "name": "rerank hw=0.3 cw=0.7 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.3,+ "ceWeight": 0.7+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 876.1186999999998}},{- "name": "rerank hw=0.3 cw=0.7",+ "name": "rerank hw=0.3 cw=0.7 Ξ±=0.5 sw=3","rerank": true,"params": {"rerank": true,- "alpha": 0.6,+ "alpha": 0.5,"subjectWeight": 3,+ "mmrLambda": 0.7,"hybridWeight": 0.3,"ceWeight": 0.7},"metrics": {"label_top1HitRate": 0.8,- "label_top3HitRate": 1,- "label_mrr3": 0.8833333333333334,- "label_precision3": 0.6666666666666665,- "label_ndcg3": 0.9130929753571457,- "avgLatencyMs": 955.0884791000001+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.875,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.8630929753571458,+ "avgLatencyMs": 849.2545624999999+ }+ },+ {+ "name": "rerank hw=0.4 cw=0.6 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.4,+ "ceWeight": 0.6+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 888.1055582999994+ }+ },+ {+ "name": "rerank hw=0.4 cw=0.6 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.4,+ "ceWeight": 0.6+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.8,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 911.6689583+ }+ },+ {+ "name": "rerank hw=0.4 cw=0.6 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.4,+ "ceWeight": 0.6+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 896.537950000001}},{- "name": "rerank hw=0.4 cw=0.6",+ "name": "rerank hw=0.4 cw=0.6 Ξ±=0.5 sw=3","rerank": true,"params": {"rerank": true,- "alpha": 0.6,+ "alpha": 0.5,"subjectWeight": 3,+ "mmrLambda": 0.7,"hybridWeight": 0.4,"ceWeight": 0.6},"metrics": {"label_top1HitRate": 0.8,- "label_top3HitRate": 1,- "label_mrr3": 0.8833333333333334,- "label_precision3": 0.6666666666666665,- "label_ndcg3": 0.9130929753571457,- "avgLatencyMs": 840.5522042+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.875,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.8630929753571458,+ "avgLatencyMs": 832.0959624999989+ }+ },+ {+ "name": "rerank hw=0.5 cw=0.5 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.5,+ "ceWeight": 0.5+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 889.6455958999999+ }+ },+ {+ "name": "rerank hw=0.5 cw=0.5 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.5,+ "ceWeight": 0.5+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.8,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 886.2357917000002+ }+ },+ {+ "name": "rerank hw=0.5 cw=0.5 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.5,+ "ceWeight": 0.5+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 881.0955125000007}},{- "name": "rerank hw=0.5 cw=0.5",+ "name": "rerank hw=0.5 cw=0.5 Ξ±=0.5 sw=3","rerank": true,"params": {"rerank": true,- "alpha": 0.6,+ "alpha": 0.5,"subjectWeight": 3,+ "mmrLambda": 0.7,"hybridWeight": 0.5,"ceWeight": 0.5},"metrics": {"label_top1HitRate": 0.8,- "label_top3HitRate": 1,- "label_mrr3": 0.8833333333333334,- "label_precision3": 0.6666666666666665,- "label_ndcg3": 0.9130929753571457,- "avgLatencyMs": 851.7643958000001+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.875,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.8630929753571458,+ "avgLatencyMs": 848.3681125000003+ }+ },+ {+ "name": "rerank hw=0.6 cw=0.4 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.6,+ "ceWeight": 0.4+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 907.0746207999997}},{- "name": "rerank hw=0.6 cw=0.4",+ "name": "rerank hw=0.6 cw=0.4 Ξ±=0.3 sw=3","rerank": true,"params": {"rerank": true,- "alpha": 0.6,+ "alpha": 0.3,"subjectWeight": 3,+ "mmrLambda": 0.7,"hybridWeight": 0.6,"ceWeight": 0.4},"metrics": {"label_top1HitRate": 0.9,- "label_top3HitRate": 1,- "label_mrr3": 0.9333333333333333,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 891.8464374999982+ }+ },+ {+ "name": "rerank hw=0.6 cw=0.4 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.6,+ "ceWeight": 0.4+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,"label_precision3": 0.7,- "label_ndcg3": 0.95,- "avgLatencyMs": 861.9551584000001+ "label_ndcg3": 0.9,+ "avgLatencyMs": 880.5650875000022+ }+ },+ {+ "name": "rerank hw=0.6 cw=0.4 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.6,+ "ceWeight": 0.4+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 856.0589041+ }+ },+ {+ "name": "rerank hw=0.7 cw=0.3 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.7,+ "ceWeight": 0.3+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7333333333333333,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 882.3316709000006+ }+ },+ {+ "name": "rerank hw=0.7 cw=0.3 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.7,+ "ceWeight": 0.3+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 896.2746833000012+ }+ },+ {+ "name": "rerank hw=0.7 cw=0.3 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.7,+ "ceWeight": 0.3+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.6333333333333332,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 891.5837584000022}},{- "name": "rerank hw=0.7 cw=0.3",+ "name": "rerank hw=0.7 cw=0.3 Ξ±=0.5 sw=3","rerank": true,"params": {"rerank": true,- "alpha": 0.6,+ "alpha": 0.5,"subjectWeight": 3,+ "mmrLambda": 0.7,"hybridWeight": 0.7,"ceWeight": 0.3},@@ -673,17 +1066,97 @@"label_top1HitRate": 0.9,"label_top3HitRate": 1,"label_mrr3": 0.95,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9630929753571458,+ "avgLatencyMs": 836.2012083000009+ }+ },+ {+ "name": "rerank hw=0.8 cw=0.2 Ξ±=0.3 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.8,+ "ceWeight": 0.2+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,"label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 898.0529125+ }+ },+ {+ "name": "rerank hw=0.8 cw=0.2 Ξ±=0.3 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.3,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.8,+ "ceWeight": 0.2+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.95,+ "label_precision3": 0.7666666666666666,"label_ndcg3": 0.9630929753571458,- "avgLatencyMs": 857.9553665999999+ "avgLatencyMs": 885.745087500001+ }+ },+ {+ "name": "rerank hw=0.8 cw=0.2 Ξ±=0.5 sw=2",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 2,+ "mmrLambda": 0.7,+ "hybridWeight": 0.8,+ "ceWeight": 0.2+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 0.9,+ "label_mrr3": 0.925,+ "label_precision3": 0.6666666666666666,+ "label_ndcg3": 0.9,+ "avgLatencyMs": 886.3895041000011+ }+ },+ {+ "name": "rerank hw=0.8 cw=0.2 Ξ±=0.5 sw=3",+ "rerank": true,+ "params": {+ "rerank": true,+ "alpha": 0.5,+ "subjectWeight": 3,+ "mmrLambda": 0.7,+ "hybridWeight": 0.8,+ "ceWeight": 0.2+ },+ "metrics": {+ "label_top1HitRate": 0.9,+ "label_top3HitRate": 1,+ "label_mrr3": 0.95,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9550650542719644,+ "avgLatencyMs": 859.4657124999998}}],"winners": {"nDcg3": "hybrid Ξ±=0.5 sw=2 mmr=0.7","top1": "hybrid Ξ±=0.5 sw=2 mmr=0.7",- "precision3": "rerank hw=0.6 cw=0.4",+ "precision3": "rerank hw=0.4 cw=0.6 Ξ±=0.3 sw=3","bestNonRerank": "hybrid Ξ±=0.5 sw=2 mmr=0.7",- "bestRerank": "rerank hw=0.7 cw=0.3"+ "bestRerank": "rerank hw=0.7 cw=0.3 Ξ±=0.5 sw=3"}}\ No newline at end of filediff --git a/docs/benchmarks/runs/pretrained-retrieval-latest.json b/docs/benchmarks/runs/pretrained-retrieval-latest.jsonindex 6b7dd2df3f..9247fdb8b7 100644--- a/docs/benchmarks/runs/pretrained-retrieval-latest.json+++ b/docs/benchmarks/runs/pretrained-retrieval-latest.json@@ -1,25 +1,25 @@{- "runAt": "2026-05-30T18:34:35.341Z",+ "runAt": "2026-05-30T18:58:53.670Z","benchmark": "pretrained-retrieval","mode": "hybrid",- "rerank": false,- "storeSize": 415,+ "rerank": true,+ "storeSize": 420,"queries": 10,"matchedQueries": 10,"matchRate": 1,- "top1HitRate": 0.8,- "top3HitRate": 0.8,- "mrr3": 0.8,+ "top1HitRate": 0.9,+ "top3HitRate": 1,+ "mrr3": 0.9333,"label_top1HitRate": 0.9,- "label_top3HitRate": 0.9,- "label_mrr3": 0.9,- "label_precision3": 0.4,- "label_ndcg3": 0.9,- "label_ndcg5": 0.8754,+ "label_top3HitRate": 1,+ "label_mrr3": 0.95,+ "label_precision3": 0.7,+ "label_ndcg3": 0.9631,+ "label_ndcg5": 0.944,"top1Diversity": 1,"top3DupRate": 0,- "avgQueryLatencyMs": 44.21,- "totalQueryMs": 442.14,+ "avgQueryLatencyMs": 949.49,+ "totalQueryMs": 9494.92,"results": [{"query": "how was the Opus model alias fixed",@@ -29,60 +29,55 @@"firstRelevantRank": 1,"label_top1": true,"label_top3_count": 1,- "label_top5_count": 1,+ "label_top5_count": 3,"label_firstRank": 1,"label_ndcg3": 1,- "label_ndcg5": 1,+ "label_ndcg5": 0.8529278650606567,"topK": [{"id": "pattern-1780161237213-1o-860k","name": "Is Ruflo safe on Claude Opus 4.8? β `opus` alias still pins to 4.7, and literal model ids silently d","type": "history-issue",- "score": 0.6843424344550606,+ "score": 0.7369520287125506,"cosineScore": 0.003778643529534665,- "bm25Score": 52.76321520250582,- "mmrScore": 0.3421712172275303,+ "bm25Score": 52.763722719504834,"labelRelevant": true},{"id": "pattern-1780161237205-9-48p8","name": "chore(release): bump 3.10.10 β 3.10.11 (4-issue bug cluster)","type": "history-commit",- "score": 0.6578149623349934,+ "score": 0.5972130700187058,"cosineScore": 0.11877348981913242,- "bm25Score": 15.501117386223756,- "mmrScore": 0.3289074811674967,+ "bm25Score": 15.508603531446157,"labelRelevant": false},{- "id": "pattern-1780161324702-4r-00fd",- "name": "feat(graph-intelligence): #2044 ADR-123 Phase 1 β ruflo-graph-intelligence plugin foundation",+ "id": "pattern-1780161324680-9-5bpv",+ "name": "chore(release): bump 3.10.10 β 3.10.11 (4-issue bug cluster)","type": "history-commit",- "score": 0.6,- "cosineScore": 0.14559488017897365,- "bm25Score": 0,- "mmrScore": 0.2867919386912716,+ "score": 0.5972130700187058,+ "cosineScore": 0.11877348981913242,+ "bm25Score": 15.508603531446157,"labelRelevant": false},{- "id": "pattern-1780161324689-23-qwbk",- "name": "fix(mcp): #2042 β agent_execute routes through v3 provider system (Anthropic / OpenRouter / Ollama)",- "type": "history-commit",- "score": 0.5439616478876625,- "cosineScore": 0.1117424282926092,- "bm25Score": 2.5472956544008363,- "mmrScore": 0.2622929277255326,- "labelRelevant": false+ "id": "pattern-1780159888525-1o-qiri",+ "name": "Is Ruflo safe on Claude Opus 4.8? β `opus` alias still pins to 4.7, and literal model ids silently d",+ "type": "history-issue",+ "score": 0.5699954884514554,+ "cosineScore": 0.003778643529534665,+ "bm25Score": 35.1452255264163,+ "labelRelevant": true},{- "id": "pattern-1780159888525-1n-2zyq",- "name": "MCP servers orphan on every Claude Code restart β ~1 GB leaked, and a stale server silently serves t",- "type": "history-issue",- "score": 0.5171795037781899,- "cosineScore": 0.10838591586557422,- "bm25Score": 0,- "mmrScore": 0.24626469580600896,- "labelRelevant": false+ "id": "pattern-1780161237206-a-bqc4",+ "name": "fix(intelligence): 4-issue bug cluster β Opus 4.8 + uptime + MCP orphan + Q-encoder",+ "type": "history-commit",+ "score": 0.4411337481482297,+ "cosineScore": 0.0020688282745718813,+ "bm25Score": 21.88145052006411,+ "labelRelevant": true}]},@@ -94,60 +89,55 @@"firstRelevantRank": 1,"label_top1": true,"label_top3_count": 3,- "label_top5_count": 3,+ "label_top5_count": 5,"label_firstRank": 1,"label_ndcg3": 1,"label_ndcg5": 1,"topK": [- {- "id": "pattern-1780161237204-4-geaj",- "name": "chore(release): bump 3.10.13 β 3.10.14 (ADR-074 self-learning wiring)",- "type": "history-commit",- "score": 0.7864771736262862,- "cosineScore": 0.09545006956277129,- "bm25Score": 29.42370040505412,- "mmrScore": 0.3932385868131431,- "labelRelevant": true- },{"id": "pattern-1780161237211-1e-nvg1","name": "Self-learning reports success but persists nothing (3.10.6): signalsProcessed dead, task-completed s","type": "history-issue",- "score": 0.7749415691985588,+ "score": 0.8124513076654658,"cosineScore": 0.04246140228195686,- "bm25Score": 38.68126443295369,- "mmrScore": 0.3874707845992794,+ "bm25Score": 38.538168325210684,"labelRelevant": true},{"id": "pattern-1780161237204-3-zs1a","name": "Merge fix/self-learning-2245: ADR-074 self-learning wiring (closes #2245)","type": "history-commit",- "score": 0.6780524894077538,+ "score": 0.7032364262410042,"cosineScore": 0.028229282902256594,- "bm25Score": 32.0978724097225,- "mmrScore": 0.3390262447038769,+ "bm25Score": 31.97080636401089,"labelRelevant": true},{- "id": "pattern-1780161324693-2x-cca3",- "name": "security(neural-trader): #50 β supply-chain audit + AIDefence wiring sketch",+ "id": "pattern-1780161324679-3-tozb",+ "name": "Merge fix/self-learning-2245: ADR-074 self-learning wiring (closes #2245)","type": "history-commit",- "score": 0.5908917909203921,- "cosineScore": 0.07021253430926652,- "bm25Score": 15.450490746772179,- "mmrScore": 0.29456614542115495,- "labelRelevant": false+ "score": 0.7032364262410042,+ "cosineScore": 0.028229282902256594,+ "bm25Score": 31.97080636401089,+ "labelRelevant": true},{- "id": "pattern-1780161324689-25-5hh2",- "name": "chore(release): publish 3.7.0-alpha.77 β #2098 #2093 #2085 fixes",- "type": "history-commit",- "score": 0.6,- "cosineScore": 0.15363730484346572,- "bm25Score": 0,- "mmrScore": 0.2772010768289724,- "labelRelevant": false+ "id": "pattern-1780158992310-a-1p27",+ "name": "Self-learning reports success but persists nothing (3.10.6): signalsProcessed dead, task-completed s",+ "type": "history-issue",+ "score": 0.6871595077555956,+ "cosineScore": 0.04246140228195686,+ "bm25Score": 28.881135375820307,+ "labelRelevant": true+ },+ {+ "id": "pattern-1780159888524-1e-ahj2",+ "name": "Self-learning reports success but persists nothing (3.10.6): signalsProcessed dead, task-completed s",+ "type": "history-issue",+ "score": 0.6871595077555956,+ "cosineScore": 0.04246140228195686,+ "bm25Score": 28.881135375820307,+ "labelRelevant": true}]},@@ -158,61 +148,56 @@"top3Relevant": true,"firstRelevantRank": 1,"label_top1": true,- "label_top3_count": 1,- "label_top5_count": 2,+ "label_top3_count": 2,+ "label_top5_count": 4,"label_firstRank": 1,"label_ndcg3": 1,- "label_ndcg5": 0.8772153153380493,+ "label_ndcg5": 0.9558295932317544,"topK": [{"id": "pattern-1780161237206-c-jffq","name": "Merge feat/deterministic-tier1-codemods: deterministic Tier-1 codemods (ADR-143)","type": "history-commit",- "score": 0.7829514826080268,+ "score": 0.802982004368638,"cosineScore": 0.040446535166730725,- "bm25Score": 21.174765268633912,- "mmrScore": 0.3914757413040134,+ "bm25Score": 21.195273445814774,"labelRelevant": true},{- "id": "pattern-1780161324702-4s-bo8j",- "name": "adr: ADR-123 β reframe as Graph Intelligence Engine with complexity-aware execution",+ "id": "pattern-1780161324680-c-rcpm",+ "name": "Merge feat/deterministic-tier1-codemods: deterministic Tier-1 codemods (ADR-143)","type": "history-commit",- "score": 0.7548952095098957,- "cosineScore": 0.010547052616670351,- "bm25Score": 23.515571760429694,- "mmrScore": 0.3774476047549479,- "labelRelevant": false+ "score": 0.802982004368638,+ "cosineScore": 0.040446535166730725,+ "bm25Score": 21.195273445814774,+ "labelRelevant": true},{- "id": "pattern-1780161237208-t-032i",- "name": "feat(gaia): #2156 iter 62 β convergence layer (deterministic finalization)",+ "id": "pattern-1780161324702-4s-bo8j",+ "name": "adr: ADR-123 β reframe as Graph Intelligence Engine with complexity-aware execution","type": "history-commit",- "score": 0.7420111456379588,- "cosineScore": 0.08054377890438601,- "bm25Score": 13.416790187909843,- "mmrScore": 0.3654859309713514,+ "score": 0.7957460079249132,+ "cosineScore": 0.010547052616670351,+ "bm25Score": 23.51504033322106,"labelRelevant": false},{- "id": "pattern-1780161237206-b-hgnz",- "name": "feat(cost-tracker): wire codemod benchmark into cost-trend (ADR-143 follow-up)",+ "id": "pattern-1780161237206-d-hik9",+ "name": "feat(intelligence): deterministic Tier-1 codemods replacing Agent Booster (ADR-143)","type": "history-commit",- "score": 0.7364130042852118,- "cosineScore": 0.008640664241102285,- "bm25Score": 22.68343780594621,- "mmrScore": 0.3567363178223988,+ "score": 0.635585836335748,+ "cosineScore": -0.0440172201991718,+ "bm25Score": 20.837130846423726,"labelRelevant": true},{- "id": "pattern-1780161324695-3k-3187",- "name": "Merge pull request #2067 from ruvnet/docs/trim-redundant-badges",+ "id": "pattern-1780161324680-d-vq2u",+ "name": "feat(intelligence): deterministic Tier-1 codemods replacing Agent Booster (ADR-143)","type": "history-commit",- "score": 0.6,- "cosineScore": 0.11852022008519922,- "bm25Score": 0,- "mmrScore": 0.29966268778718885,- "labelRelevant": false+ "score": 0.635585836335748,+ "cosineScore": -0.0440172201991718,+ "bm25Score": 20.837130846423726,+ "labelRelevant": true}]},@@ -223,60 +208,55 @@"top3Relevant": true,"firstRelevantRank": 1,"label_top1": true,- "label_top3_count": 1,- "label_top5_count": 2,+ "label_top3_count": 3,+ "label_top5_count": 4,"label_firstRank": 1,"label_ndcg3": 1,- "label_ndcg5": 0.8772153153380493,+ "label_ndcg5": 1,"topK": [{"id": "pattern-1780161237212-1n-sokv","name": "MCP servers orphan on every Claude Code restart β ~1 GB leaked, and a stale server silently serves t","type": "history-issue",- "score": 0.7099856225954626,+ "score": 0.7583213521628854,"cosineScore": -0.005021665326373356,- "bm25Score": 41.11933482489236,- "mmrScore": 0.3549928112977313,+ "bm25Score": 41.10256425461641,"labelRelevant": true},{- "id": "pattern-1780161324688-1w-n21p",- "name": "perf(guidance): M4 quantization β 1-bit RaBitQ-style signatures, 2.7x at N=1000",- "type": "history-commit",- "score": 0.6,- "cosineScore": 0.128886003056017,- "bm25Score": 0,- "mmrScore": 0.3,- "labelRelevant": false- },- {- "id": "pattern-1780161324703-54-114j",- "name": "feat(browser): #2041 ADR-122 Phase 5 β cost-aware routing + GOAP preflight",+ "id": "pattern-1780161237206-a-bqc4",+ "name": "fix(intelligence): 4-issue bug cluster β Opus 4.8 + uptime + MCP orphan + Q-encoder","type": "history-commit",- "score": 0.5946483634011628,- "cosineScore": 0.12641500425453153,- "bm25Score": 0,- "mmrScore": 0.27057137341247245,- "labelRelevant": false+ "score": 0.6498162488164477,+ "cosineScore": -0.02824698444563799,+ "bm25Score": 35.62871503054129,+ "labelRelevant": true},{- "id": "pattern-1780161237206-a-bqc4",+ "id": "pattern-1780161324680-a-jg1q","name": "fix(intelligence): 4-issue bug cluster β Opus 4.8 + uptime + MCP orphan + Q-encoder","type": "history-commit",- "score": 0.606438989206964,+ "score": 0.6498162488164477,"cosineScore": -0.02824698444563799,- "bm25Score": 35.64576215181913,- "mmrScore": 0.2674443839942542,+ "bm25Score": 35.62871503054129,"labelRelevant": true},{- "id": "pattern-1780161324690-27-igfa",- "name": "fix(cli,daemon,mcp): #2098 #2093 #2085 β three regressions reported on alpha.75",+ "id": "pattern-1780159888525-1n-2zyq",+ "name": "MCP servers orphan on every Claude Code restart β ~1 GB leaked, and a stale server silently serves t",+ "type": "history-issue",+ "score": 0.5604585694809501,+ "cosineScore": -0.005021665326373356,+ "bm25Score": 24.837228777053515,+ "labelRelevant": true+ },+ {+ "id": "pattern-1780161237205-9-48p8",+ "name": "chore(release): bump 3.10.10 β 3.10.11 (4-issue bug cluster)","type": "history-commit",- "score": 0.5744138961261711,- "cosineScore": 0.06790637329708647,- "bm25Score": 10.946201316214678,- "mmrScore": 0.2626075754483277,+ "score": 0.5535932865110383,+ "cosineScore": 0.017234812587240394,+ "bm25Score": 20.970782787973114,"labelRelevant": false}]@@ -288,8 +268,8 @@"top3Relevant": true,"firstRelevantRank": 1,"label_top1": true,- "label_top3_count": 1,- "label_top5_count": 1,+ "label_top3_count": 3,+ "label_top5_count": 5,"label_firstRank": 1,"label_ndcg3": 1,"label_ndcg5": 1,@@ -298,51 +278,46 @@"id": "pattern-1780161221198-1-3ezl","name": "feat(memory): unified learning-stats aggregator (ADR-075)","type": "history-commit",- "score": 0.6535228171782452,+ "score": 0.7112690143152043,"cosineScore": -0.03179548242068774,- "bm25Score": 34.632039854633206,- "mmrScore": 0.3267614085891226,+ "bm25Score": 33.91953195974668,"labelRelevant": true},{- "id": "pattern-1780159888520-q-3lmr",- "name": "fix(init): #2206 #2207 #2208 β wizard server key, init detector, CLAUDE.md backup (#2214)",+ "id": "pattern-1780163971873-1-kxwd",+ "name": "feat(memory): unified learning-stats aggregator (ADR-075)","type": "history-commit",- "score": 0.5626313450839108,- "cosineScore": 0.13624368513537335,- "bm25Score": 0,- "mmrScore": 0.2813156725419554,- "labelRelevant": false+ "score": 0.7112690143152043,+ "cosineScore": -0.03179548242068774,+ "bm25Score": 33.91953195974668,+ "labelRelevant": true},{- "id": "pattern-1780159888526-1v-6kuu",- "name": "bug: flashAttention reports contradictory state across MCP tools (system_info=false vs hooks_intelli",- "type": "history-issue",- "score": 0.6,- "cosineScore": 0.15655822549223372,- "bm25Score": 0,- "mmrScore": 0.2757020128669746,- "labelRelevant": false+ "id": "pattern-1780163991305-1-ng0z",+ "name": "feat(memory): unified learning-stats aggregator (ADR-075)",+ "type": "history-commit",+ "score": 0.7112690143152043,+ "cosineScore": -0.03179548242068774,+ "bm25Score": 33.91953195974668,+ "labelRelevant": true},{- "id": "pattern-1780159888526-21-8ofz",- "name": "[Dream Cycle 2026-05-27] intelligence: SRΒ²AM 8B=120β355B via simulative planning β 95% token gap + c",- "type": "history-issue",- "score": 0.5211702493559724,- "cosineScore": 0.1137043910586627,- "bm25Score": 0,- "mmrScore": 0.2361062427589102,- "labelRelevant": false+ "id": "pattern-1780164011125-1-q5kx",+ "name": "feat(memory): unified learning-stats aggregator (ADR-075)",+ "type": "history-commit",+ "score": 0.7112690143152043,+ "cosineScore": -0.03179548242068774,+ "bm25Score": 33.91953195974668,+ "labelRelevant": true},{- "id": "pattern-1780161324695-3j-wi4w",- "name": "adr: ADR-126 β ruflo-neural-trader substrate integration",+ "id": "pattern-1780164061889-1-dp9i",+ "name": "feat(memory): unified learning-stats aggregator (ADR-075)","type": "history-commit",- "score": 0.5303692753842913,- "cosineScore": 0.11870521289492406,- "bm25Score": 0,- "mmrScore": 0.20010261059031398,- "labelRelevant": false+ "score": 0.7112690143152043,+ "cosineScore": -0.03179548242068774,+ "bm25Score": 33.91953195974668,+ "labelRelevant": true}]},@@ -353,8 +328,8 @@"top3Relevant": true,"firstRelevantRank": 1,"label_top1": true,- "label_top3_count": 1,- "label_top5_count": 1,+ "label_top3_count": 3,+ "label_top5_count": 5,"label_firstRank": 1,"label_ndcg3": 1,"label_ndcg5": 1,@@ -363,51 +338,46 @@"id": "pattern-1780161221198-2-kxx1","name": "feat(intelligence): structured distillation (ADR-076)","type": "history-commit",- "score": 0.7436629268946584,+ "score": 0.7863857724122153,"cosineScore": 0.01303151951388954,- "bm25Score": 46.73029623859142,- "mmrScore": 0.3718314634473292,+ "bm25Score": 45.76215069283218,"labelRelevant": true},{- "id": "pattern-1780159888518-b-vf8y",- "name": "Merge feat/deterministic-tier1-codemods: deterministic Tier-1 codemods (ADR-143)",+ "id": "pattern-1780163971873-2-ced8",+ "name": "feat(intelligence): structured distillation (ADR-076)","type": "history-commit",- "score": 0.5899985175159177,- "cosineScore": 0.11334191563527016,- "bm25Score": 0,- "mmrScore": 0.29499925875795885,- "labelRelevant": false+ "score": 0.7863857724122153,+ "cosineScore": 0.01303151951388954,+ "bm25Score": 45.76215069283218,+ "labelRelevant": true},{- "id": "pattern-1780161324689-22-p22q",- "name": "Merge pull request #2101 from ruvnet/fix/2078-claudemd-coauthor-rule",+ "id": "pattern-1780163991305-2-bbx9",+ "name": "feat(intelligence): structured distillation (ADR-076)","type": "history-commit",- "score": 0.6,- "cosineScore": 0.11741462257643585,- "bm25Score": 0,- "mmrScore": 0.27832122285750827,- "labelRelevant": false+ "score": 0.7863857724122153,+ "cosineScore": 0.01303151951388954,+ "bm25Score": 45.76215069283218,+ "labelRelevant": true},{- "id": "pattern-1780159888519-h-o34h",- "name": "docs: ruflo-workflows v0.4.0 native-Workflow orchestration + ADR-141 (taubench campaign)",+ "id": "pattern-1780164011125-2-hz9g",+ "name": "feat(intelligence): structured distillation (ADR-076)","type": "history-commit",- "score": 0.574352690368402,- "cosineScore": 0.1069707732645887,- "bm25Score": 0,- "mmrScore": 0.2703441391017582,- "labelRelevant": false+ "score": 0.7863857724122153,+ "cosineScore": 0.01303151951388954,+ "bm25Score": 45.76215069283218,+ "labelRelevant": true},{- "id": "pattern-1780161324698-3w-5c7h",- "name": "feat(memory): #2061 ADR-125 Phase 5 β graceful retrieval degradation + FTS5 keyword fallback",+ "id": "pattern-1780164061889-2-g68y",+ "name": "feat(intelligence): structured distillation (ADR-076)","type": "history-commit",- "score": 0.5750560127842083,- "cosineScore": 0.1072571734146955,- "bm25Score": 0,- "mmrScore": 0.2557069865449775,- "labelRelevant": false+ "score": 0.7863857724122153,+ "cosineScore": 0.01303151951388954,+ "bm25Score": 45.76215069283218,+ "labelRelevant": true}]},@@ -415,8 +385,8 @@"query": "SQL injection migrate.ts table identifier","matched": true,"top1Relevant": false,- "top3Relevant": false,- "firstRelevantRank": -1,+ "top3Relevant": true,+ "firstRelevantRank": 3,"label_top1": true,"label_top3_count": 1,"label_top5_count": 1,@@ -428,50 +398,45 @@"id": "pattern-1780161324687-1s-ibq9","name": "fix(security): patch CVEs, shell injection, SSRF in ruflo (#2114)","type": "history-commit",- "score": 0.6996019746310844,+ "score": 0.7496683121925704,"cosineScore": 0.013552514538906218,- "bm25Score": 17.379739449050696,- "mmrScore": 0.3498009873155422,+ "bm25Score": 17.385529422508366,"labelRelevant": true},{- "id": "pattern-1780161324691-2i-tm1b",- "name": "Merge pull request #2090 from ruvnet/docs/adr-127-github-stack-modernization",+ "id": "pattern-1780161324691-2k-8wey",+ "name": "fix(smoke): #2089 β accept E2BIG as valid rejection in github-safe injection smoke","type": "history-commit",- "score": 0.6,- "cosineScore": 0.15794464752821977,- "bm25Score": 0,- "mmrScore": 0.3,+ "score": 0.6120726663381497,+ "cosineScore": -0.03030855555620211,+ "bm25Score": 15.245231730179402,"labelRelevant": false},{- "id": "pattern-1780161324691-2k-8wey",- "name": "fix(smoke): #2089 β accept E2BIG as valid rejection in github-safe injection smoke",+ "id": "pattern-1780161324686-1l-uwcb",+ "name": "fix(memory): #2120 β accept NULL status in memory_entries (legacy DBs) + 3.7.0 stable","type": "history-commit",- "score": 0.5591739479416563,- "cosineScore": -0.03030855555620211,- "bm25Score": 15.242985233408563,- "mmrScore": 0.26835575675353013,+ "score": 0.4308784383211308,+ "cosineScore": 0.08345807062618357,+ "bm25Score": 2.0867963971112022,"labelRelevant": false},{- "id": "pattern-1780161324689-21-o5x6",- "name": "fix(smoke): #2042 β make providers smoke static-only (no build dependency)",+ "id": "pattern-1780161324692-2o-blny",+ "name": "feat(ci): #2089 ADR-127 Phase 1 β github-safe injection smoke + uses: pin smoke + supply-chain allow","type": "history-commit",- "score": 0.5486082159087727,- "cosineScore": 0.13324219046664132,- "bm25Score": 0,- "mmrScore": 0.25652644260691226,+ "score": 0.5656525624573043,+ "cosineScore": -0.010739342553144992,+ "bm25Score": 12.451477317504837,"labelRelevant": false},{"id": "pattern-1780161237215-24-4gf9","name": "[Dream Cycle 2026-05-26] security: Indirect prompt injection critical gap vs OWASP ASI01 + intellige","type": "history-issue",- "score": 0.5017973091184831,+ "score": 0.5360244406461236,"cosineScore": -0.025503342917368558,- "bm25Score": 12.315648052530662,- "mmrScore": 0.25089865455924154,+ "bm25Score": 12.311284864524511,"labelRelevant": false}]@@ -493,50 +458,45 @@"id": "pattern-1780161324693-2z-5x4a","name": "feat(neural-trader): #48 β benchmark suite (signal, backtest, memory-recall)","type": "history-commit",- "score": 0.8481889920375287,+ "score": 0.8734908266979406,"cosineScore": 0.08967419136034757,- "bm25Score": 22.761593530524472,- "mmrScore": 0.42409449601876437,+ "bm25Score": 22.72722152532161,"labelRelevant": true},{"id": "pattern-1780161324698-3y-v3g2","name": "feat(memory): #2061 ADR-125 Phase 3 β persistent HNSW snapshot + restore","type": "history-commit",- "score": 0.7808016707146919,+ "score": 0.7916358014837522,"cosineScore": 0.08630266804079345,- "bm25Score": 19.318395092653383,- "mmrScore": 0.3779554118021456,+ "bm25Score": 19.267091972257315,"labelRelevant": true},{- "id": "pattern-1780161324685-1e-ew7u",- "name": "fix(bench): ADR-130 P6 β CI-friendly benchmark using single-session inserts",+ "id": "pattern-1780161237205-6-7kk3",+ "name": "chore(release): bump 3.10.12 β 3.10.13 + [email protected]","type": "history-commit",- "score": 0.6454933069430006,- "cosineScore": 0.06474451013559841,- "bm25Score": 14.121550811799843,- "mmrScore": 0.3227466534715003,+ "score": 0.5198757928997108,+ "cosineScore": 0.013638755437439873,+ "bm25Score": 12.52972367217003,"labelRelevant": false},{- "id": "pattern-1780161237210-13-hqcn",- "name": "fix(ci): graph benchmark process.exit β eliminate 40-min hang (#2148)",+ "id": "pattern-1780161324679-6-xn7y",+ "name": "chore(release): bump 3.10.12 β 3.10.13 + [email protected]","type": "history-commit",- "score": 0.6934783408071648,- "cosineScore": 0.06790435166188932,- "bm25Score": 16.485256468636152,- "mmrScore": 0.32210386538531194,+ "score": 0.5198757928997108,+ "cosineScore": 0.013638755437439873,+ "bm25Score": 12.52972367217003,"labelRelevant": false},{- "id": "pattern-1780161324688-1y-hjpj",- "name": "perf(guidance): Phase 1 β hot-path cleanup + scaling benchmark infrastructure",+ "id": "pattern-1780161237210-13-hqcn",+ "name": "fix(ci): graph benchmark process.exit β eliminate 40-min hang (#2148)","type": "history-commit",- "score": 0.5896711309905036,- "cosineScore": 0.006665289443791871,- "bm25Score": 17.68760912478118,- "mmrScore": 0.285931094674632,+ "score": 0.6997408203707638,+ "cosineScore": 0.06790435166188932,+ "bm25Score": 16.511844334590442,"labelRelevant": false}]@@ -544,64 +504,59 @@{"query": "Q-learning encoder keyword block","matched": true,- "top1Relevant": false,- "top3Relevant": false,- "firstRelevantRank": -1,- "label_top1": false,- "label_top3_count": 0,- "label_top5_count": 0,- "label_firstRank": -1,- "label_ndcg3": 0,- "label_ndcg5": 0,+ "top1Relevant": true,+ "top3Relevant": true,+ "firstRelevantRank": 1,+ "label_top1": true,+ "label_top3_count": 2,+ "label_top5_count": 2,+ "label_firstRank": 1,+ "label_ndcg3": 1,+ "label_ndcg5": 1,"topK": [{- "id": "pattern-1780161324692-2o-blny",- "name": "feat(ci): #2089 ADR-127 Phase 1 β github-safe injection smoke + uses: pin smoke + supply-chain allow",- "type": "history-commit",- "score": 0.6573216521970584,- "cosineScore": 0.09696516710558883,- "bm25Score": 13.394332282219988,- "mmrScore": 0.3286608260985292,- "labelRelevant": false+ "id": "pattern-1780161237212-1j-us8j",+ "name": "Route Q-state encoder discards the entire keyword block β keyword-distinct tasks collapse to one Q-s",+ "type": "history-issue",+ "score": 0.6428258091644229,+ "cosineScore": -0.08305818918298438,+ "bm25Score": 49.861468797898674,+ "labelRelevant": true},{- "id": "pattern-1780161237213-1s-xof1",- "name": "Statusline shows `RuFlo V3.6` for global npm installs β statusline-generator version probe never che",+ "id": "pattern-1780159888525-1j-o7o2",+ "name": "Route Q-state encoder discards the entire keyword block β keyword-distinct tasks collapse to one Q-s","type": "history-issue",- "score": 0.5830272882362477,- "cosineScore": 0.10389287629109815,- "bm25Score": 2.3141438235371585,- "mmrScore": 0.29151364411812386,- "labelRelevant": false+ "score": 0.504193935954098,+ "cosineScore": -0.08305818918298438,+ "bm25Score": 36.03669115695696,+ "labelRelevant": true},{- "id": "pattern-1780161324690-27-igfa",- "name": "fix(cli,daemon,mcp): #2098 #2093 #2085 β three regressions reported on alpha.75",+ "id": "pattern-1780161324692-2o-blny",+ "name": "feat(ci): #2089 ADR-127 Phase 1 β github-safe injection smoke + uses: pin smoke + supply-chain allow","type": "history-commit",- "score": 0.5472141937172988,- "cosineScore": 0.09568661030559562,- "bm25Score": 0,- "mmrScore": 0.2736070968586494,+ "score": 0.5925110387802567,+ "cosineScore": 0.09696516710558883,+ "bm25Score": 13.388701820142487,"labelRelevant": false},{- "id": "pattern-1780159888526-1w-jptg",- "name": "wizard: unconditional CLAUDE.md overwrite destroys project guidance",- "type": "history-issue",- "score": 0.5455255717807561,- "cosineScore": 0.09488348699864597,- "bm25Score": 0,- "mmrScore": 0.27276278589037806,+ "id": "pattern-1780161237205-9-48p8",+ "name": "chore(release): bump 3.10.10 β 3.10.11 (4-issue bug cluster)",+ "type": "history-commit",+ "score": 0.48046064055505455,+ "cosineScore": 0.029870791404767158,+ "bm25Score": 13.938013753646597,"labelRelevant": false},{- "id": "pattern-1780161324698-3u-c1g1",- "name": "chore(release): publish 3.7.0-alpha.71 + @claude-flow/[email protected]",+ "id": "pattern-1780161324680-9-5bpv",+ "name": "chore(release): bump 3.10.10 β 3.10.11 (4-issue bug cluster)","type": "history-commit",- "score": 0.5887786396874698,- "cosineScore": 0.10356354291635028,- "bm25Score": 3.117634827934018,- "mmrScore": 0.25984549556943226,+ "score": 0.48046064055505455,+ "cosineScore": 0.029870791404767158,+ "bm25Score": 13.938013753646597,"labelRelevant": false}]@@ -612,61 +567,56 @@"top1Relevant": true,"top3Relevant": true,"firstRelevantRank": 1,- "label_top1": true,+ "label_top1": false,"label_top3_count": 1,"label_top5_count": 1,- "label_firstRank": 1,- "label_ndcg3": 1,- "label_ndcg5": 1,+ "label_firstRank": 2,+ "label_ndcg3": 0.6309297535714575,+ "label_ndcg5": 0.6309297535714575,"topK": [+ {+ "id": "pattern-1780161324701-4k-s8su",+ "name": "ci: #2046 supply-chain hardening β five-layer audit + dependency review + CODEOWNERS",+ "type": "history-commit",+ "score": 0.7683521455484774,+ "cosineScore": 0.02961367472444284,+ "bm25Score": 16.78700114221645,+ "labelRelevant": false+ },{"id": "pattern-1780161324699-44-nys5","name": "chore(release): publish 3.7.0-alpha.70 β CWE-347 security fix","type": "history-commit",- "score": 0.7270684861323451,+ "score": 0.734955163555904,"cosineScore": 0.0679787880690766,- "bm25Score": 13.023323867602025,- "mmrScore": 0.36353424306617255,+ "bm25Score": 13.016977906207593,"labelRelevant": true},{- "id": "pattern-1780161324692-2n-9rpj",- "name": "feat(security): #2089 ADR-127 Phase 2 β github-safe maxBuffer + agent frontmatter tools: + swarm-pr/",+ "id": "pattern-1780161237205-6-7kk3",+ "name": "chore(release): bump 3.10.12 β 3.10.13 + [email protected]","type": "history-commit",- "score": 0.692160745793463,- "cosineScore": 0.07733370497882346,- "bm25Score": 10.589960703321834,- "mmrScore": 0.3460803728967315,+ "score": 0.5894397052836056,+ "cosineScore": 0.03253431220092657,+ "bm25Score": 10.5785517143945,"labelRelevant": false},{- "id": "pattern-1780161324701-4k-s8su",- "name": "ci: #2046 supply-chain hardening β five-layer audit + dependency review + CODEOWNERS",+ "id": "pattern-1780161324679-6-xn7y",+ "name": "chore(release): bump 3.10.12 β 3.10.13 + [email protected]","type": "history-commit",- "score": 0.722022574658173,- "cosineScore": 0.02961367472444284,- "bm25Score": 16.784021193101726,- "mmrScore": 0.3162592205852921,+ "score": 0.5894397052836056,+ "cosineScore": 0.03253431220092657,+ "bm25Score": 10.5785517143945,"labelRelevant": false},{- "id": "pattern-1780161324699-43-nlue",- "name": "feat(memory): #2061 ADR-125 Phase 1 β MemoryService canonical entry point + deprecate UnifiedMemoryS",- "type": "history-commit",- "score": 0.6,- "cosineScore": 0.14226244116789438,- "bm25Score": 0,- "mmrScore": 0.3,- "labelRelevant": false- },- {- "id": "pattern-1780161324703-51-v1b7",- "name": "docs(browser): #2041 ADR-122 security audit + substrate benchmarks + announcement draft",+ "id": "pattern-1780161324692-2n-9rpj",+ "name": "feat(security): #2089 ADR-127 Phase 2 β github-safe maxBuffer + agent frontmatter tools: + swarm-pr/","type": "history-commit",- "score": 0.6420647374891724,- "cosineScore": 0.04934530829645153,- "bm25Score": 11.385921233671224,- "mmrScore": 0.291427320437951,+ "score": 0.6812870831790458,+ "cosineScore": 0.07733370497882346,+ "bm25Score": 10.569255981200145,"labelRelevant": false}]diff --git a/package-lock.json b/package-lock.jsonindex 5bd02f232c..cff1d4f99b 100644--- a/package-lock.json+++ b/package-lock.json@@ -1,12 +1,12 @@{"name": "claude-flow",- "version": "3.10.22",+ "version": "3.10.23","lockfileVersion": 3,"requires": true,"packages": {"": {"name": "claude-flow",- "version": "3.10.22",+ "version": "3.10.23","license": "MIT","dependencies": {"@claude-flow/cli-core": "^3.7.0-alpha.5",diff --git a/package.json b/package.jsonindex a229e0325a..86cab09f64 100644--- a/package.json+++ b/package.json@@ -1,6 +1,6 @@{"name": "claude-flow",- "version": "3.10.22",+ "version": "3.10.23","description": "Ruflo - Enterprise AI agent orchestration for Claude Code. Deploy 60+ specialized agents in coordinated swarms with self-learning, fault-tolerant consensus, vector memory, and MCP integration","main": "dist/index.js","type": "module",diff --git a/ruflo/package.json b/ruflo/package.jsonindex 1fc10f3b94..2c23bbf1a6 100644--- a/ruflo/package.json+++ b/ruflo/package.json@@ -1,6 +1,6 @@{"name": "ruflo",- "version": "3.10.22",+ "version": "3.10.23","description": "Ruflo - Enterprise AI agent orchestration platform. Deploy 60+ specialized agents in coordinated swarms with self-learning, fault-tolerant consensus, vector memory, and MCP integration","main": "bin/ruflo.js","type": "module",diff --git a/v3/@claude-flow/cli/package.json b/v3/@claude-flow/cli/package.jsonindex 9732ac6a2d..ae26a22b62 100644--- a/v3/@claude-flow/cli/package.json+++ b/v3/@claude-flow/cli/package.json@@ -1,6 +1,6 @@{"name": "@claude-flow/cli",- "version": "3.10.22",+ "version": "3.10.23","type": "module","description": "Ruflo CLI - Enterprise AI agent orchestration with 60+ specialized agents, swarm coordination, MCP server, self-learning hooks, and vector memory for Claude Code","main": "dist/src/index.js",diff --git a/v3/@claude-flow/cli/scripts/grid-search-retrieval.mjs b/v3/@claude-flow/cli/scripts/grid-search-retrieval.mjsindex 9d8ac57af3..70c89ae0bf 100644--- a/v3/@claude-flow/cli/scripts/grid-search-retrieval.mjs+++ b/v3/@claude-flow/cli/scripts/grid-search-retrieval.mjs@@ -74,10 +74,15 @@ const ALPHA_GRID = QUICK ? [0.5, 0.7] : [0.3, 0.5, 0.7];const SUBJ_GRID = QUICK ? [3.0, 5.0] : [2.0, 3.0, 5.0];const MMR_GRID = QUICK ? [0.5] : [0.3, 0.5, 0.7];-// Rerank grid: hybridWeight Γ ceWeight (mutually constrained β they sum to 1)+// Rerank grid: hybridWeight Γ ceWeight (sum to 1).const RERANK_GRID = QUICK? [[0.5, 0.5]]- : [[0.3, 0.7], [0.4, 0.6], [0.5, 0.5], [0.6, 0.4], [0.7, 0.3]];+ : [[0.2, 0.8], [0.3, 0.7], [0.4, 0.6], [0.5, 0.5], [0.6, 0.4], [0.7, 0.3], [0.8, 0.2]];++// ADR-083: when re-gridding rerank, sweep BOTH the hybrid sub-params (alpha, sw)+// AND the rerank weights. This catches joint-optima the per-axis grids miss.+const RERANK_HYBRID_ALPHA = QUICK ? [0.5] : [0.3, 0.5];+const RERANK_HYBRID_SW = QUICK ? [2.0] : [2.0, 3.0];// ---------------------------------------------------------------------------// Eval@@ -128,13 +133,19 @@ async function main() {}}- // Β§B β rerank grid (slow, ~5 configs β each query takes ~1s with CE)+ // Β§B β rerank joint grid (ADR-083): hybridWeight Γ ceWeight Γ alpha Γ subjectWeight.+ // Each query takes ~1s with cross-encoder, so default full grid = 28 configs Γ 10+ // queries Γ 1s β 5 minutes. Use --quick for 1 config (smoke).for (const [hybridWeight, ceWeight] of RERANK_GRID) {- configs.push({- name: `rerank hw=${hybridWeight} cw=${ceWeight}`,- rerank: true,- params: { rerank: true, alpha: 0.6, subjectWeight: 3.0, hybridWeight, ceWeight },- });+ for (const alpha of RERANK_HYBRID_ALPHA) {+ for (const subjectWeight of RERANK_HYBRID_SW) {+ configs.push({+ name: `rerank hw=${hybridWeight} cw=${ceWeight} Ξ±=${alpha} sw=${subjectWeight}`,+ rerank: true,+ params: { rerank: true, alpha, subjectWeight, mmrLambda: 0.7, hybridWeight, ceWeight },+ });+ }+ }}console.log(`Grid-search: ${configs.length} configs across ${QUERIES.length} queries\n`);diff --git a/v3/@claude-flow/cli/src/mcp-tools/neural-tools.ts b/v3/@claude-flow/cli/src/mcp-tools/neural-tools.tsindex 963138caa2..a53d43878f 100644--- a/v3/@claude-flow/cli/src/mcp-tools/neural-tools.ts+++ b/v3/@claude-flow/cli/src/mcp-tools/neural-tools.ts@@ -496,12 +496,12 @@ export const neuralTools: MCPTool[] = [mode: { type: 'string', enum: ['hybrid', 'cosine'], description: 'Search mode β hybrid (cosine+BM25+MMR, default) or cosine (pre-3.10.18 behaviour, for A/B)' },alpha: { type: 'number', description: 'Hybrid: cosine weight in [0,1]; (1-Ξ±) is BM25 weight (default 0.5, tuned ADR-082)' },mmrLambda: { type: 'number', description: 'Hybrid: MMR balance β 1.0 = pure relevance, 0.0 = pure diversity (default 0.7, tuned ADR-082)' },- subjectWeight: { type: 'number', description: 'Hybrid: multi-field BM25 weight for subject/name (default 2.0, tuned ADR-082)' },+ subjectWeight: { type: 'number', description: 'Hybrid: multi-field BM25 weight for subject/name (default 2.0 non-rerank, 3.0 with rerank β tuned ADR-082/083)' },bodyWeight: { type: 'number', description: 'Hybrid: multi-field BM25 weight for body/content (default 1.0)' },typePenaltyFactor: { type: 'number', description: 'Hybrid: meta-commit score multiplier β release/merge/bump commits Γ this factor (default 1.0 = disabled; set 0.5 for aggressive suppression)' },rerank: { type: 'boolean', description: 'Hybrid: opt-in cross-encoder rerank pass over the top-K (ADR-080). Adds ~20-40 ms per (query, doc) pair; first call downloads ~30MB model. Gracefully degrades to hybrid+MMR order when unavailable.' },- hybridWeight: { type: 'number', description: 'Rerank: hybrid score weight in final combination (default 0.5)' },- ceWeight: { type: 'number', description: 'Rerank: cross-encoder score weight in final combination (default 0.5)' },+ hybridWeight: { type: 'number', description: 'Rerank: hybrid score weight in final combination (default 0.7, tuned ADR-083)' },+ ceWeight: { type: 'number', description: 'Rerank: cross-encoder score weight in final combination (default 0.3, tuned ADR-083)' },data: { type: 'object', description: 'Pattern data' },},},@@ -581,10 +581,13 @@ export const neuralTools: MCPTool[] = [// pre-3.10.18 behaviour for A/B tests via {mode:'cosine'}; default is// hybrid (cosine + BM25 + MMR).const mode = String(input.mode ?? 'hybrid');- // ADR-082 grid-search optima: Ξ±=0.5 (vs 0.6 default), mmr=0.7 (vs 0.5).- // Measured: nDCG@3 0.900 β 0.963, top-1 90% maintained, latency unchanged.- const alpha = Number(input.alpha ?? 0.5); // cosine weight; (1-Ξ±) is BM25- const mmrLambda = Number(input.mmrLambda ?? 0.7); // 1 = pure relevance, 0 = pure diversity+ const useRerank = input.rerank === true || String(input.rerank) === 'true';+ // ADR-083 joint grid: rerank path benefits from DIFFERENT hybrid+ // sub-params than non-rerank (the cross-encoder adds semantic depth,+ // so the hybrid stage can be more keyword-focused). nDCG@3 0.900 β+ // 0.963 on rerank just by switching sw 2.0 β 3.0 in the hybrid stage.+ const alpha = Number(input.alpha ?? 0.5);+ const mmrLambda = Number(input.mmrLambda ?? 0.7);const { tokenize, buildCorpusStats, hybridScores, mmrRerank, multiFieldBM25, typePenalty } =await import('../memory/hybrid-retrieval.js');@@ -626,10 +629,11 @@ export const neuralTools: MCPTool[] = [const subjectStats = buildCorpusStats(subjectDocs);const bodyStats = buildCorpusStats(bodyDocs);const queryTokens = tokenize(query);- // ADR-082: subjectWeight 3.0 β 2.0 from grid-search (sw=2 beats sw=3- // on this corpus β the body adds relevance signal that gets crowded- // out at sw=3). 5.0 is strictly worse than 3.0 (overweights subject).- const subjectWeight = Number(input.subjectWeight ?? 2.0);+ // ADR-082: subjectWeight 3.0 β 2.0 from grid (sw=2 dominates at hybrid-only).+ // ADR-083 joint grid: when rerank is on, the cross-encoder handles+ // semantic understanding, so the hybrid stage can be MORE+ // subject-focused (sw=3) β recovers nDCG@3 0.963.+ const subjectWeight = Number(input.subjectWeight ?? (useRerank ? 3.0 : 2.0));const bodyWeight = Number(input.bodyWeight ?? 1.0);const bm25Arr = patterns.map((_, i) =>multiFieldBM25(queryTokens, subjectDocs[i], bodyDocs[i], subjectStats, bodyStats, subjectWeight, bodyWeight),@@ -649,7 +653,7 @@ export const neuralTools: MCPTool[] = [// more options to find the truly-best). ADR-080 ablation: rerank over// a narrow post-MMR slice degrades top-1; reranking a wider hybrid// top-K*6 pool restores and exceeds the no-rerank baseline.- const useRerank = input.rerank === true || String(input.rerank) === 'true';+ // useRerank declared at top of search block for conditional defaults.const poolSize = useRerank ? k * 6 : k * 3;const prelim = patterns.map((p, i) => ({ p, hybrid: hybridArr[i], cosine: cosineArr[i], bm25: bm25Arr[i] }))@@ -684,13 +688,12 @@ export const neuralTools: MCPTool[] = [const hybridNorm = normalise(candidates.map((c) => c.relevance));const ceNorm = normalise(ceScores);- // ADR-082: hybridWeight/ceWeight kept at 0.5/0.5 β the grid-search- // showed hw=0.7 cw=0.3 winning when tested against the OLD Ξ±=0.6- // sw=3.0 baseline, but a joint re-grid with the new Ξ±=0.5 sw=2.0- // defaults is pending. Conservative: keep 0.5/0.5 until the- // joint optimum is measured.- const hybridWeight = Number(input.hybridWeight ?? 0.5);- const ceWeight = Number(input.ceWeight ?? 0.5);+ // ADR-083 joint grid: hw=0.7 cw=0.3 (with Ξ±=0.5 sw=3 from above) is+ // the joint optimum at nDCG@3=0.963 (vs 0.900 at 0.5/0.5). The+ // hybrid signal carries most of the relevance; the cross-encoder+ // contributes a 30% smoothing/disambiguation kick.+ const hybridWeight = Number(input.hybridWeight ?? 0.7);+ const ceWeight = Number(input.ceWeight ?? 0.3);const combined = candidates.map((c, i) => ({...c,_crossEncoderScore: ceScores[i],diff --git a/v3/docs/adr/ADR-083-joint-rerank-grid.md b/v3/docs/adr/ADR-083-joint-rerank-grid.mdnew file mode 100644index 0000000000..34a560eaac--- /dev/null+++ b/v3/docs/adr/ADR-083-joint-rerank-grid.md@@ -0,0 +1,120 @@+# ADR-083 β Joint Rerank Re-Grid (Conditional Defaults for Rerank Path)++**Status**: Accepted β Implemented in ruflo 3.10.23+**Date**: 2026-05-30+**Tracking**: continuation of self-learning hardening cluster (ADR-077 β 078 β 079 β 080 β 081 β 082 β 083)+**Related**: ADR-082 (single-axis grid-search)++## Context++ADR-082 grid-searched the hybrid (non-rerank) hyperparameter space against the ADR-081 labelled corpus and shipped Ξ±=0.5, sw=2, mmr=0.7 β pushing hybrid nDCG@3 from 0.900 to 0.963. The rerank path was left at hw=0.5/cw=0.5 because the original rerank grid had been tested against the OLD Ξ±=0.6/sw=3.0 baseline; with Ξ±/sw shifting underneath, the joint optimum needed measuring.++ADR-082 flagged this explicitly: *"Rerank's trade-off: top-1/MRR/P3 up, nDCG@3/top-3 marginally down. Net: positive but not unambiguous. A joint re-grid (including hybridWeight/ceWeight Γ new Ξ±/sw) is tracked."*++This is that re-grid.++## Decision++Extended `scripts/grid-search-retrieval.mjs` with a joint rerank sweep:+- `hybridWeight Γ ceWeight` β {(0.2,0.8), (0.3,0.7), (0.4,0.6), (0.5,0.5), (0.6,0.4), (0.7,0.3), (0.8,0.2)}+- `alpha` β {0.3, 0.5} (for the underlying hybrid stage when rerank is on)+- `subjectWeight` β {2.0, 3.0}++7 Γ 2 Γ 2 = 28 rerank configs, ~25 min wall-clock with the cross-encoder.++### Key finding++The rerank path wants **different hybrid sub-params** than the non-rerank path:++| Path | Best Ξ± | Best sw | Best mmr | Best hw/cw | nDCG@3 |+|---|---:|---:|---:|---|---:|+| Non-rerank (hybrid only) | 0.5 | **2.0** | 0.7 | β | 0.963 |+| **Rerank** | 0.5 | **3.0** | 0.7 | hw=0.7 cw=0.3 | **0.963** |++This makes intuitive sense: when the cross-encoder is doing the semantic understanding downstream, the hybrid stage can be more keyword-focused (higher subject weight). When hybrid is the final stage, lower subject weight gives the body tokens room to contribute relevance signal.++Implementation: `subjectWeight` default is now **conditional on `useRerank`** (3.0 if reranking, 2.0 otherwise). Explicit `subjectWeight` param still overrides.++### New defaults++| Parameter | Non-rerank | Rerank | Change vs 3.10.22 |+|---|---:|---:|---|+| `alpha` | 0.5 | 0.5 | unchanged |+| `subjectWeight` | 2.0 | **3.0** | rerank +1.0 (conditional default) |+| `mmrLambda` | 0.7 | 0.7 | unchanged |+| `hybridWeight` | β | **0.7** | rerank: 0.5 β 0.7 |+| `ceWeight` | β | **0.3** | rerank: 0.5 β 0.3 |++## Measured proof (N=385, 10 queries, labelled metric)++Rerank path:++| Metric | 3.10.22 (old joint defaults) | **3.10.23 (ADR-083)** | Ξ |+|---|---:|---:|---:|+| Label top-1 hit rate | 90% | 90% | tied |+| Label top-3 hit rate | 90% | **100%** | +10pp |+| Label MRR@3 | 0.925 | **0.950** | +0.025 |+| **Label precision@3** | 0.700 | **0.700** | tied |+| **Label nDCG@3** | 0.900 | **0.963** | **+0.063 (+7%)** |+| Label nDCG@5 | 0.904 | **0.944** | +0.040 |++Hybrid (non-rerank) path: unchanged from 3.10.22 (nDCG@3 = 0.963).++### Cumulative SOTA push (3.10.17 β 3.10.23)++| Metric (labelled) | 3.10.17 cosine | 3.10.19 hybrid | 3.10.20 +rerank | 3.10.22 | **3.10.23** |+|---|---:|---:|---:|---:|---:|+| Hybrid nDCG@3 | 0.000 | 0.900 | 0.900 | 0.963 | **0.963** |+| Rerank nDCG@3 | β | β | 0.913 | 0.900 | **0.963** |+| Hybrid top-3 | 0% | 90% | 90% | 100% | **100%** |+| Rerank top-3 | β | β | 100% | 90% | **100%** |+| Rerank precision@3 | β | β | 0.667 | 0.700 | **0.700** |++**Both retrieval paths now hit nDCG@3 = 0.963 on this corpus.** The choice between them is now purely cost vs richness:+- **Hybrid (39 ms/query)** β same nDCG, leaner top-3 (P3=0.533), use for hot paths+- **Rerank (1000 ms/query)** β same nDCG, denser top-3 (P3=0.700), use for richness-first paths++## Joint grid top-5 by nDCG@3 (full ranking)++| Rank | Config | top-1 | top-3 | nDCG | P3 | MRR |+|---|---|---:|---:|---:|---:|---:|+| 1 | hybrid Ξ±=0.5 sw=2 mmr=0.7 | 90% | 100% | **0.963** | 0.533 | 0.950 |+| 1 | rerank hw=0.7 cw=0.3 Ξ±=0.5 sw=3 | 90% | 100% | **0.963** | 0.700 | 0.950 |+| 1 | rerank hw=0.8 cw=0.2 Ξ±=0.3 sw=3 | 90% | 100% | **0.963** | **0.767** | 0.950 |+| 4 | hybrid Ξ±=0.5 sw=3 mmr=0.7 | 90% | 100% | 0.955 | 0.533 | 0.950 |+| 4 | rerank hw=0.8 cw=0.2 Ξ±=0.5 sw=3 | 90% | 100% | 0.955 | 0.700 | 0.950 |++Three configs tied at the corpus ceiling. Picked hw=0.7 cw=0.3 over hw=0.8 cw=0.2 because the latter underweights the cross-encoder's contribution (cw=0.2 leaves the CE doing almost nothing).++## Reusable infrastructure shipped++- `scripts/grid-search-retrieval.mjs` β extended with joint rerank sweep (28 configs across hw/cw Γ Ξ± Γ sw). Re-runnable on any corpus.+- Conditional default logic in `src/mcp-tools/neural-tools.ts` β `subjectWeight` default depends on `useRerank`.+- Run JSON at `docs/benchmarks/runs/grid-search-retrieval-latest.json` with the full 48-config matrix.++## Honest limits++- **N=10 queries** still β three configs tied at 0.963 are likely indistinguishable within noise.+- **Cross-repo generalisation pending** β all numbers in ADRs 077-083 are on the ruflo corpus. The real SOTA test is "does this hold up on a different repo's history?" β pretrain on agentdb / agentic-flow, run a similar labelled bench, see if nDCG@3 stays near 0.96. Tracked for the next iteration.+- **Conditional defaults add complexity** β callers passing explicit `subjectWeight` get consistent behaviour, but callers relying on defaults see different values based on `rerank` flag. This is documented in the schema but is a minor surprise.++## Deliberately NOT in this round++- **Cross-repo generalisation test** β biggest pending validation; next loop iteration.+- **Pure-precision configs** (hw=0.4/cw=0.6 Ξ±=0.3 sw=3 hit P3=0.800 with nDCG=0.900) β would be the right opt-in for "richer top-K" but adds yet another config option. Skipping.+- **Larger cross-encoder** (L-12 vs L-6) β corpus is already near ceiling; bigger model unlikely to help on N=10.++## Verification++```bash+git clone https://github.com/ruvnet/ruflo && cd ruflo+npm install && ( cd v3/@claude-flow/cli && npx tsc )+node v3/@claude-flow/cli/scripts/pretrain-from-github.mjs++# Joint grid (~25 min)+cd v3/@claude-flow/cli && node scripts/grid-search-retrieval.mjs++# Verify new defaults+BENCH_NO_WRITE=1 node scripts/benchmark-pretrained-retrieval.mjs # hybrid β nDCG@3 0.963+RERANK=1 BENCH_NO_WRITE=1 node scripts/benchmark-pretrained-retrieval.mjs # rerank β nDCG@3 0.963 (was 0.900)+```