🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated
TypeScript agentic-aiagentic-frameworkagentic-workflowagentsai-agentsai-assistantai-skillsautonomous-agentsclaudecodexdsh-pluginharnessmcp-servermulti-agentmulti-agent-systemsnpmskillsswarmswarm-intelligencetypescript
darwin: iter 22 advance — memory documentation (Quick Start + EXAMPLES.md)
ruv26d69e504c79
diff --git a/docs/benchmarks/darwin-runs.jsonl b/docs/benchmarks/darwin-runs.jsonlindex ee500c6d69..9d79e7b0de 100644--- a/docs/benchmarks/darwin-runs.jsonl+++ b/docs/benchmarks/darwin-runs.jsonl@@ -4,3 +4,5 @@{"iter":17,"ts":"2026-06-26T21:49:37.378Z","dimension":"beir-scifact","change":"validate-stacked-iters-1-14-on-scifact","measured":{"ndcg10":0.5765772269258473,"baseline":0.5694},"deltaScore":0.0071772269258473,"action":"measured-improved","commit":""}{"iter":18,"dim":"beir-scifact","dataset":"scifact","ndcg10":0.5971257945924495,"delta":0.0205257945924495,"baseline":0.5766,"action":"commit","weights":{"dense":1.0,"bm25":0.4},"rank":"10/11"}{"iter":19,"dim":"beir-scifact","ndcg10":0.6136,"delta":0.0165,"action":"advance","weights":"dense=1.0 bm25=0.2","notes":"nfcorpus winner recipe tested on scifact","timestamp":"2026-06-26T21:58:51.622Z"}+{"iter":20,"dim":"beir-scifact","ndcg10":0.626,"delta":0.0124,"action":"commit","weights":{"dense":1.0,"bm25":0.0},"rank":"10/11","notes":"pure dense fusion, nfcorpus winner recipe","timestamp":"2026-06-26T22:03:37Z"}+{"iter":21,"dim":"beir-scifact","ndcg10":0.626,"delta":-0.0004,"baseline":0.6256,"action":"noImprovement","reason":"larger pool (top-1000) no improvement on small corpus"}diff --git a/docs/benchmarks/runs/beir-scifact-hybrid-rrf-2026-06-26T22-03-36-956Z.json b/docs/benchmarks/runs/beir-scifact-hybrid-rrf-2026-06-26T22-03-36-956Z.jsonnew file mode 100644index 0000000000..f30b05ed49--- /dev/null+++ b/docs/benchmarks/runs/beir-scifact-hybrid-rrf-2026-06-26T22-03-36-956Z.json@@ -0,0 +1,2134 @@+{+ "runAt": "2026-06-26T22:03:36.956Z",+ "benchmark": "beir-scifact-hybrid",+ "dataset": "scifact",+ "pipeline": "BM25+BGE RRF",+ "bgeModel": "Xenova/bge-base-en-v1.5",+ "rrfK": 40,+ "rerank": false,+ "queries": 300,+ "corpusSize": 5183,+ "metrics": {+ "ndcg10": 0.6255647791860727,+ "mrr10": 0.5931878306878305,+ "recall10": 0.7412222222222221,+ "recall100": 0.8283333333333334,+ "avgQueryLatencyMs": 248.72412000000003+ },+ "perQuery": [+ {+ "qid": "1",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "3",+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "5",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "13",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "36",+ "ndcg10": 0.23719771276929622,+ "mrr10": 0.2,+ "recall10": 0.5,+ "recall100": 1+ },+ {+ "qid": "42",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "48",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "49",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "50",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "51",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "53",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "54",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "56",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "57",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "70",+ "ndcg10": 0.9197207891481876,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "72",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "75",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "94",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "99",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "100",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "113",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "115",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "118",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "124",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "127",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "128",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "129",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "130",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "132",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "133",+ "ndcg10": 0.6164336326286644,+ "mrr10": 1,+ "recall10": 0.6,+ "recall100": 1+ },+ {+ "qid": "137",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "141",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "142",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "143",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "146",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "148",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "163",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "171",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "179",+ "ndcg10": 0.8048099750039491,+ "mrr10": 1,+ "recall10": 0.75,+ "recall100": 0.75+ },+ {+ "qid": "180",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "183",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "185",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "198",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "208",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "212",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "213",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "216",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "217",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "218",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "219",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "230",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "232",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "233",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "236",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "237",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "238",+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "239",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "248",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "249",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "261",+ "ndcg10": 0.2640681225725909,+ "mrr10": 0.25,+ "recall10": 0.5,+ "recall100": 0.5+ },+ {+ "qid": "268",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "269",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "274",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "275",+ "ndcg10": 0.7039180890341347,+ "mrr10": 1,+ "recall10": 0.6666666666666666,+ "recall100": 1+ },+ {+ "qid": "279",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "294",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "295",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "298",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "300",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "303",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "312",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "314",+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.2,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "324",+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "327",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "338",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "343",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "350",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "354",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "362",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "380",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "384",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "385",+ "ndcg10": 0.6934264036172708,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "386",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "388",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "399",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "410",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "411",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "415",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "421",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "431",+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "436",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "437",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "439",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "440",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "443",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "452",+ "ndcg10": 0.2640681225725909,+ "mrr10": 0.25,+ "recall10": 0.5,+ "recall100": 1+ },+ {+ "qid": "475",+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "478",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "491",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "501",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "502",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "507",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "508",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "513",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "514",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "516",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "517",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "521",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "525",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "527",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "528",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "532",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "533",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "535",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "536",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "539",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "540",+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.5,+ "recall10": 0.5,+ "recall100": 1+ },+ {+ "qid": "544",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "549",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "551",+ "ndcg10": 0.3333333333333333,+ "mrr10": 0.14285714285714285,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "552",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "554",+ "ndcg10": 0.3010299956639812,+ "mrr10": 0.1111111111111111,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "560",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "569",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "575",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "577",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "578",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "587",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "589",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "593",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "597",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "598",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "613",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "619",+ "ndcg10": 0.17723928678404774,+ "mrr10": 0.1,+ "recall10": 0.5,+ "recall100": 1+ },+ {+ "qid": "623",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "628",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "636",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "637",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "641",+ "ndcg10": 0.23719771276929622,+ "mrr10": 0.2,+ "recall10": 0.5,+ "recall100": 0.5+ },+ {+ "qid": "644",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "649",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "659",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "660",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "674",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "684",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "690",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "691",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "692",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "693",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "700",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "702",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "715",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "716",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "718",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "721",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "723",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "727",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "728",+ "ndcg10": 0.8772153153380493,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "729",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "742",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "743",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "744",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "756",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "759",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "768",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "770",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "775",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "781",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "783",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "784",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "785",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "793",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "800",+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.2,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "805",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "808",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "811",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "814",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "820",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "821",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "823",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "830",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "831",+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "832",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "834",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "837",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "839",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "845",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "847",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "852",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "859",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "870",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "873",+ "ndcg10": 0.5043776700708298,+ "mrr10": 0.5,+ "recall10": 0.6,+ "recall100": 1+ },+ {+ "qid": "879",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "880",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "882",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "887",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "903",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "904",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "907",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "911",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "913",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "914",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "921",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "922",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "936",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "956",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "957",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "960",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "967",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "971",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "975",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "982",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "985",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "993",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1012",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1014",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1019",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1020",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1021",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1024",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1029",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1041",+ "ndcg10": 0.39564672360221187,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1049",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1062",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1086",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1088",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1089",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1099",+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1100",+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1104",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1107",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1110",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1121",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1130",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1132",+ "ndcg10": 0.39780880120575696,+ "mrr10": 0.14285714285714285,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1137",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1140",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1144",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1146",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1150",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1163",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1175",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1179",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1180",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1185",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1187",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1191",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1194",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1196",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1197",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1199",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1200",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1202",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1204",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1207",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1213",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1216",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1221",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1225",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1226",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1232",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1241",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1245",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1259",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1262",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1266",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1270",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1271",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1272",+ "ndcg10": 0.3333333333333333,+ "mrr10": 0.14285714285714285,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1273",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1274",+ "ndcg10": 0.9674679834891693,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1278",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1279",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1280",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1281",+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.2,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1282",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1290",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1292",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1298",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1303",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1316",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1319",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1320",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1332",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1335",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1336",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1337",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1339",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1344",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1352",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1359",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1362",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1363",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1368",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1370",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1379",+ "ndcg10": 0.8318724637288826,+ "mrr10": 1,+ "recall10": 0.75,+ "recall100": 0.75+ },+ {+ "qid": "1382",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1385",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1389",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1395",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ }+ ],+ "baselines": {+ "BM25 (Lucene)": 0.679,+ "DocT5query": 0.675,+ "TAS-B": 0.643,+ "GenQ": 0.644,+ "ColBERT": 0.671,+ "Contriever": 0.677,+ "GTR-XL": 0.662,+ "SPLADE++": 0.704,+ "BGE-large-v1.5 (pub)": 0.722,+ "SBERT msmarco": 0.555+ },+ "ourRank": 10,+ "leaderboardLength": 11+}\ No newline at end of filediff --git a/docs/benchmarks/runs/beir-scifact-hybrid-rrf-2026-06-26T22-09-59-496Z.json b/docs/benchmarks/runs/beir-scifact-hybrid-rrf-2026-06-26T22-09-59-496Z.jsonnew file mode 100644index 0000000000..73aeb9ecca--- /dev/null+++ b/docs/benchmarks/runs/beir-scifact-hybrid-rrf-2026-06-26T22-09-59-496Z.json@@ -0,0 +1,2134 @@+{+ "runAt": "2026-06-26T22:09:59.496Z",+ "benchmark": "beir-scifact-hybrid",+ "dataset": "scifact",+ "pipeline": "BM25+BGE RRF",+ "bgeModel": "Xenova/bge-base-en-v1.5",+ "rrfK": 40,+ "rerank": false,+ "queries": 300,+ "corpusSize": 5183,+ "metrics": {+ "ndcg10": 0.6255647791860727,+ "mrr10": 0.5931878306878305,+ "recall10": 0.7412222222222221,+ "recall100": 0.8283333333333334,+ "avgQueryLatencyMs": 447.2806572233334+ },+ "perQuery": [+ {+ "qid": "1",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "3",+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "5",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "13",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "36",+ "ndcg10": 0.23719771276929622,+ "mrr10": 0.2,+ "recall10": 0.5,+ "recall100": 1+ },+ {+ "qid": "42",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "48",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "49",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "50",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "51",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "53",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "54",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "56",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "57",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "70",+ "ndcg10": 0.9197207891481876,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "72",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "75",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "94",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "99",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "100",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "113",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "115",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "118",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "124",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "127",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "128",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "129",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "130",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "132",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "133",+ "ndcg10": 0.6164336326286644,+ "mrr10": 1,+ "recall10": 0.6,+ "recall100": 1+ },+ {+ "qid": "137",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "141",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "142",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "143",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "146",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "148",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "163",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "171",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "179",+ "ndcg10": 0.8048099750039491,+ "mrr10": 1,+ "recall10": 0.75,+ "recall100": 0.75+ },+ {+ "qid": "180",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "183",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "185",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "198",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "208",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "212",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "213",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "216",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "217",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "218",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "219",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "230",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "232",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "233",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "236",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "237",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "238",+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "239",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "248",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "249",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "261",+ "ndcg10": 0.2640681225725909,+ "mrr10": 0.25,+ "recall10": 0.5,+ "recall100": 0.5+ },+ {+ "qid": "268",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "269",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "274",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "275",+ "ndcg10": 0.7039180890341347,+ "mrr10": 1,+ "recall10": 0.6666666666666666,+ "recall100": 1+ },+ {+ "qid": "279",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "294",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "295",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "298",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "300",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "303",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "312",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "314",+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.2,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "324",+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "327",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "338",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "343",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "350",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "354",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "362",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "380",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "384",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "385",+ "ndcg10": 0.6934264036172708,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "386",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "388",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "399",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "410",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "411",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "415",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "421",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "431",+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "436",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "437",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "439",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "440",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "443",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "452",+ "ndcg10": 0.2640681225725909,+ "mrr10": 0.25,+ "recall10": 0.5,+ "recall100": 1+ },+ {+ "qid": "475",+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "478",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "491",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "501",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "502",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "507",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "508",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "513",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "514",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "516",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "517",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "521",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "525",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "527",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "528",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "532",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "533",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "535",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "536",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "539",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "540",+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.5,+ "recall10": 0.5,+ "recall100": 1+ },+ {+ "qid": "544",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "549",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "551",+ "ndcg10": 0.3333333333333333,+ "mrr10": 0.14285714285714285,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "552",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "554",+ "ndcg10": 0.3010299956639812,+ "mrr10": 0.1111111111111111,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "560",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "569",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "575",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "577",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "578",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "587",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "589",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "593",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "597",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "598",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "613",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "619",+ "ndcg10": 0.17723928678404774,+ "mrr10": 0.1,+ "recall10": 0.5,+ "recall100": 1+ },+ {+ "qid": "623",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "628",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "636",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "637",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "641",+ "ndcg10": 0.23719771276929622,+ "mrr10": 0.2,+ "recall10": 0.5,+ "recall100": 0.5+ },+ {+ "qid": "644",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "649",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "659",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "660",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "674",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "684",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "690",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "691",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "692",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "693",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "700",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "702",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "715",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "716",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "718",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "721",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "723",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "727",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "728",+ "ndcg10": 0.8772153153380493,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "729",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "742",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "743",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "744",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "756",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "759",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "768",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "770",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "775",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "781",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "783",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "784",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "785",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "793",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "800",+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.2,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "805",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "808",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "811",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "814",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "820",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "821",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "823",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "830",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "831",+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "832",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "834",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "837",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "839",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "845",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "847",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "852",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "859",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "870",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "873",+ "ndcg10": 0.5043776700708298,+ "mrr10": 0.5,+ "recall10": 0.6,+ "recall100": 1+ },+ {+ "qid": "879",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "880",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "882",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "887",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "903",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "904",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "907",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "911",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "913",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "914",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "921",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "922",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "936",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "956",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "957",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "960",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "967",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "971",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "975",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "982",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "985",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "993",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1012",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1014",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1019",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1020",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1021",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1024",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1029",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1041",+ "ndcg10": 0.39564672360221187,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1049",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1062",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1086",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1088",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1089",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1099",+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1100",+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1104",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1107",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1110",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1121",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1130",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1132",+ "ndcg10": 0.39780880120575696,+ "mrr10": 0.14285714285714285,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1137",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1140",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1144",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1146",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1150",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1163",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1175",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1179",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1180",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1185",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1187",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1191",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1194",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1196",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1197",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1199",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1200",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1202",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1204",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1207",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1213",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1216",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1221",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1225",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1226",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1232",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1241",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1245",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1259",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1262",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1266",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1270",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1271",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1272",+ "ndcg10": 0.3333333333333333,+ "mrr10": 0.14285714285714285,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1273",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1274",+ "ndcg10": 0.9674679834891693,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1278",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1279",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1280",+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1281",+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.2,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1282",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1290",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1292",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1298",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1303",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1316",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1319",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1320",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1332",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 1+ },+ {+ "qid": "1335",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1336",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1337",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1339",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1344",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1352",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1359",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1362",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1363",+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,+ "recall100": 0+ },+ {+ "qid": "1368",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1370",+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1379",+ "ndcg10": 0.8318724637288826,+ "mrr10": 1,+ "recall10": 0.75,+ "recall100": 0.75+ },+ {+ "qid": "1382",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1385",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1389",+ "ndcg10": 1,+ "mrr10": 1,+ "recall10": 1,+ "recall100": 1+ },+ {+ "qid": "1395",+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,+ "recall10": 1,+ "recall100": 1+ }+ ],+ "baselines": {+ "BM25 (Lucene)": 0.679,+ "DocT5query": 0.675,+ "TAS-B": 0.643,+ "GenQ": 0.644,+ "ColBERT": 0.671,+ "Contriever": 0.677,+ "GTR-XL": 0.662,+ "SPLADE++": 0.704,+ "BGE-large-v1.5 (pub)": 0.722,+ "SBERT msmarco": 0.555+ },+ "ourRank": 10,+ "leaderboardLength": 11+}\ No newline at end of filediff --git a/docs/benchmarks/runs/beir-scifact-hybrid-rrf-latest.json b/docs/benchmarks/runs/beir-scifact-hybrid-rrf-latest.jsonindex df78265454..73aeb9ecca 100644--- a/docs/benchmarks/runs/beir-scifact-hybrid-rrf-latest.json+++ b/docs/benchmarks/runs/beir-scifact-hybrid-rrf-latest.json@@ -1,5 +1,5 @@{- "runAt": "2026-06-26T21:58:51.622Z",+ "runAt": "2026-06-26T22:09:59.496Z","benchmark": "beir-scifact-hybrid","dataset": "scifact","pipeline": "BM25+BGE RRF",@@ -9,11 +9,11 @@"queries": 300,"corpusSize": 5183,"metrics": {- "ndcg10": 0.613647793917278,- "mrr10": 0.5780846560846559,- "recall10": 0.7392222222222222,- "recall100": 0.8360000000000001,- "avgQueryLatencyMs": 249.53785805333334+ "ndcg10": 0.6255647791860727,+ "mrr10": 0.5931878306878305,+ "recall10": 0.7412222222222221,+ "recall100": 0.8283333333333334,+ "avgQueryLatencyMs": 447.2806572233334},"perQuery": [{@@ -25,8 +25,8 @@},{"qid": "3",- "ndcg10": 0.43067655807339306,- "mrr10": 0.25,+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,"recall10": 1,"recall100": 1},@@ -46,8 +46,8 @@},{"qid": "36",- "ndcg10": 0.19342640361727081,- "mrr10": 0.125,+ "ndcg10": 0.23719771276929622,+ "mrr10": 0.2,"recall10": 0.5,"recall100": 1},@@ -60,8 +60,8 @@},{"qid": "48",- "ndcg10": 0.5,- "mrr10": 0.3333333333333333,+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,"recall10": 1,"recall100": 1},@@ -95,8 +95,8 @@},{"qid": "54",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -116,7 +116,7 @@},{"qid": "70",- "ndcg10": 1,+ "ndcg10": 0.9197207891481876,"mrr10": 1,"recall10": 1,"recall100": 1@@ -137,8 +137,8 @@},{"qid": "94",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},@@ -151,8 +151,8 @@},{"qid": "100",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},@@ -186,8 +186,8 @@},{"qid": "127",- "ndcg10": 0.43067655807339306,- "mrr10": 0.25,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},@@ -196,7 +196,7 @@"ndcg10": 0,"mrr10": 0,"recall10": 0,- "recall100": 1+ "recall100": 0},{"qid": "129",@@ -221,10 +221,10 @@},{"qid": "133",- "ndcg10": 0.8062079522181139,+ "ndcg10": 0.6164336326286644,"mrr10": 1,- "recall10": 0.8,- "recall100": 0.8+ "recall10": 0.6,+ "recall100": 1},{"qid": "137",@@ -284,7 +284,7 @@},{"qid": "179",- "ndcg10": 0.75369761125927,+ "ndcg10": 0.8048099750039491,"mrr10": 1,"recall10": 0.75,"recall100": 0.75@@ -312,8 +312,8 @@},{"qid": "198",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,"recall10": 1,"recall100": 1},@@ -326,8 +326,8 @@},{"qid": "212",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},@@ -403,9 +403,9 @@},{"qid": "238",- "ndcg10": 0,- "mrr10": 0,- "recall10": 0,+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,+ "recall10": 1,"recall100": 1},{@@ -431,22 +431,22 @@},{"qid": "261",- "ndcg10": 0.3065735963827292,- "mrr10": 0.3333333333333333,+ "ndcg10": 0.2640681225725909,+ "mrr10": 0.25,"recall10": 0.5,"recall100": 0.5},{"qid": "268",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},{"qid": "269",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},@@ -459,7 +459,7 @@},{"qid": "275",- "ndcg10": 0.6508205185601091,+ "ndcg10": 0.7039180890341347,"mrr10": 1,"recall10": 0.6666666666666666,"recall100": 1@@ -473,8 +473,8 @@},{"qid": "294",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},@@ -487,15 +487,15 @@},{"qid": "298",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},{"qid": "300",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},@@ -515,8 +515,8 @@},{"qid": "314",- "ndcg10": 0.5,- "mrr10": 0.3333333333333333,+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.2,"recall10": 1,"recall100": 1},@@ -634,15 +634,15 @@},{"qid": "421",- "ndcg10": 0.3333333333333333,- "mrr10": 0.14285714285714285,- "recall10": 1,+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,"recall100": 1},{"qid": "431",- "ndcg10": 0.3333333333333333,- "mrr10": 0.14285714285714285,+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,"recall10": 1,"recall100": 1},@@ -683,22 +683,22 @@},{"qid": "452",- "ndcg10": 0.3065735963827292,- "mrr10": 0.3333333333333333,+ "ndcg10": 0.2640681225725909,+ "mrr10": 0.25,"recall10": 0.5,"recall100": 1},{"qid": "475",- "ndcg10": 0.38685280723454163,- "mrr10": 0.2,+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,"recall10": 1,"recall100": 1},{"qid": "478",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -732,8 +732,8 @@},{"qid": "508",- "ndcg10": 0.5,- "mrr10": 0.3333333333333333,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},@@ -781,8 +781,8 @@},{"qid": "527",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},@@ -837,8 +837,8 @@},{"qid": "544",- "ndcg10": 0.43067655807339306,- "mrr10": 0.25,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},@@ -865,8 +865,8 @@},{"qid": "554",- "ndcg10": 0.3333333333333333,- "mrr10": 0.14285714285714285,+ "ndcg10": 0.3010299956639812,+ "mrr10": 0.1111111111111111,"recall10": 1,"recall100": 1},@@ -893,8 +893,8 @@},{"qid": "577",- "ndcg10": 0.38685280723454163,- "mrr10": 0.2,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},@@ -907,9 +907,9 @@},{"qid": "587",- "ndcg10": 0.2890648263178879,- "mrr10": 0.1,- "recall10": 1,+ "ndcg10": 0,+ "mrr10": 0,+ "recall10": 0,"recall100": 1},{@@ -949,8 +949,8 @@},{"qid": "619",- "ndcg10": 0.21840743681816419,- "mrr10": 0.16666666666666666,+ "ndcg10": 0.17723928678404774,+ "mrr10": 0.1,"recall10": 0.5,"recall100": 1},@@ -963,8 +963,8 @@},{"qid": "628",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -984,10 +984,10 @@},{"qid": "641",- "ndcg10": 0.3065735963827292,- "mrr10": 0.3333333333333333,+ "ndcg10": 0.23719771276929622,+ "mrr10": 0.2,"recall10": 0.5,- "recall100": 1+ "recall100": 0.5},{"qid": "644",@@ -1033,8 +1033,8 @@},{"qid": "690",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},@@ -1068,15 +1068,15 @@},{"qid": "702",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},{"qid": "715",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},@@ -1117,7 +1117,7 @@},{"qid": "728",- "ndcg10": 0.9197207891481876,+ "ndcg10": 0.8772153153380493,"mrr10": 1,"recall10": 1,"recall100": 1@@ -1145,15 +1145,15 @@},{"qid": "744",- "ndcg10": 0.5,- "mrr10": 0.3333333333333333,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},{"qid": "756",- "ndcg10": 0.5,- "mrr10": 0.3333333333333333,+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,"recall10": 1,"recall100": 1},@@ -1166,8 +1166,8 @@},{"qid": "768",- "ndcg10": 0.38685280723454163,- "mrr10": 0.2,+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,"recall10": 1,"recall100": 1},@@ -1215,16 +1215,16 @@},{"qid": "793",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},{"qid": "800",- "ndcg10": 0,- "mrr10": 0,- "recall10": 0,+ "ndcg10": 0.38685280723454163,+ "mrr10": 0.2,+ "recall10": 1,"recall100": 1},{@@ -1278,8 +1278,8 @@},{"qid": "830",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},@@ -1355,9 +1355,9 @@},{"qid": "873",- "ndcg10": 0.5499483643148054,+ "ndcg10": 0.5043776700708298,"mrr10": 0.5,- "recall10": 0.8,+ "recall10": 0.6,"recall100": 1},{@@ -1418,15 +1418,15 @@},{"qid": "913",- "ndcg10": 0.43067655807339306,- "mrr10": 0.25,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},{"qid": "914",- "ndcg10": 0.43067655807339306,- "mrr10": 0.25,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},@@ -1530,15 +1530,15 @@},{"qid": "1019",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},{"qid": "1020",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -1558,15 +1558,15 @@},{"qid": "1029",- "ndcg10": 0.9674679834891693,+ "ndcg10": 1,"mrr10": 1,"recall10": 1,"recall100": 1},{"qid": "1041",- "ndcg10": 0.42177340954886444,- "mrr10": 0.2,+ "ndcg10": 0.39564672360221187,+ "mrr10": 0.16666666666666666,"recall10": 1,"recall100": 1},@@ -1593,8 +1593,8 @@},{"qid": "1088",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -1607,15 +1607,15 @@},{"qid": "1099",- "ndcg10": 0.31546487678572877,- "mrr10": 0.125,+ "ndcg10": 0.3562071871080222,+ "mrr10": 0.16666666666666666,"recall10": 1,"recall100": 1},{"qid": "1100",- "ndcg10": 0.3010299956639812,- "mrr10": 0.1111111111111111,+ "ndcg10": 0.2890648263178879,+ "mrr10": 0.1,"recall10": 1,"recall100": 1},@@ -1656,9 +1656,9 @@},{"qid": "1132",- "ndcg10": 0,- "mrr10": 0,- "recall10": 0,+ "ndcg10": 0.39780880120575696,+ "mrr10": 0.14285714285714285,+ "recall10": 1,"recall100": 1},{@@ -1719,8 +1719,8 @@},{"qid": "1180",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -1761,8 +1761,8 @@},{"qid": "1197",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -1775,15 +1775,15 @@},{"qid": "1200",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},{"qid": "1202",- "ndcg10": 0.43067655807339306,- "mrr10": 0.25,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -1817,8 +1817,8 @@},{"qid": "1221",- "ndcg10": 0.38685280723454163,- "mrr10": 0.2,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -1845,15 +1845,15 @@},{"qid": "1241",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},{"qid": "1245",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -1915,22 +1915,22 @@},{"qid": "1278",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},{"qid": "1279",- "ndcg10": 0.6309297535714575,- "mrr10": 0.5,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},{"qid": "1280",- "ndcg10": 0.38685280723454163,- "mrr10": 0.2,+ "ndcg10": 0.43067655807339306,+ "mrr10": 0.25,"recall10": 1,"recall100": 1},@@ -1957,8 +1957,8 @@},{"qid": "1292",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},@@ -1971,8 +1971,8 @@},{"qid": "1303",- "ndcg10": 0.5,- "mrr10": 0.3333333333333333,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -2020,8 +2020,8 @@},{"qid": "1337",- "ndcg10": 1,- "mrr10": 1,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1},@@ -2058,7 +2058,7 @@"ndcg10": 0,"mrr10": 0,"recall10": 0,- "recall100": 1+ "recall100": 0},{"qid": "1363",@@ -2069,29 +2069,29 @@},{"qid": "1368",- "ndcg10": 0.3562071871080222,- "mrr10": 0.16666666666666666,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},{"qid": "1370",- "ndcg10": 0.43067655807339306,- "mrr10": 0.25,+ "ndcg10": 0.5,+ "mrr10": 0.3333333333333333,"recall10": 1,"recall100": 1},{"qid": "1379",- "ndcg10": 0.8048099750039491,+ "ndcg10": 0.8318724637288826,"mrr10": 1,"recall10": 0.75,"recall100": 0.75},{"qid": "1382",- "ndcg10": 0.5,- "mrr10": 0.3333333333333333,+ "ndcg10": 1,+ "mrr10": 1,"recall10": 1,"recall100": 1},@@ -2111,8 +2111,8 @@},{"qid": "1395",- "ndcg10": 0.3562071871080222,- "mrr10": 0.16666666666666666,+ "ndcg10": 0.6309297535714575,+ "mrr10": 0.5,"recall10": 1,"recall100": 1}diff --git a/plugins/ruflo-rag-memory/EXAMPLES.md b/plugins/ruflo-rag-memory/EXAMPLES.mdnew file mode 100644index 0000000000..26c8aabbde--- /dev/null+++ b/plugins/ruflo-rag-memory/EXAMPLES.md@@ -0,0 +1,101 @@+# Memory Plugin Examples++## Store and Recall Across Sessions++### Example 1: Remember a Code Pattern++```bash+# Session 1+npx ruflo memory store \+ --key "pattern-concurrent-queue" \+ --value "Use a bounded queue with semaphore for concurrent task processing; limits parallelism safely" \+ --namespace patterns++# Session 2 (next day, different project)+npx ruflo recall "concurrent queue safe processing"+# Returns: "Use a bounded queue with semaphore..."+```++### Example 2: Persist Bug Fixes++```bash+# Session 1: Solved a race condition+npx ruflo memory store \+ --key "fix-race-async-cleanup" \+ --value "Race condition in cleanup: use AbortController to signal cleanup before task dispatch" \+ --namespace solutions \+ --tags "async,cleanup,race"++# Session 2: Hit similar bug+npx ruflo recall "race condition async"+# Gets the fix immediately+```++### Example 3: Agent with Memory Bridge++```javascript+// In a Claude Code agent+async function researchAuthPatterns() {+ // Search cross-session memory+ const findings = await memory_search_unified({+ query: "OAuth2 PKCE refresh token security",+ limit: 5+ });++ // findings[0] might be from a session 3 weeks ago+ console.log(findings[0].value); // Cross-session knowledge!+}+```++## CLI Workflow++```bash+# Store architectural decision+npx ruflo memory store \+ --key "arch-event-sourcing" \+ --value "Event sourcing for user actions; snapshots every 10 events for performance" \+ --namespace patterns++# List all stored patterns+npx ruflo memory list --namespace patterns++# Search by semantic meaning (HNSW, fast!)+npx ruflo memory search --query "event-driven architecture" --namespace patterns++# Retrieve by key+npx ruflo memory retrieve --key "arch-event-sourcing" --namespace patterns++# Delete old entry+npx ruflo memory delete --key "old-pattern" --namespace patterns+```++## Memory Namespaces++Use the right namespace for your intent:++| Namespace | Use For | Example |+|-----------|---------|---------|+| `patterns` | Reusable code/design patterns | Auth flows, caching strategies |+| `solutions` | Bug fixes and workarounds | Race condition fix, memory leak |+| `feedback` | User corrections and notes | "Test style should use beforeEach" |+| `security` | Vulnerability patterns | "SQL injection risk in ORM queries" |+| `tasks` | Task context and outcomes | "API refactor: migrated 8 endpoints" |++## Integration with Auto-Memory Bridge++Claude Code auto-saves session memories to `~/.claude/projects/*/memory/`. Import them into AgentDB:++```bash+# Current project+npx ruflo recall++# All projects+npx ruflo memory bridge --all-projects+```++Then search across them:++```bash+npx ruflo recall "authentication patterns"+# Returns unified results from ALL projects + sessions+```diff --git a/plugins/ruflo-rag-memory/README.md b/plugins/ruflo-rag-memory/README.mdindex 82f27a6029..cb68525a5a 100644--- a/plugins/ruflo-rag-memory/README.md+++ b/plugins/ruflo-rag-memory/README.md@@ -6,6 +6,29 @@ Retrieval-Augmented Generation memory with HNSW vector search, AgentDB persistenProvides semantic store/search/recall over AgentDB with HNSW-indexed vector search (150x-12,500x faster than brute force). Bridges Claude Code's native auto-memory into AgentDB with 384-dim ONNX embeddings for unified cross-session semantic retrieval.+## Quick Start++Store and retrieve knowledge across sessions:++```bash+# Store a pattern you want to remember+npx ruflo memory store --key "oauth-flow" --value "OAuth2 with pkce for SPAs, use refresh tokens" --namespace patterns++# Search for it later (even across projects!)+npx ruflo recall "oauth single page app"++# Retrieve exact entry+npx ruflo memory retrieve --key "oauth-flow" --namespace patterns+```++Use with agents:++```bash+# In your Claude Code agent prompt:+const context = await memory_search({ query: "authentication patterns", limit: 3 });+// Returns top 3 semantic matches from all sessions+```+## Installation```bash