π The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated
TypeScript agentic-aiagentic-frameworkagentic-workflowagentsai-agentsai-assistantai-skillsautonomous-agentsclaudecodexdsh-pluginharnessmcp-servermulti-agentmulti-agent-systemsnpmskillsswarmswarm-intelligencetypescript
feat(router): ADR-389β391 β refresh router helper, opt-in MiniLM embedder, benchmark gate (no default change) (#3410)
rUv82dac70fd785
diff --git a/scripts/audit-env-var-precedence.mjs b/scripts/audit-env-var-precedence.mjsindex 22a9ed35eb..c5755cac6b 100644--- a/scripts/audit-env-var-precedence.mjs+++ b/scripts/audit-env-var-precedence.mjs@@ -82,6 +82,7 @@ const KNOWN_ESCAPE_HATCHES = new Set(['RUFLO_METAHARNESS_SKIP_LOCAL', // plugins/ruflo-metaharness/scripts/_invoke.mjs β CI seam that forces the invoke shim off the local vendored metaharness and onto the pinned-cache resolver. Plugin script has no CLI-flag surface (invoked internally by MCP tools)'RUFLO_HELPERS_LOCKED', // v3.30.0 β env-level opt-out for the .claude/helpers/ auto-refresh (init/helper-refresh.ts). Sibling to the `.LOCKED` marker file; helper-refresh runs from a hook, not a user-typed CLI command β no per-invocation flag surface. See CLAUDE.md "Concurrent-session helper corruption" for rationale'CLAUDE_FLOW_DISABLE_NATIVE_ROUTER', // Test/lock-constrained MCP escape hatch: forces hooks routing onto the deterministic pure-JS backend. The router is process-lifetime state, not owned by one CLI invocation.+ 'CLAUDE_FLOW_ROUTER_EMBEDDER', // ADR-390/391: selects the hooks_route semantic-index embedder (minilm|hash; default hash). Same process-lifetime MCP router state as CLAUDE_FLOW_DISABLE_NATIVE_ROUTER β the index is built once per process, not per CLI invocation; the ADR-391 bench passes the embedder explicitly instead.'RUFLO_FLYWHEEL_ALLOW_BUILTIN_ANCHOR', // Explicit compatibility escape hatch for pre-ADR-331 downstream behavior. Intentionally env-only and visibly unsafe-by-choice; normal CLI/MCP use supplies a project anchor path + hash.// ββ Embedding substrate toggles (3.25.x β opt-in tier + fail-closed ops flag) βdiff --git a/scripts/smoke-helper-signing-security.mjs b/scripts/smoke-helper-signing-security.mjsindex 1e9bc97731..be3ce98163 100644--- a/scripts/smoke-helper-signing-security.mjs+++ b/scripts/smoke-helper-signing-security.mjs@@ -35,7 +35,7 @@ try {mkdirSync(join(fixture, 'scripts'), { recursive: true });mkdirSync(join(fixture, '.claude', 'helpers'), { recursive: true });cpSync(signer, join(fixture, 'scripts', 'sign-helpers.mjs'));- for (const name of ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs']) {+ for (const name of ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs', 'router.js']) {cpSync(join(cli, '.claude', 'helpers', name), join(fixture, '.claude', 'helpers', name));}writeFileSync(join(fixture, 'package.json'), JSON.stringify({ version: '0.0.0-security-test' }));diff --git a/v3/@claude-flow/cli/__tests__/adr-389-router-helper-refresh.test.ts b/v3/@claude-flow/cli/__tests__/adr-389-router-helper-refresh.test.tsnew file mode 100644index 0000000000..99698165c9--- /dev/null+++ b/v3/@claude-flow/cli/__tests__/adr-389-router-helper-refresh.test.ts@@ -0,0 +1,127 @@+/**+ * ADR-389 / #3401 β the keyword router helper must be refreshed on upgrade.+ *+ * `hook-handler.cjs` loads `router.js` from the same helpers dir to label each+ * prompt with a suggested agent. The April-era router matched keywords as+ * SUBSTRINGS ("la*test*" β tester). The word-boundary fix shipped in the+ * package (PR #3402) but never reached existing installs, because `router.js`+ * was not in CRITICAL_HELPERS and `init` skips files that already exist.+ *+ * Like helper-refresh.test.ts, the copy path is exercised against a+ * throwaway-keypair-signed fixture so this suite does not depend on the real+ * manifest being re-signed. The fixture's router.js IS the real package copy,+ * so the test also proves the package ships the fixed router.+ */+import { describe, it, expect } from 'vitest';+import { mkdtempSync, mkdirSync, writeFileSync, readFileSync } from 'node:fs';+import { join, dirname } from 'node:path';+import { tmpdir } from 'node:os';+import { fileURLToPath } from 'node:url';+import { createRequire } from 'node:module';+import { generateKeyPairSync, sign as edSign } from 'node:crypto';++import {+ autoRefreshHelpersIfStale,+ getInstalledCliVersion,+ CRITICAL_HELPERS,+ HELPERS_STAMP_FILE,+} from '../src/init/helper-refresh.js';+import { canonicalManifestBytes, sha256Hex } from '../src/init/helper-signing.js';+import { generateAgentRouter } from '../src/init/helpers-generator.js';++const PKG_HELPERS_DIR = join(dirname(fileURLToPath(import.meta.url)), '..', '.claude', 'helpers');+const PROMPT = 'sync and review latest issues';++// The pre-#2257 router as installed on real machines (dated 2026-04-15):+// plain substring alternations compiled with new RegExp(pattern, 'i').+const STALE_APRIL_ROUTER = `#!/usr/bin/env node+const TASK_PATTERNS = {+ 'implement|create|build|add|write code': 'coder',+ 'test|spec|coverage|unit test|integration': 'tester',+ 'review|audit|check|validate|security': 'reviewer',+ 'research|find|search|documentation|explore': 'researcher',+ 'design|architect|structure|plan': 'architect',+ 'api|endpoint|server|backend|database': 'backend-dev',+ 'ui|frontend|component|react|css|style': 'frontend-dev',+ 'deploy|docker|ci|cd|pipeline|infrastructure': 'devops',+};+function routeTask(task) {+ const taskLower = task.toLowerCase();+ for (const [pattern, agent] of Object.entries(TASK_PATTERNS)) {+ const regex = new RegExp(pattern, 'i');+ if (regex.test(taskLower)) {+ return { agent, confidence: 0.8, reason: 'Matched pattern: ' + pattern };+ }+ }+ return { agent: 'coder', confidence: 0.5, reason: 'Default routing - no specific pattern matched' };+}+module.exports = { routeTask, TASK_PATTERNS };+`;++/** Load a CommonJS router.js fresh (no require cache reuse between loads). */+function loadRouter(file: string): { routeTask: (t: string) => { agent: string; confidence: number } } {+ const req = createRequire(file);+ delete req.cache[req.resolve(file)];+ return req(file);+}++/** Signed source fixture: the real package hook-handler.cjs + router.js. */+function makeSignedSource(version: string): { sourceDir: string; pubkeyPem: string } {+ const sourceDir = mkdtempSync(join(tmpdir(), 'adr389-source-'));+ const files: Record<string, string> = {};+ for (const name of ['hook-handler.cjs', 'router.js']) {+ const content = readFileSync(join(PKG_HELPERS_DIR, name));+ writeFileSync(join(sourceDir, name), content);+ files[name] = sha256Hex(content);+ }+ const { publicKey, privateKey } = generateKeyPairSync('ed25519');+ const manifest = { version, files };+ const signature = edSign(null, canonicalManifestBytes(manifest), privateKey).toString('base64');+ writeFileSync(+ join(sourceDir, 'helpers.manifest.json'),+ JSON.stringify({ manifest, signature, algorithm: 'ed25519' }),+ );+ return { sourceDir, pubkeyPem: publicKey.export({ type: 'spki', format: 'pem' }).toString() };+}++describe('ADR-389 β router.js is a refreshed critical helper', () => {+ it('CRITICAL_HELPERS includes router.js', () => {+ expect(CRITICAL_HELPERS).toContain('router.js');+ });++ it('the stale April router really does misroute the prompt (fixture sanity)', () => {+ const dir = mkdtempSync(join(tmpdir(), 'adr389-stale-'));+ writeFileSync(join(dir, 'router.js'), STALE_APRIL_ROUTER);+ const r = loadRouter(join(dir, 'router.js')).routeTask(PROMPT);+ expect(r.agent).toBe('tester');+ expect(r.confidence).toBe(0.8);+ });++ it('refresh replaces a stale substring router.js with the package copy', async () => {+ const version = getInstalledCliVersion();+ const cwd = mkdtempSync(join(tmpdir(), 'adr389-project-'));+ const helpersDir = join(cwd, '.claude', 'helpers');+ mkdirSync(helpersDir, { recursive: true });+ writeFileSync(join(helpersDir, 'hook-handler.cjs'), '// old hook-handler\n');+ writeFileSync(join(helpersDir, 'router.js'), STALE_APRIL_ROUTER);+ writeFileSync(join(helpersDir, HELPERS_STAMP_FILE), '0.0.1-old');+ const { sourceDir, pubkeyPem } = makeSignedSource(version);++ const res = await autoRefreshHelpersIfStale(cwd, { sourceDirOverride: sourceDir, pubkeyPemOverride: pubkeyPem });+ expect(res.blocked).toBeUndefined();+ expect(res.refreshed).toBe(true);++ const installed = readFileSync(join(helpersDir, 'router.js'));+ expect(sha256Hex(installed)).toBe(sha256Hex(readFileSync(join(PKG_HELPERS_DIR, 'router.js'))));++ const r = loadRouter(join(helpersDir, 'router.js')).routeTask(PROMPT);+ expect(r.agent).not.toBe('tester');+ expect(r.agent).toBe('reviewer');+ });++ it('the generator fallback router (unresolvable package source) is also word-boundary', () => {+ const dir = mkdtempSync(join(tmpdir(), 'adr389-gen-'));+ writeFileSync(join(dir, 'router.js'), generateAgentRouter());+ expect(loadRouter(join(dir, 'router.js')).routeTask(PROMPT).agent).not.toBe('tester');+ });+});diff --git a/v3/@claude-flow/cli/__tests__/adr-390-router-embedder.test.ts b/v3/@claude-flow/cli/__tests__/adr-390-router-embedder.test.tsnew file mode 100644index 0000000000..0596b72600--- /dev/null+++ b/v3/@claude-flow/cli/__tests__/adr-390-router-embedder.test.ts@@ -0,0 +1,229 @@+/**+ * ADR-390 β the semantic router uses the real sentence embedder.+ *+ * London-school: the local embedder (`generateLocalEmbedding`) is mocked so+ * each test pins one collaborator behaviour (onnx / mock backend / throws) and+ * asserts how hooks_route and the router embedder react. The bridge-first+ * `generateEmbedding` is also mocked, and must never be called (#2312).+ *+ * One real (unmocked) test runs only when the MiniLM model is cached locally.+ */+import { describe, it, expect, vi, beforeEach, afterEach } from 'vitest';+import { createRequire } from 'module';+import { execFileSync } from 'child_process';+import { existsSync, readFileSync } from 'fs';+import { dirname, join } from 'path';+import { fileURLToPath, pathToFileURL } from 'url';++vi.mock('../src/memory/memory-initializer.js', async (importOriginal) => ({+ ...(await importOriginal<Record<string, unknown>>()),+ generateLocalEmbedding: vi.fn(),+ generateEmbedding: vi.fn(async () => { throw new Error('bridge-first generateEmbedding must not be called by the router'); }),+}));+// Keep hooks_route on the local path: the AgentDB pre-route answers "nothing".+vi.mock('../src/memory/memory-bridge.js', () => ({ bridgeRouteTask: vi.fn(async () => null) }));++import * as memoryInit from '../src/memory/memory-initializer.js';+import { hooksRoute, routeTaskForBench, resetSemanticRouterForTests } from '../src/mcp-tools/hooks-tools.js';+import {+ DEFAULT_ROUTER_EMBEDDER,+ clearRouterEmbedderCache,+ embedForRouter,+ generateSimpleEmbedding,+ resolveRouterEmbedder,+} from '../src/ruvector/router-embedder.js';++const localEmbed = vi.mocked(memoryInit.generateLocalEmbedding);+const bridgeEmbed = vi.mocked(memoryInit.generateEmbedding);++/** A deterministic "onnx" vector (distinct from the hash so provenance is checkable). */+function fakeOnnx(text: string) {+ const v = Array.from(generateSimpleEmbedding(`onnx::${text}`));+ return { embedding: v, dimensions: 384, model: 'onnx', backend: 'onnx' as const };+}++type RouteOut = { primaryAgent: { type: string }; embedder: string; embedderReason?: string; routing: { method: string } };+const route = (task: string) => hooksRoute.handler({ task }) as Promise<RouteOut>;++const ENV_KEYS = ['CLAUDE_FLOW_ROUTER_EMBEDDER', 'CLAUDE_FLOW_DISABLE_NATIVE_ROUTER', 'CLAUDE_FLOW_ROUTER_TYPESAFE'] as const;+const savedEnv: Record<string, string | undefined> = {};++beforeEach(() => {+ for (const k of ENV_KEYS) savedEnv[k] = process.env[k];+ // Deterministic pure-JS backend (the native VectorDb is required via createRequire, not mockable).+ process.env.CLAUDE_FLOW_DISABLE_NATIVE_ROUTER = '1';+ delete process.env.CLAUDE_FLOW_ROUTER_TYPESAFE;+ delete process.env.CLAUDE_FLOW_ROUTER_EMBEDDER;+ vi.spyOn(console, 'log').mockImplementation(() => {});+ localEmbed.mockReset();+ bridgeEmbed.mockClear();+ clearRouterEmbedderCache();+ resetSemanticRouterForTests();+});++afterEach(() => {+ for (const k of ENV_KEYS) {+ if (savedEnv[k] === undefined) delete process.env[k];+ else process.env[k] = savedEnv[k];+ }+ vi.restoreAllMocks();+});++describe('ADR-390 router embedder selection', () => {+ it('defaults to hash when CLAUDE_FLOW_ROUTER_EMBEDDER is unset, and never loads the model', async () => {+ expect(DEFAULT_ROUTER_EMBEDDER).toBe('hash');+ expect(resolveRouterEmbedder().kind).toBe('hash');++ const out = await route('write unit tests for the auth module');++ expect(out.embedder).toBe('hash');+ expect(out.embedderReason).toBeUndefined();+ expect(localEmbed).not.toHaveBeenCalled();+ expect(bridgeEmbed).not.toHaveBeenCalled();+ });++ it('rejects an unknown env value and falls back to the default with a reason', () => {+ const sel = resolveRouterEmbedder(undefined, { CLAUDE_FLOW_ROUTER_EMBEDDER: 'bert' } as NodeJS.ProcessEnv);+ expect(sel.kind).toBe('hash');+ expect(sel.reason).toMatch(/bert/);+ });+});++describe('ADR-390 MiniLM path', () => {+ it('onnx available: pattern and query vectors come from generateLocalEmbedding; embedder=minilm', async () => {+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';+ localEmbed.mockImplementation(async (t: string) => fakeOnnx(t));++ const task = 'write unit tests for the auth module';+ const out = await route(task);++ expect(out.embedder).toBe('minilm');+ expect(out.embedderReason).toBeUndefined();+ expect(out.routing.method).not.toBe(undefined);+ const texts = localEmbed.mock.calls.map(c => c[0]);+ // patterns (every static keyword) ...+ for (const kw of ['test', 'authentication', 'refactor', 'deploy']) expect(texts).toContain(kw);+ // ... and the query, through the SAME function+ expect(texts).toContain(task);+ expect(bridgeEmbed).not.toHaveBeenCalled();+ });++ it('mock/hash backend: hash on BOTH sides, embedder=hash with a reason', async () => {+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';+ localEmbed.mockImplementation(async () => ({ embedding: new Array(128).fill(0.1), dimensions: 128, model: 'hash-fallback', backend: 'mock' as const }));++ const out = await route('write unit tests for the auth module');++ expect(out.embedder).toBe('hash');+ expect(out.embedderReason).toMatch(/not onnx/);+ // Degradation is decided once at index build: the query is not re-tried on the model.+ expect(localEmbed).toHaveBeenCalledTimes(1);+ expect(bridgeEmbed).not.toHaveBeenCalled();+ });++ it('generateLocalEmbedding throws: hash on both sides, embedder=hash with a reason', async () => {+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';+ localEmbed.mockRejectedValue(new Error('onnx runtime missing'));++ const out = await route('write unit tests for the auth module');++ expect(out.embedder).toBe('hash');+ expect(out.embedderReason).toMatch(/onnx runtime missing/);+ expect(bridgeEmbed).not.toHaveBeenCalled();+ });++ it('a non-384-d onnx vector is rejected (router index is 384-d)', async () => {+ localEmbed.mockImplementation(async () => ({ embedding: new Array(768).fill(0.01), dimensions: 768, model: 'onnx', backend: 'onnx' as const }));+ const res = await embedForRouter(['a', 'b'], 'minilm');+ expect(res.embedder).toBe('hash');+ expect(res.reason).toMatch(/768-d/);+ expect(res.vectors).toHaveLength(2);+ expect(Array.from(res.vectors[0])).toEqual(Array.from(generateSimpleEmbedding('a')));+ });++ it('query fails after a MiniLM index was built: index is rebuilt with hash so spaces never mix', async () => {+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';+ const task = 'profile the slow query';+ localEmbed.mockImplementation(async (t: string) => {+ if (t === task) throw new Error('model evicted');+ return fakeOnnx(t);+ });++ const out = await route(task);++ expect(out.embedder).toBe('hash');+ expect(out.embedderReason).toMatch(/model evicted/);+ });++ it('switching the env embedder rebuilds the index', async () => {+ localEmbed.mockImplementation(async (t: string) => fakeOnnx(t));+ expect((await route('improve test coverage')).embedder).toBe('hash');+ expect(localEmbed).not.toHaveBeenCalled();++ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';+ expect((await route('improve test coverage')).embedder).toBe('minilm');+ expect(localEmbed).toHaveBeenCalled();+ });+});++describe('ADR-390 bench entry', () => {+ it('routeTaskForBench returns the same primary agent hooks_route does, for both embedders', async () => {+ localEmbed.mockImplementation(async (t: string) => fakeOnnx(t));+ const tasks = ['write unit tests for the auth module', 'deploy the service with docker', 'refactor the parser'];+ for (const kind of ['hash', 'minilm'] as const) {+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = kind;+ for (const task of tasks) {+ const viaTool = await route(task);+ const viaBench = await routeTaskForBench(task, { embedder: kind });+ expect(viaBench.embedder).toBe(kind);+ expect(viaBench.primaryAgent).toBe(viaTool.primaryAgent.type);+ }+ }+ expect(bridgeEmbed).not.toHaveBeenCalled();+ });+});++describe('ADR-390 static guard (#2312)', () => {+ it('router-embedder.ts has no call path to the bridge-first generateEmbedding', () => {+ const here = dirname(fileURLToPath(import.meta.url));+ const src = readFileSync(join(here, '../src/ruvector/router-embedder.ts'), 'utf8')+ .split('\n').filter(l => !/^\s*(\*|\/\/|\/\*)/.test(l)).join('\n'); // drop comments+ expect(src).toMatch(/generateLocalEmbedding/);+ expect(src).not.toMatch(/(?<![A-Za-z])generateEmbedding\s*\(/);+ expect(src).not.toMatch(/\{\s*generateEmbedding\s*[,}]/);+ });+});++// ββ Real model (no mocks) βββββββββββββββββββββββββββββββββββββββββββββββββββ+function localMiniLMCached(): boolean {+ const req = createRequire(import.meta.url);+ for (const pkg of ['@huggingface/transformers', '@xenova/transformers']) {+ try {+ let dir = dirname(req.resolve(pkg));+ for (let i = 0; i < 4 && !existsSync(join(dir, 'package.json')); i++) dir = dirname(dir);+ if (existsSync(join(dir, '.cache', 'Xenova', 'all-MiniLM-L6-v2'))) return true;+ } catch { /* not installed */ }+ }+ return false;+}++// The real model runs in a plain `node` child against the built dist: inside the+// vitest worker the transformers pipeline does not initialise and the local+// chain reports backend 'mock' (observed), which would test the harness, not+// the router. Skips unless both the model cache and dist exist.+const distHooks = join(dirname(fileURLToPath(import.meta.url)), '../dist/src/mcp-tools/hooks-tools.js');++describe.skipIf(!localMiniLMCached() || !existsSync(distHooks))('ADR-390 real MiniLM (runs only when the model is cached locally)', () => {+ it('routes "write unit tests for the auth module" to tester with embedder=minilm', () => {+ const script = `import(${JSON.stringify(pathToFileURL(distHooks).href)}).then(async (h) => {+ const r = await h.routeTaskForBench('write unit tests for the auth module', { embedder: 'minilm' });+ process.stdout.write('\\nRESULT=' + JSON.stringify(r) + '\\n');+ });`;+ const stdout = execFileSync(process.execPath, ['-e', script], { encoding: 'utf8', timeout: 110_000, env: { ...process.env, CLAUDE_FLOW_ROUTER_TYPESAFE: '' } });+ const line = stdout.split('\n').find(l => l.startsWith('RESULT='));+ expect(line, stdout).toBeDefined();+ const out = JSON.parse(line!.slice('RESULT='.length));+ expect(out.embedder, out.embedderReason).toBe('minilm');+ expect(out.primaryAgent).toBe('tester');+ }, 120_000);+});diff --git a/v3/@claude-flow/cli/__tests__/typesafe-router.test.ts b/v3/@claude-flow/cli/__tests__/typesafe-router.test.tsindex a4a26f570e..92004fe1ce 100644--- a/v3/@claude-flow/cli/__tests__/typesafe-router.test.ts+++ b/v3/@claude-flow/cli/__tests__/typesafe-router.test.ts@@ -193,7 +193,10 @@ describe.skipIf(!realModule)('typesafe-router: real @ruvector/typesafe (hash embexpect(out.primaryAgent).toEqual(LEGACY.primaryAgent);});- it('(e) hooks_route end to end: the "latest"βtester keyword misroute is overridden to researcher', async () => {+ // Since #3402 the keyword fallback matches whole words, so it no longer+ // routes "latest" to tester; the legacy pick is whatever the local router+ // returns now. What this test guards is the typesafe override itself.+ it('(e) hooks_route end to end: typesafe routes "sync and review latest issues" to researcher, legacy kept as fallback', async () => {process.env.CLAUDE_FLOW_ROUTER_TYPESAFE = '1';try {const { hooksRoute } = await import('../src/mcp-tools/hooks-tools.js');@@ -201,7 +204,9 @@ describe.skipIf(!realModule)('typesafe-router: real @ruvector/typesafe (hash embexpect(res.routedBy).toBe('typesafe');expect((res.primaryAgent as Record<string, unknown>).type).toBe('researcher');expect((res.primaryAgent as Record<string, unknown>).confidenceCalibrated).toBe(false);- expect((res.fallbackRoute as Record<string, unknown>).agent).toBe('tester');+ const fallback = res.fallbackRoute as Record<string, unknown>;+ expect(typeof fallback.agent).toBe('string');+ expect(fallback.agent).not.toBe('researcher');} finally {delete process.env.CLAUDE_FLOW_ROUTER_TYPESAFE;}diff --git a/v3/@claude-flow/cli/benchmarks/router/README.md b/v3/@claude-flow/cli/benchmarks/router/README.mdnew file mode 100644index 0000000000..e75f9f1f87--- /dev/null+++ b/v3/@claude-flow/cli/benchmarks/router/README.md@@ -0,0 +1,116 @@+# Router evaluation corpus (ADR-391)++`corpus.jsonl` is the labelled, frozen evaluation set that ADR-391 uses to+compare agent-routing candidates (A current, B MiniLM, C typesafe-hash,+D typesafe-onnx). It contains 197 prompts, each labelled with the one agent a+competent engineering lead would assign.++**Frozen at sha256 `b0c1923b2813b61907304dff56c53d199b709797bfb9600a7c1f496cf0c0bf04`.**+Any edit to `corpus.jsonl` changes this hash. A changed corpus is a new corpus:+earlier receipts don't carry over to it.++## Line format++```json+{"id":"r001","prompt":"...","label":"researcher","split":"dev","trap":false,"source":"issue","note":"why this label"}+```++- `source`: `issue` or `pr` means the prompt paraphrases a real ruflo issue or PR+ title into how a developer would ask for it. `synthetic` means the labeller+ wrote it.+- `trap: true` marks an adversarial case, where a naive keyword match points to+ the wrong agent. Examples: "review the latest issues" is `researcher`,+ "update the test fixtures for the auth API" is `tester`, and "run the+ benchmark" is `performance-engineer`.++## Labels++| label | primary work |+|---|---|+| `coder` | implement a feature or change, fix a bug, write code |+| `tester` | write, extend or fix tests; coverage; test strategy |+| `reviewer` | review a PR, diff or code for quality or correctness |+| `researcher` | investigate, look up, compare, summarise, triage; explain how existing code or issues work |+| `architect` | design, ADRs, API or schema design, module boundaries, refactor planning |+| `security-architect` | security review, vulnerabilities, auth hardening, threat modelling, CVEs |+| `performance-engineer` | profiling, latency and throughput, benchmarks, optimisation |+| `devops` | CI/CD, deploy, Docker, release pipelines, infrastructure |+| `swarm-specialist` | multi-agent, swarm or hive-mind orchestration and coordination |+| `memory-specialist` | memory store, vector index, embeddings, AgentDB, HNSW |+| `none` | not an engineering task: chit-chat, thanks, vague one-word asks, non-software requests |++Tie-break rules, applied the same way to every prompt:++- **Specialist vs `coder`.** A specialist label wins only when the work sits+ squarely in that domain and needs its expertise, such as memory-store+ persistence, HNSW or embeddings internals, auth exposure, or agent coordination.+ When the domain is incidental, the label is `coder`. A wrong exit code in the+ `memory` command, or a hiveId that is never saved, are both `coder`.+- **`reviewer` vs `researcher`.** Reviewing a PR, diff or code is `reviewer`.+ Reading issues, changelogs or docs to report back is `researcher`, even when+ the prompt says "review".+- **Mixed intent.** The label is the primary ask. For example, "profile X" is+ performance work even when X is the memory store. The `note` field says why.++Prompts that two reasonable leads could label differently were rewritten or+dropped.++## Split rule++The split is deterministic and stratified by label. Within each label, sort+rows by `id`. The row at 0-indexed position `i` goes to `dev` if `i % 5` is 0+or 2, and to `test` otherwise. `validate-corpus.mjs` recomputes this rule and+fails if any row disagrees.++- **`dev`** is for tuning thresholds.+- **`test`** decides promotion. Each candidate runs on it once.++Ids were assigned after a seeded shuffle, so they don't encode the label.++## Counts++| label | dev | test | total | traps |+|---|---|---|---|---|+| coder | 12 | 16 | 28 | 12 |+| tester | 8 | 10 | 18 | 10 |+| reviewer | 6 | 9 | 15 | 4 |+| researcher | 10 | 15 | 25 | 11 |+| architect | 7 | 9 | 16 | 3 |+| security-architect | 7 | 9 | 16 | 5 |+| performance-engineer | 7 | 9 | 16 | 5 |+| devops | 7 | 9 | 16 | 3 |+| swarm-specialist | 6 | 7 | 13 | 6 |+| memory-specialist | 6 | 9 | 15 | 3 |+| none | 8 | 11 | 19 | 2 |+| **total** | **84** | **113** | **197** | **64** |++## Blindness rule++The labeller never saw any router's output. No router was run while the corpus+was built: not `hooks route`, `hooks_route`, `router.js`/`router.cjs`, or+typesafe. The labeller also didn't read the router keyword/pattern tables+(`TASK_PATTERNS` in `hooks-tools.ts`, `typesafe-router.ts`) or any routing test+tables. Labels reflect only what the prompt asks for. That independence is what+makes the corpus a fair benchmark, so keep it when extending or relabelling:+whoever labels must not look at router output first.++## Validate++```bash+node validate-corpus.mjs # defaults to ./corpus.jsonl+```++The validator uses no dependencies. It checks:++- every line is valid JSON+- ids are unique and match `r\d{3}`+- no prompt appears twice+- each label is in the set above+- each split is `dev` or `test`, and matches the split rule+- `trap` is a boolean+- `source` is `issue`, `pr` or `synthetic`+- the total is 180β200+- every label except `none` has at least 8 rows, and `none` has 15β20+- there are at least 30 traps++It prints the counts table above and the file's sha256.diff --git a/v3/@claude-flow/cli/benchmarks/router/corpus.jsonl b/v3/@claude-flow/cli/benchmarks/router/corpus.jsonlnew file mode 100644index 0000000000..dd38b692a5--- /dev/null+++ b/v3/@claude-flow/cli/benchmarks/router/corpus.jsonl@@ -0,0 +1,197 @@+{"id":"r001","prompt":"the secret-scanner regex misses common real key formats, which patterns should it catch?","label":"security-architect","split":"dev","trap":false,"source":"issue","note":"secret detection coverage"}+{"id":"r002","prompt":"catch me up on what changed in 3.43.0","label":"researcher","split":"dev","trap":false,"source":"pr","note":"summarise changes"}+{"id":"r003","prompt":"native builds fail on the windows-latest runner, pin the runner image","label":"devops","split":"dev","trap":false,"source":"issue","note":"CI"}+{"id":"r004","prompt":"set up RaBitQ quantization for the vector index","label":"memory-specialist","split":"dev","trap":false,"source":"synthetic","note":"vector quantization"}+{"id":"r005","prompt":"cut allocations in the JSONL parser, it is dominating GC","label":"performance-engineer","split":"dev","trap":false,"source":"synthetic","note":"optimisation"}+{"id":"r006","prompt":"memory_import_claude cuts sections off at 4096 chars","label":"memory-specialist","split":"test","trap":false,"source":"issue","note":"memory import"}+{"id":"r007","prompt":"fix teh off-by-one in the date bucketing of cost-burn","label":"coder","split":"dev","trap":false,"source":"synthetic","note":"bug fix (typo intentional)"}+{"id":"r008","prompt":"add a regression test that pins statusline --json stdout purity","label":"tester","split":"dev","trap":false,"source":"pr","note":"write a regression test"}+{"id":"r009","prompt":"make `ruflo doctor` print a hint when node is older than 20","label":"coder","split":"test","trap":false,"source":"synthetic","note":"small feature"}+{"id":"r010","prompt":"the author field is missing in the prefix list","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"a data/code omission to fix; \"prefix list\" is not a memory/search task"}+{"id":"r011","prompt":"run a security scan on the new plugin before we publish it","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"security scan"}+{"id":"r012","prompt":"how do plugins get registered with the MCP server?","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"how does X work"}+{"id":"r013","prompt":"do the thing","label":"none","split":"dev","trap":false,"source":"synthetic","note":"vague, no identifiable task"}+{"id":"r014","prompt":"good morning","label":"none","split":"test","trap":false,"source":"synthetic","note":"greeting"}+{"id":"r015","prompt":"pnpm-lock.yaml drifted and every frozen-lockfile CI job fails","label":"devops","split":"test","trap":false,"source":"issue","note":"CI/lockfile"}+{"id":"r016","prompt":"summarise the open Dream Cycle issues from this week","label":"researcher","split":"dev","trap":false,"source":"issue","note":"summarise"}+{"id":"r017","prompt":"is this patch idiomatic TypeScript? pasting it below","label":"reviewer","split":"dev","trap":false,"source":"synthetic","note":"code quality review"}+{"id":"r018","prompt":"launch a multi-agent team to triage all open issues in parallel","label":"swarm-specialist","split":"dev","trap":true,"source":"synthetic","note":"the ask is launching the team"}+{"id":"r019","prompt":"import my Claude Code memories into AgentDB","label":"memory-specialist","split":"dev","trap":false,"source":"synthetic","note":"AgentDB import"}+{"id":"r020","prompt":"consolidate duplicate memory entries across namespaces","label":"memory-specialist","split":"test","trap":false,"source":"synthetic","note":"memory consolidation"}+{"id":"r021","prompt":"write up an ADR on versioning policy for MCP tool signatures","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"ADR"}+{"id":"r022","prompt":"can you look over my diff before I push? mainly correctness","label":"reviewer","split":"test","trap":false,"source":"synthetic","note":"diff review"}+{"id":"r023","prompt":"review the swarm topology PR before we merge it","label":"reviewer","split":"dev","trap":true,"source":"synthetic","note":"PR review; swarm is the subject"}+{"id":"r024","prompt":"lol","label":"none","split":"dev","trap":false,"source":"synthetic","note":"chit-chat"}+{"id":"r025","prompt":"remind me to call mom at 5","label":"none","split":"test","trap":false,"source":"synthetic","note":"non-software"}+{"id":"r026","prompt":"run a byzantine consensus vote among the reviewer agents","label":"swarm-specialist","split":"test","trap":true,"source":"synthetic","note":"consensus orchestration, not code review"}+{"id":"r027","prompt":"plan the refactor of commands/ into bounded contexts","label":"architect","split":"test","trap":false,"source":"synthetic","note":"refactor planning"}+{"id":"r028","prompt":"add london-school mocks for the AgentDB controller in the hooks tests","label":"tester","split":"test","trap":true,"source":"synthetic","note":"mocking in tests, not AgentDB work"}+{"id":"r029","prompt":"design the REST API for the gateway invites endpoint","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"API design"}+{"id":"r030","prompt":"design the data model for the swarm state store","label":"architect","split":"test","trap":true,"source":"synthetic","note":"data model design; swarm is the subject"}+{"id":"r031","prompt":"autopilot accepts task sources that are not valid, reject them","label":"coder","split":"test","trap":false,"source":"pr","note":"input handling fix"}+{"id":"r032","prompt":"give me a review of the diff on the feat/adr-390-minilm-router branch","label":"reviewer","split":"test","trap":false,"source":"synthetic","note":"branch diff review"}+{"id":"r033","prompt":"config_set writes under a `values` envelope that the daemon reader never unwraps. make the reader handle it","label":"coder","split":"test","trap":false,"source":"issue","note":"bug fix in config reader"}+{"id":"r034","prompt":"bump node in CI to 24","label":"devops","split":"dev","trap":false,"source":"synthetic","note":"CI"}+{"id":"r035","prompt":"list every place the CLI calls process.exit","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"code search"}+{"id":"r036","prompt":"review the PR for security problems, it touches token handling","label":"security-architect","split":"dev","trap":true,"source":"synthetic","note":"security review is primary, not general code review"}+{"id":"r037","prompt":"entries from one tenant might be readable by another in the memory store, investigate the isolation","label":"security-architect","split":"test","trap":true,"source":"synthetic","note":"cross-tenant exposure is a security question"}+{"id":"r038","prompt":"npm audit flags a critical protobufjs issue through agentdb, figure out the remediation path","label":"security-architect","split":"test","trap":true,"source":"issue","note":"CVE remediation; agentdb is only the dependency chain"}+{"id":"r039","prompt":"the loadEd25519 error message mentions an env var the function never reads β fix the message","label":"coder","split":"dev","trap":false,"source":"issue","note":"fix an incorrect error string"}+{"id":"r040","prompt":"write a failing test that reproduces the secret-scanner false negative before anyone fixes it","label":"tester","split":"dev","trap":true,"source":"synthetic","note":"reproduction test; the security fix is someone else's task"}+{"id":"r041","prompt":"profile ruflo cold start, it takes 2s","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"profiling"}+{"id":"r042","prompt":"why does swarm status always say 0 agents? figure out which stores spawn and list use β just report, no fix","label":"researcher","split":"test","trap":true,"source":"issue","note":"investigation only"}+{"id":"r043","prompt":"MMR reranking re-tokenizes every candidate on each call, optimise that","label":"performance-engineer","split":"dev","trap":false,"source":"pr","note":"optimisation"}+{"id":"r044","prompt":"check my refactor did not change behaviour, diff attached","label":"reviewer","split":"test","trap":false,"source":"synthetic","note":"behaviour-preservation review"}+{"id":"r045","prompt":"agents can inject instructions into each other β threat model cross-agent contagion","label":"security-architect","split":"dev","trap":true,"source":"issue","note":"threat model; swarm is the setting"}+{"id":"r046","prompt":"optimise the hot loop in the cosine similarity function","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"optimisation"}+{"id":"r047","prompt":"spin up a swarm of 5 agents to refactor the hooks package","label":"swarm-specialist","split":"dev","trap":true,"source":"synthetic","note":"the ask is to set up the multi-agent run"}+{"id":"r048","prompt":"what does embeddings init actually download?","label":"researcher","split":"dev","trap":true,"source":"issue","note":"understand existing behaviour"}+{"id":"r049","prompt":"check recall@10 of the vector index after re-embedding everything","label":"memory-specialist","split":"test","trap":true,"source":"synthetic","note":"index quality, not a test suite or latency task"}+{"id":"r050","prompt":"fix the failing vitest snapshot in the doctor command tests","label":"tester","split":"test","trap":false,"source":"synthetic","note":"test maintenance"}+{"id":"r051","prompt":"harden the MCP server against prompt injection coming back in tool results","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"hardening"}+{"id":"r052","prompt":"increase test coverage for the memory bridge search path","label":"tester","split":"test","trap":true,"source":"synthetic","note":"coverage work; memory is only the subject under test"}+{"id":"r053","prompt":"code review the memory bridge PR β is the WAL handle release right?","label":"reviewer","split":"dev","trap":true,"source":"pr","note":"reviewing a PR; memory is the subject"}+{"id":"r054","prompt":"review the latest issues","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"reading and triaging issues, not a code review"}+{"id":"r055","prompt":"review this change to the policy lock handling for correctness under concurrent callers","label":"reviewer","split":"test","trap":false,"source":"issue","note":"code review for correctness"}+{"id":"r056","prompt":"go through the stale issues and tell me which are already fixed on main","label":"researcher","split":"dev","trap":false,"source":"issue","note":"triage"}+{"id":"r057","prompt":"fast-uri has a CVE, are we affected?","label":"security-architect","split":"dev","trap":false,"source":"pr","note":"CVE triage"}+{"id":"r058","prompt":"codex exec hangs forever because the dual-mode orchestrator never closes the worker stdin","label":"coder","split":"test","trap":true,"source":"issue","note":"process-handling bug; \"orchestrator\" is a class name, not swarm work"}+{"id":"r059","prompt":"review PR #3406","label":"reviewer","split":"dev","trap":false,"source":"pr","note":"PR review"}+{"id":"r060","prompt":"design a namespace scheme for storing agent patterns in AgentDB","label":"memory-specialist","split":"dev","trap":true,"source":"synthetic","note":"memory layout within AgentDB, not system architecture"}+{"id":"r061","prompt":"memory_search takes 900ms on 50k entries, profile it and find where the time goes","label":"performance-engineer","split":"test","trap":true,"source":"synthetic","note":"latency profiling; memory is the subject"}+{"id":"r062","prompt":"find where the daemon reads config.json","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"locate code"}+{"id":"r063","prompt":"tune HNSW efSearch and M for our 20k-entry memory","label":"memory-specialist","split":"test","trap":false,"source":"synthetic","note":"HNSW tuning"}+{"id":"r064","prompt":"write me a haiku about autumn","label":"none","split":"test","trap":false,"source":"synthetic","note":"non-software"}+{"id":"r065","prompt":"write a function that parses ADR front-matter into a typed object","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"write code; ADR is the input format, not an architecture task"}+{"id":"r066","prompt":"plan the migration from the v2 config format to v3 without breaking existing users","label":"architect","split":"test","trap":false,"source":"synthetic","note":"migration design"}+{"id":"r067","prompt":"design the event schema for task lifecycle event sourcing","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"schema design"}+{"id":"r068","prompt":"the smoke job times out during npm install behind the proxy","label":"devops","split":"test","trap":false,"source":"issue","note":"CI infrastructure"}+{"id":"r069","prompt":"--provider and --model on agent spawn are ignored at execution time, wire them through","label":"coder","split":"test","trap":true,"source":"issue","note":"plumbing bug; \"agent spawn\" does not make it coordination work"}+{"id":"r070","prompt":"how do the deploy paths for the api, website and meta-llm repos differ?","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"explain; not performing a deploy"}+{"id":"r071","prompt":"the swarm lifecycle test runs against source instead of the built CLI, guard it on dist","label":"tester","split":"dev","trap":true,"source":"pr","note":"test harness fix"}+{"id":"r072","prompt":"compare sql.js and better-sqlite3 β tradeoffs for a CLI that runs on Windows and Android","label":"researcher","split":"dev","trap":false,"source":"issue","note":"compare options"}+{"id":"r073","prompt":"set up a staging environment on fly","label":"devops","split":"test","trap":false,"source":"synthetic","note":"infrastructure"}+{"id":"r074","prompt":"do a code review pass on src/commands/doctor.ts","label":"reviewer","split":"test","trap":false,"source":"synthetic","note":"code review"}+{"id":"r075","prompt":"hooks statusline --json writes [WARN] lines to stdout and breaks JSON parsers, send them to stderr","label":"coder","split":"test","trap":false,"source":"issue","note":"output-stream bug fix"}+{"id":"r076","prompt":"implement the scaffold-drift fix described in ADR-382 in the init command","label":"coder","split":"dev","trap":true,"source":"pr","note":"implementation of an already-decided ADR"}+{"id":"r077","prompt":"review the test changes in #3403 β are the assertions actually meaningful?","label":"reviewer","split":"test","trap":true,"source":"pr","note":"reviewing test code, not writing tests"}+{"id":"r078","prompt":"check the plugin installer for path traversal","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"vulnerability check"}+{"id":"r079","prompt":"second pair of eyes on the typesafe router integration PR please","label":"reviewer","split":"dev","trap":false,"source":"pr","note":"PR review"}+{"id":"r080","prompt":"config.instructions is not being passed as the system prompt fallback in agent-execute-core","label":"coder","split":"test","trap":false,"source":"issue","note":"bug fix"}+{"id":"r081","prompt":"tell me a joke","label":"none","split":"dev","trap":false,"source":"synthetic","note":"chit-chat"}+{"id":"r082","prompt":"why is the MCP server at 1.2GB RSS after an hour?","label":"performance-engineer","split":"dev","trap":true,"source":"synthetic","note":"process memory/leak profiling, not the memory store"}+{"id":"r083","prompt":"thanks, that fixed the test","label":"none","split":"test","trap":true,"source":"synthetic","note":"acknowledgement containing engineering words"}+{"id":"r084","prompt":"throughput drops when 8 agents write at once, find where the time is spent","label":"performance-engineer","split":"test","trap":true,"source":"synthetic","note":"throughput profiling, not coordination"}+{"id":"r085","prompt":"audit the auth middleware for session fixation","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"auth security audit"}+{"id":"r086","prompt":"there are no tests for the percentile math in the benchmark harness, add some","label":"tester","split":"test","trap":true,"source":"synthetic","note":"write tests; not a performance measurement"}+{"id":"r087","prompt":"running the CLI test suite edits my real ~/.claude/CLAUDE.md β isolate HOME in those tests","label":"tester","split":"dev","trap":false,"source":"issue","note":"test isolation fix"}+{"id":"r088","prompt":"test whether the deploy works","label":"devops","split":"dev","trap":true,"source":"synthetic","note":"deployment verification, not test authoring"}+{"id":"r089","prompt":"propose module boundaries for the hooks package, it has turned into a grab bag","label":"architect","split":"test","trap":false,"source":"synthetic","note":"module boundaries"}+{"id":"r090","prompt":"?","label":"none","split":"dev","trap":false,"source":"synthetic","note":"no content"}+{"id":"r091","prompt":"explain the ADR-150 AND-gate to me","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"explain an existing decision"}+{"id":"r092","prompt":"migrate the entries in memory.db into agentdb-memory.db","label":"memory-specialist","split":"dev","trap":false,"source":"issue","note":"memory store migration"}+{"id":"r093","prompt":"the swarm drifts off task after 20 minutes, tune the coordination so agents stay on track","label":"swarm-specialist","split":"test","trap":false,"source":"synthetic","note":"anti-drift coordination"}+{"id":"r094","prompt":"the performance tab crashes when there are no metrics yet, pls add the null check","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"null-check crash fix; not an optimisation task"}+{"id":"r095","prompt":"read issue #3327 and explain Finding A to me","label":"researcher","split":"dev","trap":false,"source":"issue","note":"read and explain an issue"}+{"id":"r096","prompt":"add property-based tests for the semver range checker","label":"tester","split":"test","trap":false,"source":"synthetic","note":"write tests"}+{"id":"r097","prompt":"never mind","label":"none","split":"test","trap":false,"source":"synthetic","note":"no task"}+{"id":"r098","prompt":"threat model the x-gateway relay","label":"security-architect","split":"dev","trap":false,"source":"pr","note":"threat modelling"}+{"id":"r099","prompt":"how does hooks post-task decide what to record?","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"how does X work"}+{"id":"r100","prompt":"compare cold and warm latency of the four router candidates","label":"performance-engineer","split":"dev","trap":false,"source":"synthetic","note":"latency benchmarking"}+{"id":"r101","prompt":"mock the embeddings provider so the unit tests stop downloading a model","label":"tester","split":"test","trap":true,"source":"synthetic","note":"test isolation; not embedding work"}+{"id":"r102","prompt":"does init carry untrusted hooks and allow-rules forward on upgrade? security review it","label":"security-architect","split":"test","trap":false,"source":"issue","note":"security review"}+{"id":"r103","prompt":"review what is in the patterns namespace and dedupe it","label":"memory-specialist","split":"test","trap":true,"source":"synthetic","note":"memory curation, not code review"}+{"id":"r104","prompt":"who won the game last night","label":"none","split":"test","trap":false,"source":"synthetic","note":"non-software"}+{"id":"r105","prompt":"great review, cheers","label":"none","split":"dev","trap":true,"source":"synthetic","note":"acknowledgement containing \"review\""}+{"id":"r106","prompt":"stuff","label":"none","split":"test","trap":false,"source":"synthetic","note":"vague one-word"}+{"id":"r107","prompt":"the quantization recall test is flaky on unseeded random vectors, seed it so it is deterministic","label":"tester","split":"dev","trap":true,"source":"issue","note":"fixing a flaky test, not tuning quantization"}+{"id":"r108","prompt":"can you recommend a good pizza place in toronto","label":"none","split":"dev","trap":false,"source":"synthetic","note":"non-software"}+{"id":"r109","prompt":"how should the plugin manifest v2 be structured so it stays backwards compatible?","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"format/API design"}+{"id":"r110","prompt":"can u write tests for the new parser","label":"tester","split":"test","trap":false,"source":"synthetic","note":"write tests"}+{"id":"r111","prompt":"what is NIP-98 and how does the relay use it? short summary pls","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"explain a spec"}+{"id":"r112","prompt":"draft an ADR: typesafe as a tie-break second opinion behind the default router","label":"architect","split":"test","trap":false,"source":"synthetic","note":"ADR"}+{"id":"r113","prompt":"init reads kebab-case flag keys but the parser gives camelCase, so --all-agents is always undefined. fix it","label":"coder","split":"test","trap":false,"source":"issue","note":"straightforward bug fix"}+{"id":"r114","prompt":"what methodology does the intelligence-system audit doc use for its benchmark numbers?","label":"researcher","split":"dev","trap":true,"source":"synthetic","note":"read and explain a doc; not running a benchmark"}+{"id":"r115","prompt":"add a config option uing camelCase for the daemon idle timeout","label":"coder","split":"test","trap":false,"source":"synthetic","note":"small feature (typo intentional)"}+{"id":"r116","prompt":"thanks!","label":"none","split":"test","trap":false,"source":"synthetic","note":"acknowledgement"}+{"id":"r117","prompt":"refactor the parseArgs helper to get rid of the duplicated switch statement","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"local code change, not refactor planning"}+{"id":"r118","prompt":"configure dependabot to group minor bumps","label":"devops","split":"test","trap":false,"source":"pr","note":"repo automation"}+{"id":"r119","prompt":"add a GitHub Actions job that re-runs the router bench when hooks_route changes","label":"devops","split":"dev","trap":true,"source":"synthetic","note":"CI job setup; the bench already exists"}+{"id":"r120","prompt":"implement retry for transient rename failures in writeJsonAtomic and never leave the temp file behind","label":"coder","split":"test","trap":false,"source":"pr","note":"implement a behaviour change"}+{"id":"r121","prompt":"add test cases for the ADR index rebuild when a source file was deleted","label":"tester","split":"dev","trap":true,"source":"issue","note":"test cases; ADR is the subject"}+{"id":"r122","prompt":"design the schema for the router benchmark receipts","label":"architect","split":"test","trap":false,"source":"synthetic","note":"schema design"}+{"id":"r123","prompt":"docker build cache is filling the disk on the build box, prune it safely","label":"devops","split":"test","trap":false,"source":"synthetic","note":"infrastructure"}+{"id":"r124","prompt":"add e2e tests for `ruflo init --dual`","label":"tester","split":"test","trap":false,"source":"synthetic","note":"write tests"}+{"id":"r125","prompt":"run three researchers in parallel and merge their findings","label":"swarm-specialist","split":"test","trap":true,"source":"synthetic","note":"orchestrating agents, not doing research"}+{"id":"r126","prompt":"our cold-start benchmark measured setTimeout, not the CLI β fix the measurement so the numbers are real","label":"performance-engineer","split":"test","trap":false,"source":"issue","note":"benchmark correctness"}+{"id":"r127","prompt":"add a --json flag to `ruflo swarm status`","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"small CLI feature; swarm is only the command name"}+{"id":"r128","prompt":"benchmark the three kernel backends and compare throughput","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"benchmarking"}+{"id":"r129","prompt":"sketch an architecture for an embeddings cache β design only, no code yet","label":"architect","split":"dev","trap":true,"source":"synthetic","note":"design, not memory tuning or perf work"}+{"id":"r130","prompt":"run the benchmark","label":"performance-engineer","split":"dev","trap":true,"source":"synthetic","note":"running a benchmark is perf work, not CI/devops"}+{"id":"r131","prompt":"set up a pipeline where the architect agent hands to the coder agent, which hands to the tester agent","label":"swarm-specialist","split":"dev","trap":true,"source":"synthetic","note":"multi-agent pipeline wiring"}+{"id":"r132","prompt":"two agents are idle and one is overloaded, rebalance the swarm","label":"swarm-specialist","split":"test","trap":false,"source":"synthetic","note":"load balancing across agents"}+{"id":"r133","prompt":"publish 3.43.1 to npm and update the dist-tags","label":"devops","split":"test","trap":false,"source":"synthetic","note":"release"}+{"id":"r134","prompt":"the deploy script has zero test coverage β write tests for its argument parsing","label":"tester","split":"test","trap":true,"source":"synthetic","note":"unit tests for a script, not deployment"}+{"id":"r135","prompt":"set up a mesh of agents across two machines over federation","label":"swarm-specialist","split":"dev","trap":false,"source":"synthetic","note":"cross-machine agent coordination"}+{"id":"r136","prompt":"test whether the executor endpoint can be reached without auth","label":"security-architect","split":"dev","trap":true,"source":"synthetic","note":"probing an auth boundary, not writing tests"}+{"id":"r137","prompt":"memory delete leaves the vector in the search index β clean up the orphaned vectors","label":"memory-specialist","split":"test","trap":false,"source":"issue","note":"vector index maintenance"}+{"id":"r138","prompt":"which topology fits 12 agents doing independent benchmark runs?","label":"swarm-specialist","split":"test","trap":true,"source":"synthetic","note":"topology choice, not benchmarking"}+{"id":"r139","prompt":"update the test fixtures for the auth API","label":"tester","split":"dev","trap":true,"source":"synthetic","note":"fixture maintenance is test work, not security"}+{"id":"r140","prompt":"the design doc says the audit-list tool takes --since but it does not, add it","label":"coder","split":"test","trap":true,"source":"synthetic","note":"implement a missing flag; the design already exists"}+{"id":"r141","prompt":"tag v3.43.0 and create the GitHub release","label":"devops","split":"dev","trap":false,"source":"synthetic","note":"release"}+{"id":"r142","prompt":"policy_evaluate throws on a malformed request, make it return a validation error instead","label":"coder","split":"test","trap":false,"source":"pr","note":"bug fix"}+{"id":"r143","prompt":"reduce CLI startup time","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"optimisation"}+{"id":"r144","prompt":"the test suite takes 14 minutes, find out what is slow","label":"performance-engineer","split":"dev","trap":true,"source":"synthetic","note":"profiling runtime, not writing tests"}+{"id":"r145","prompt":"build the UI component for the agent status panel","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"\"build\" means write the component, not a CI build"}+{"id":"r146","prompt":"write an ADR for splitting the memory bridge into separate read and write paths","label":"architect","split":"test","trap":true,"source":"synthetic","note":"ADR/boundary decision; memory is the subject"}+{"id":"r147","prompt":"could the helpers signing key leak into tool output during publish? assess it","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"secret exposure assessment"}+{"id":"r148","prompt":"hello","label":"none","split":"test","trap":false,"source":"synthetic","note":"greeting"}+{"id":"r149","prompt":"configure a hierarchical topology with a queen and 6 workers","label":"swarm-specialist","split":"test","trap":false,"source":"synthetic","note":"topology"}+{"id":"r150","prompt":"memory store reports success but nothing is persisted after the better-sqlite3 to sql.js fallback","label":"memory-specialist","split":"dev","trap":false,"source":"issue","note":"memory backend persistence"}+{"id":"r151","prompt":"write unit tests for writeJsonAtomic covering the rename-retry path","label":"tester","split":"test","trap":false,"source":"pr","note":"write tests"}+{"id":"r152","prompt":"configure the RRF weights in the hybrid memory backend","label":"memory-specialist","split":"test","trap":false,"source":"pr","note":"hybrid retrieval tuning"}+{"id":"r153","prompt":"is there prior art for semantic agent routing? papers or open-source projects","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"literature search"}+{"id":"r154","prompt":"coordinate a hive-mind with raft consensus for this release","label":"swarm-specialist","split":"dev","trap":false,"source":"synthetic","note":"hive-mind coordination"}+{"id":"r155","prompt":"our agents keep editing the same files β set up ownership and handoff between them","label":"swarm-specialist","split":"test","trap":false,"source":"issue","note":"agent coordination"}+{"id":"r156","prompt":"post-task drops the routing outcome when --agent has a colon in it, handle plugin-qualified agent names","label":"coder","split":"test","trap":false,"source":"issue","note":"parsing bug fix"}+{"id":"r157","prompt":"statusline shows the baked-in version when run from a git worktree; resolve the package from the main repo node_modules instead","label":"coder","split":"dev","trap":false,"source":"issue","note":"path-resolution bug fix"}+{"id":"r158","prompt":"our session tokens never expire β what is the risk and what should we do","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"auth hardening"}+{"id":"r159","prompt":"`memory <unknown-subcommand>` prints usage and exits 0 β make it exit non-zero","label":"coder","split":"test","trap":true,"source":"issue","note":"CLI exit-code bug; no memory-store expertise involved"}+{"id":"r160","prompt":"look into how other CLIs handle update notifications","label":"researcher","split":"dev","trap":false,"source":"synthetic","note":"external research"}+{"id":"r161","prompt":"decide which packages may import which, and draw the allowed dependency graph","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"module boundaries"}+{"id":"r162","prompt":"p95 of hooks_route got worse after 3.42 β measure it","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"latency measurement"}+{"id":"r163","prompt":"what time is it","label":"none","split":"dev","trap":false,"source":"synthetic","note":"not an engineering task"}+{"id":"r164","prompt":"pls review my PR, its the one fixing the kebab flags","label":"reviewer","split":"test","trap":false,"source":"pr","note":"PR review"}+{"id":"r165","prompt":"add a CD workflow for the website repo","label":"devops","split":"test","trap":false,"source":"synthetic","note":"CD"}+{"id":"r166","prompt":"shut the swarm down cleanly and hand off the unclaimed tasks","label":"swarm-specialist","split":"dev","trap":false,"source":"synthetic","note":"swarm lifecycle"}+{"id":"r167","prompt":"design the public interface for a pluggable router","label":"architect","split":"test","trap":false,"source":"synthetic","note":"API design"}+{"id":"r168","prompt":"critique the error handling in this function","label":"reviewer","split":"dev","trap":false,"source":"synthetic","note":"code quality review"}+{"id":"r169","prompt":"translate \"good night\" into french","label":"none","split":"test","trap":false,"source":"synthetic","note":"non-software"}+{"id":"r170","prompt":"the daemon sits at 100% CPU when idle","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"CPU profiling"}+{"id":"r171","prompt":"flame graph the statusline render","label":"performance-engineer","split":"dev","trap":false,"source":"synthetic","note":"profiling"}+{"id":"r172","prompt":"add pagination to the list output of the claims command","label":"coder","split":"test","trap":false,"source":"synthetic","note":"feature work"}+{"id":"r173","prompt":"deploy the gateway to Cloud Run and confirm traffic moved to the new revision","label":"devops","split":"dev","trap":false,"source":"synthetic","note":"deploy"}+{"id":"r174","prompt":"add a CI check that the packed tarball actually contains dist/","label":"devops","split":"test","trap":true,"source":"synthetic","note":"release pipeline gate, not a unit test"}+{"id":"r175","prompt":"hive-mind init generates a hiveId but never saves it, so status shows a different id β fix that","label":"coder","split":"dev","trap":true,"source":"pr","note":"persistence bug in a CLI command, no coordination design needed"}+{"id":"r176","prompt":"summarize the discussion on issue 2399","label":"researcher","split":"test","trap":false,"source":"issue","note":"summarise"}+{"id":"r177","prompt":"which packages depend on @claude-flow/memory?","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"dependency lookup"}+{"id":"r178","prompt":"switch memory search from hash embeddings to MiniLM","label":"memory-specialist","split":"dev","trap":false,"source":"synthetic","note":"embedding backend"}+{"id":"r179","prompt":"memory search only sees the oldest rows because the candidate scan uses LIMIT 1000 without ORDER BY","label":"memory-specialist","split":"test","trap":false,"source":"issue","note":"retrieval correctness"}+{"id":"r180","prompt":"write a Dockerfile for the MCP server","label":"devops","split":"test","trap":false,"source":"synthetic","note":"Docker"}+{"id":"r181","prompt":"validateEnv() denylist is missing PATH and friends β assess the CWE-427 exposure","label":"security-architect","split":"dev","trap":false,"source":"issue","note":"vulnerability assessment"}+{"id":"r182","prompt":"what is the weather like tomorrow","label":"none","split":"dev","trap":false,"source":"synthetic","note":"non-software"}+{"id":"r183","prompt":"the CD workflow goes green without deploy credentials, make it fail loudly","label":"devops","split":"dev","trap":false,"source":"issue","note":"CD pipeline"}+{"id":"r184","prompt":"what is the difference between hive-mind and swarm in ruflo?","label":"researcher","split":"dev","trap":true,"source":"synthetic","note":"conceptual question, not orchestration"}+{"id":"r185","prompt":"we need a contract between the daemon and the MCP server β define it","label":"architect","split":"test","trap":false,"source":"synthetic","note":"interface definition"}+{"id":"r186","prompt":"what should our test strategy be for the MCP tools β which parts unit vs integration?","label":"tester","split":"dev","trap":false,"source":"synthetic","note":"test strategy"}+{"id":"r187","prompt":"review the changelog and tell me which releases touched hooks","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"reading history, not code review"}+{"id":"r188","prompt":"what does the memory module do","label":"researcher","split":"dev","trap":true,"source":"synthetic","note":"explain existing code"}+{"id":"r189","prompt":"add a --dry-run flag to the cleanup command","label":"coder","split":"test","trap":false,"source":"synthetic","note":"small feature"}+{"id":"r190","prompt":"look at the benchmark script PR and tell me if the code is clean","label":"reviewer","split":"test","trap":true,"source":"synthetic","note":"code quality review, not benchmarking"}+{"id":"r191","prompt":"LGTM or not? PR #3398, the rename retry logic","label":"reviewer","split":"test","trap":false,"source":"pr","note":"PR review"}+{"id":"r192","prompt":"triage the new bug reports and group them by component","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"triage"}+{"id":"r193","prompt":"ok","label":"none","split":"test","trap":false,"source":"synthetic","note":"acknowledgement"}+{"id":"r194","prompt":"how does the test runner find its fixtures?","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"how does X work"}+{"id":"r195","prompt":"Float32Array embeddings are not recognised and memory falls back to hash vectors","label":"memory-specialist","split":"test","trap":false,"source":"issue","note":"embedding handling"}+{"id":"r196","prompt":"write a small CLI command that prints the ruflo version and the node version","label":"coder","split":"dev","trap":false,"source":"synthetic","note":"write code"}+{"id":"r197","prompt":"should claims be one service or stay as four separate systems? sketch the options","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"architecture options"}diff --git a/v3/@claude-flow/cli/benchmarks/router/results/router-bench-2026-09-23.json b/v3/@claude-flow/cli/benchmarks/router/results/router-bench-2026-09-23.jsonnew file mode 100644index 0000000000..5d682327a4--- /dev/null+++ b/v3/@claude-flow/cli/benchmarks/router/results/router-bench-2026-09-23.json@@ -0,0 +1,7630 @@+{+ "adr": "ADR-391",+ "ts": "2026-09-23T18:27:43.084Z",+ "corpusSha256": "b0c1923b2813b61907304dff56c53d199b709797bfb9600a7c1f496cf0c0bf04",+ "node": "v22.23.2",+ "host": "linux-x64",+ "highConfidence": 0.7,+ "gate": {+ "B": {+ "accuracyDeltaPts": 10.62,+ "p95LatencyRegressionPct": 485,+ "requiredDependencyAdded": false,+ "passesAccuracy": true,+ "passesLatency": false,+ "passesDependency": true+ },+ "C": {+ "accuracyDeltaPts": 0.89,+ "p95LatencyRegressionPct": 12.7,+ "requiredDependencyAdded": true,+ "passesAccuracy": false,+ "passesLatency": false,+ "passesDependency": "optional-peer (allowed only as opt-in)"+ },+ "D": {+ "accuracyDeltaPts": 3.54,+ "p95LatencyRegressionPct": 686.1,+ "requiredDependencyAdded": true,+ "passesAccuracy": true,+ "passesLatency": false,+ "passesDependency": "optional-peer (allowed only as opt-in)"+ }+ },+ "results": {+ "A": {+ "dev": {+ "n": 84,+ "accuracy": 0.2619,+ "macroF1": 0.1996,+ "wrongHighConfRate": 0.3214,+ "trapAccuracy": 0.303+ },+ "test": {+ "n": 113,+ "accuracy": 0.2566,+ "macroF1": 0.1775,+ "wrongHighConfRate": 0.292,+ "trapAccuracy": 0.2903+ },+ "latencyMs": {+ "cold": 37.99,+ "p50": 0.659,+ "p95": 1.062+ },+ "predictions": [+ {+ "id": "r001",+ "ms": 37.99279,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r002",+ "ms": 0.4868100000000055,+ "agent": "coder",+ "confidence": 0.48,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r003",+ "ms": 0.9899389999999997,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r004",+ "ms": 0.6015099999999975,+ "agent": "tester",+ "confidence": 0.52,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r005",+ "ms": 0.6375290000000007,+ "agent": "tester",+ "confidence": 0.46,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r006",+ "ms": 0.6031300000000002,+ "agent": "tester",+ "confidence": 0.44,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r007",+ "ms": 0.6299799999999962,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r008",+ "ms": 0.6999589999999998,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r009",+ "ms": 0.7006599999999992,+ "agent": "swarm-specialist",+ "confidence": 0.4,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r010",+ "ms": 0.5656400000000019,+ "agent": "tester",+ "confidence": 0.56,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r011",+ "ms": 0.6567989999999924,+ "agent": "security-architect",+ "confidence": 0.92,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r012",+ "ms": 0.5663300000000078,+ "agent": "tester",+ "confidence": 0.46,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r013",+ "ms": 0.1967300000000023,+ "agent": "tester",+ "confidence": 0.64,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r014",+ "ms": 0.19214999999999804,+ "agent": "swarm-specialist",+ "confidence": 0.69,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r015",+ "ms": 0.6947289999999953,+ "agent": "performance-engineer",+ "confidence": 0.4,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r016",+ "ms": 0.5883000000000038,+ "agent": "performance-engineer",+ "confidence": 0.44,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r017",+ "ms": 0.5921699999999959,+ "agent": "tester",+ "confidence": 0.45,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r018",+ "ms": 0.7051999999999907,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r019",+ "ms": 0.5066290000000038,+ "agent": "architect",+ "confidence": 0.5,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r020",+ "ms": 0.6468500000000006,+ "agent": "tester",+ "confidence": 0.49,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r021",+ "ms": 0.6785599999999903,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r022",+ "ms": 0.6626389999999986,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r023",+ "ms": 0.576430000000002,+ "agent": "memory-specialist",+ "confidence": 0.44,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r024",+ "ms": 0.10147000000000617,+ "agent": "architect",+ "confidence": 0.52,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r025",+ "ms": 0.32793000000000916,+ "agent": "memory-specialist",+ "confidence": 0.57,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r026",+ "ms": 0.6297390000000007,+ "agent": "coder",+ "confidence": 0.44,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r027",+ "ms": 0.5824900000000071,+ "agent": "performance-engineer",+ "confidence": 0.46,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r028",+ "ms": 0.8965900000000033,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r029",+ "ms": 0.6745590000000021,+ "agent": "tester",+ "confidence": 0.43,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r030",+ "ms": 0.5391900000000049,+ "agent": "tester",+ "confidence": 0.58,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r031",+ "ms": 0.7666090000000025,+ "agent": "coder",+ "confidence": 0.41,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r032",+ "ms": 0.7946100000000058,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r033",+ "ms": 1.154869000000005,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r034",+ "ms": 0.28396000000000754,+ "agent": "architect",+ "confidence": 0.52,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r035",+ "ms": 0.5078999999999922,+ "agent": "coder",+ "confidence": 0.49,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r036",+ "ms": 0.6894199999999984,+ "agent": "security-architect",+ "confidence": 0.92,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r037",+ "ms": 1.061749000000006,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r038",+ "ms": 0.9940290000000118,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r039",+ "ms": 1.1766700000000014,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r040",+ "ms": 1.062459000000004,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r041",+ "ms": 0.4381699999999995,+ "agent": "architect",+ "confidence": 0.55,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r042",+ "ms": 1.110439999999997,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r043",+ "ms": 0.7684689999999961,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r044",+ "ms": 0.6300999999999988,+ "agent": "architect",+ "confidence": 0.9,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r045",+ "ms": 0.9714089999999942,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r046",+ "ms": 0.6765999999999934,+ "agent": "performance-engineer",+ "confidence": 0.49,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r047",+ "ms": 0.6453300000000013,+ "agent": "architect",+ "confidence": 0.9,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r048",+ "ms": 0.5250589999999988,+ "agent": "tester",+ "confidence": 0.57,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r049",+ "ms": 0.7258599999999973,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r050",+ "ms": 0.6679600000000079,+ "agent": "tester",+ "confidence": 0.43,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r051",+ "ms": 0.8108289999999982,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r052",+ "ms": 0.627200000000002,+ "agent": "tester",+ "confidence": 0.52,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r053",+ "ms": 0.726649000000009,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r054",+ "ms": 0.30979000000000667,+ "agent": "tester",+ "confidence": 0.67,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r055",+ "ms": 0.9439899999999994,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r056",+ "ms": 0.7731590000000068,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r057",+ "ms": 0.4160399999999953,+ "agent": "architect",+ "confidence": 0.5,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r058",+ "ms": 0.9608800000000031,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r059",+ "ms": 0.216668999999996,+ "agent": "swarm-specialist",+ "confidence": 0.47,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r060",+ "ms": 0.7030999999999921,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r061",+ "ms": 0.8719899999999967,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r062",+ "ms": 0.45816899999999805,+ "agent": "tester",+ "confidence": 0.6,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r063",+ "ms": 0.5518499999999875,+ "agent": "coder",+ "confidence": 0.44,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r064",+ "ms": 0.3669700000000091,+ "agent": "architect",+ "confidence": 0.48,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r065",+ "ms": 0.717219,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r066",+ "ms": 0.90561000000001,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r067",+ "ms": 0.6325800000000044,+ "agent": "tester",+ "confidence": 0.48,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r068",+ "ms": 0.6485489999999885,+ "agent": "tester",+ "confidence": 0.4,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r069",+ "ms": 0.8946100000000001,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r070",+ "ms": 0.7625099999999918,+ "agent": "architect",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r071",+ "ms": 0.9282589999999971,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r072",+ "ms": 0.9458500000000072,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r073",+ "ms": 0.4197589999999991,+ "agent": "tester",+ "confidence": 0.57,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r074",+ "ms": 0.530210000000011,+ "agent": "memory-specialist",+ "confidence": 0.43,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r075",+ "ms": 1.0243389999999977,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r076",+ "ms": 0.8301000000000016,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r077",+ "ms": 0.7982400000000069,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r078",+ "ms": 0.5173089999999974,+ "agent": "tester",+ "confidence": 0.54,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r079",+ "ms": 0.7103800000000007,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r080",+ "ms": 1.008538999999999,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r081",+ "ms": 0.20626000000000033,+ "agent": "coder",+ "confidence": 0.56,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r082",+ "ms": 0.5475799999999964,+ "agent": "tester",+ "confidence": 0.43,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r083",+ "ms": 0.33740999999999133,+ "agent": "tester",+ "confidence": 0.75,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r084",+ "ms": 0.798608999999999,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r085",+ "ms": 0.5322299999999984,+ "agent": "tester",+ "confidence": 0.54,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r086",+ "ms": 0.8296100000000024,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r087",+ "ms": 0.9388690000000111,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r088",+ "ms": 0.3638899999999978,+ "agent": "tester",+ "confidence": 0.68,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r089",+ "ms": 0.8507689999999997,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r090",+ "ms": 0.0712299999999999,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r091",+ "ms": 0.40718999999999994,+ "agent": "tester",+ "confidence": 0.52,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r092",+ "ms": 0.6127400000000023,+ "agent": "tester",+ "confidence": 0.62,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r093",+ "ms": 0.95090900000001,+ "agent": "swarm-specialist",+ "confidence": 0.9,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r094",+ "ms": 0.8726999999999947,+ "agent": "performance-engineer",+ "confidence": 0.88,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r095",+ "ms": 0.4998899999999935,+ "agent": "memory-specialist",+ "confidence": 0.43,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r096",+ "ms": 0.5971289999999954,+ "agent": "tester",+ "confidence": 0.5,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r097",+ "ms": 0.17450000000000898,+ "agent": "memory-specialist",+ "confidence": 0.65,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r098",+ "ms": 0.38515999999999906,+ "agent": "architect",+ "confidence": 0.62,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r099",+ "ms": 0.5228699999999975,+ "agent": "tester",+ "confidence": 0.49,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r100",+ "ms": 0.6590790000000055,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r101",+ "ms": 0.7756399999999957,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r102",+ "ms": 0.9204200000000071,+ "agent": "security-architect",+ "confidence": 0.92,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r103",+ "ms": 0.5979990000000015,+ "agent": "tester",+ "confidence": 0.52,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r104",+ "ms": 0.33292000000000144,+ "agent": "tester",+ "confidence": 0.61,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r105",+ "ms": 0.2650700000000086,+ "agent": "architect",+ "confidence": 0.75,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r106",+ "ms": 0.11467000000000382,+ "agent": "devops",+ "confidence": 0.51,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r107",+ "ms": 1.1050389999999908,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r108",+ "ms": 0.5528599999999955,+ "agent": "performance-engineer",+ "confidence": 0.42,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r109",+ "ms": 0.8871589999999969,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r110",+ "ms": 0.41853000000000407,+ "agent": "tester",+ "confidence": 0.67,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r111",+ "ms": 0.6855500000000063,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r112",+ "ms": 0.8302889999999934,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r113",+ "ms": 1.1012099999999805,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r114",+ "ms": 0.9312989999999957,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r115",+ "ms": 0.6697599999999966,+ "agent": "performance-engineer",+ "confidence": 0.41,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r116",+ "ms": 0.13606999999998948,+ "agent": "security-architect",+ "confidence": 0.52,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r117",+ "ms": 0.8105589999999836,+ "agent": "architect",+ "confidence": 0.9,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r118",+ "ms": 0.47147999999998547,+ "agent": "architect",+ "confidence": 0.46,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r119",+ "ms": 0.8518600000000163,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r120",+ "ms": 1.0783589999999776,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r121",+ "ms": 0.756069999999994,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r122",+ "ms": 0.5691690000000165,+ "agent": "tester",+ "confidence": 0.47,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r123",+ "ms": 0.7787800000000118,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r124",+ "ms": 0.40230999999999995,+ "agent": "tester",+ "confidence": 0.53,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r125",+ "ms": 0.6398000000000081,+ "agent": "devops",+ "confidence": 0.54,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r126",+ "ms": 1.0541389999999922,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r127",+ "ms": 0.4547100000000057,+ "agent": "architect",+ "confidence": 0.45,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r128",+ "ms": 0.6513789999999915,+ "agent": "devops",+ "confidence": 0.48,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r129",+ "ms": 0.7888399999999933,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r130",+ "ms": 0.23631999999997788,+ "agent": "performance-engineer",+ "confidence": 0.79,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r131",+ "ms": 1.0420990000000074,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r132",+ "ms": 0.6785800000000108,+ "agent": "tester",+ "confidence": 0.48,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r133",+ "ms": 0.508340000000004,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r134",+ "ms": 0.8485589999999945,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r135",+ "ms": 0.6682299999999941,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r136",+ "ms": 0.6773890000000051,+ "agent": "devops",+ "confidence": 0.42,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r137",+ "ms": 0.8860699999999895,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r138",+ "ms": 0.6921600000000012,+ "agent": "swarm-specialist",+ "confidence": 0.5,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r139",+ "ms": 0.46905899999998724,+ "agent": "tester",+ "confidence": 0.65,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r140",+ "ms": 0.811080000000004,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r141",+ "ms": 0.4757099999999923,+ "agent": "tester",+ "confidence": 0.5,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r142",+ "ms": 0.9391689999999926,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r143",+ "ms": 0.29493999999999687,+ "agent": "architect",+ "confidence": 0.64,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r144",+ "ms": 0.5916699999999935,+ "agent": "tester",+ "confidence": 0.55,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r145",+ "ms": 0.5453290000000095,+ "agent": "architect",+ "confidence": 0.43,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r146",+ "ms": 0.8434799999999996,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r147",+ "ms": 0.8165889999999933,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r148",+ "ms": 0.11932000000001608,+ "agent": "devops",+ "confidence": 0.6,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r149",+ "ms": 0.663470000000018,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r150",+ "ms": 1.1883100000000013,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r151",+ "ms": 0.7772190000000023,+ "agent": "tester",+ "confidence": 0.4,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r152",+ "ms": 0.6090199999999868,+ "agent": "tester",+ "confidence": 0.48,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r153",+ "ms": 0.8162389999999959,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r154",+ "ms": 0.6461800000000153,+ "agent": "architect",+ "confidence": 0.41,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r155",+ "ms": 0.866928999999999,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r156",+ "ms": 1.0815900000000056,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r157",+ "ms": 1.2978789999999947,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r158",+ "ms": 0.7680900000000008,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r159",+ "ms": 0.8086590000000058,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r160",+ "ms": 0.5948499999999797,+ "agent": "swarm-specialist",+ "confidence": 0.45,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r161",+ "ms": 0.8232100000000173,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r162",+ "ms": 0.564819,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r163",+ "ms": 0.21762999999998556,+ "agent": "tester",+ "confidence": 0.77,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r164",+ "ms": 0.5662799999999777,+ "agent": "performance-engineer",+ "confidence": 0.47,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r165",+ "ms": 0.4380400000000009,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r166",+ "ms": 0.6587089999999876,+ "agent": "swarm-specialist",+ "confidence": 0.9,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r167",+ "ms": 0.5670500000000231,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r168",+ "ms": 0.4999699999999905,+ "agent": "tester",+ "confidence": 0.52,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r169",+ "ms": 0.39852899999999636,+ "agent": "tester",+ "confidence": 0.62,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r170",+ "ms": 0.4193300000000022,+ "agent": "tester",+ "confidence": 0.61,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r171",+ "ms": 0.39539000000002034,+ "agent": "architect",+ "confidence": 0.65,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r172",+ "ms": 0.5979000000000099,+ "agent": "tester",+ "confidence": 0.44,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r173",+ "ms": 0.8211990000000071,+ "agent": "devops",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r174",+ "ms": 0.6908799999999928,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r175",+ "ms": 0.9775989999999979,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r176",+ "ms": 0.43828999999999496,+ "agent": "memory-specialist",+ "confidence": 0.54,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r177",+ "ms": 0.5094699999999932,+ "agent": "devops",+ "confidence": 0.44,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r178",+ "ms": 0.5684300000000064,+ "agent": "memory-specialist",+ "confidence": 0.51,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r179",+ "ms": 1.0348490000000083,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r180",+ "ms": 0.43326999999999316,+ "agent": "memory-specialist",+ "confidence": 0.5,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r181",+ "ms": 0.8423689999999908,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r182",+ "ms": 0.3919300000000021,+ "agent": "tester",+ "confidence": 0.65,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r183",+ "ms": 0.7918400000000076,+ "agent": "devops",+ "confidence": 0.85,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r184",+ "ms": 0.6428989999999999,+ "agent": "memory-specialist",+ "confidence": 0.5,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r185",+ "ms": 0.7232600000000105,+ "agent": "security-architect",+ "confidence": 0.4,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r186",+ "ms": 0.8909500000000037,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r187",+ "ms": 0.6708690000000104,+ "agent": "architect",+ "confidence": 0.41,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r188",+ "ms": 0.36223000000001093,+ "agent": "memory-specialist",+ "confidence": 0.55,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r189",+ "ms": 0.4732099999999946,+ "agent": "performance-engineer",+ "confidence": 0.41,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r190",+ "ms": 0.6896490000000028,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r191",+ "ms": 0.4930400000000077,+ "agent": "tester",+ "confidence": 0.45,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r192",+ "ms": 0.5948999999999955,+ "agent": "architect",+ "confidence": 0.42,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r193",+ "ms": 0.08334999999999582,+ "agent": "devops",+ "confidence": 0.56,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r194",+ "ms": 0.4823389999999961,+ "agent": "tester",+ "confidence": 0.59,+ "embedder": "hash",+ "method": "semantic-native"+ },+ {+ "id": "r195",+ "ms": 0.8602400000000046,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r196",+ "ms": 0.8100689999999986,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ },+ {+ "id": "r197",+ "ms": 0.8646699999999896,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "hash",+ "method": "keyword"+ }+ ]+ },+ "B": {+ "dev": {+ "n": 84,+ "accuracy": 0.3452,+ "macroF1": 0.3279,+ "wrongHighConfRate": 0.4643,+ "trapAccuracy": 0.3636+ },+ "test": {+ "n": 113,+ "accuracy": 0.3628,+ "macroF1": 0.3335,+ "wrongHighConfRate": 0.469,+ "trapAccuracy": 0.2581+ },+ "latencyMs": {+ "cold": 325.56,+ "p50": 2.189,+ "p95": 6.213+ },+ "predictions": [+ {+ "id": "r001",+ "ms": 325.558016,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r002",+ "ms": 2.629488999999978,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r003",+ "ms": 2.393957999999998,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r004",+ "ms": 2.150148999999999,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r005",+ "ms": 1.7406590000000506,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r006",+ "ms": 1.6508890000000065,+ "agent": "memory-specialist",+ "confidence": 0.45,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r007",+ "ms": 2.2936090000000036,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r008",+ "ms": 1.7468390000000227,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r009",+ "ms": 2.6653590000000236,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r010",+ "ms": 1.4015590000000202,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r011",+ "ms": 6.022057000000018,+ "agent": "security-architect",+ "confidence": 0.92,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r012",+ "ms": 6.812935999999979,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r013",+ "ms": 3.5920380000000023,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r014",+ "ms": 1.0287399999999707,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r015",+ "ms": 8.410005000000012,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r016",+ "ms": 4.587437999999963,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r017",+ "ms": 4.084738000000016,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r018",+ "ms": 8.839744999999994,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r019",+ "ms": 2.8909079999999676,+ "agent": "swarm-specialist",+ "confidence": 0.43,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r020",+ "ms": 3.24323899999996,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r021",+ "ms": 2.333558000000039,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r022",+ "ms": 3.624968000000024,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r023",+ "ms": 2.412538999999981,+ "agent": "swarm-specialist",+ "confidence": 0.58,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r024",+ "ms": 1.0176590000000374,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r025",+ "ms": 3.488427999999999,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r026",+ "ms": 2.1083090000000198,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r027",+ "ms": 3.619939000000045,+ "agent": "architect",+ "confidence": 0.5,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r028",+ "ms": 3.92818699999998,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r029",+ "ms": 2.144128999999964,+ "agent": "architect",+ "confidence": 0.42,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r030",+ "ms": 4.8483980000000315,+ "agent": "swarm-specialist",+ "confidence": 0.54,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r031",+ "ms": 1.4637189999999691,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r032",+ "ms": 3.5434679999999616,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r033",+ "ms": 4.504327999999987,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r034",+ "ms": 2.1165280000000166,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r035",+ "ms": 3.649907999999982,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r036",+ "ms": 2.8382990000000063,+ "agent": "security-architect",+ "confidence": 0.47,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r037",+ "ms": 8.506836000000021,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r038",+ "ms": 5.100637000000006,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r039",+ "ms": 6.274376000000018,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r040",+ "ms": 2.832538999999997,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r041",+ "ms": 1.4084589999999935,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r042",+ "ms": 3.5218980000000215,+ "agent": "swarm-specialist",+ "confidence": 0.43,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r043",+ "ms": 5.849846999999954,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r044",+ "ms": 2.155858999999964,+ "agent": "architect",+ "confidence": 0.63,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r045",+ "ms": 2.9345880000000193,+ "agent": "swarm-specialist",+ "confidence": 0.49,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r046",+ "ms": 3.219589000000042,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r047",+ "ms": 2.510778000000016,+ "agent": "swarm-specialist",+ "confidence": 0.47,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r048",+ "ms": 4.20117799999997,+ "agent": "memory-specialist",+ "confidence": 0.43,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r049",+ "ms": 2.2492490000000203,+ "agent": "memory-specialist",+ "confidence": 0.42,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r050",+ "ms": 4.677236999999991,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r051",+ "ms": 2.576238999999987,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r052",+ "ms": 5.318687000000068,+ "agent": "tester",+ "confidence": 0.41,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r053",+ "ms": 1.6511990000000196,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r054",+ "ms": 1.026489999999967,+ "agent": "coder",+ "confidence": 0.51,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r055",+ "ms": 3.427787999999964,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r056",+ "ms": 1.487209000000007,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r057",+ "ms": 2.230809000000022,+ "agent": "security-architect",+ "confidence": 0.51,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r058",+ "ms": 2.703987999999981,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r059",+ "ms": 1.2336800000000494,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r060",+ "ms": 1.350738999999976,+ "agent": "swarm-specialist",+ "confidence": 0.45,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r061",+ "ms": 5.630217000000016,+ "agent": "performance-engineer",+ "confidence": 0.46,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r062",+ "ms": 1.4966890000000603,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r063",+ "ms": 1.9040989999999738,+ "agent": "memory-specialist",+ "confidence": 0.43,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r064",+ "ms": 3.6902679999999464,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r065",+ "ms": 1.6024590000000671,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r066",+ "ms": 2.480269000000021,+ "agent": "architect",+ "confidence": 0.52,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r067",+ "ms": 4.043287999999961,+ "agent": "architect",+ "confidence": 0.46,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r068",+ "ms": 1.4939190000000053,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r069",+ "ms": 4.030897999999979,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r070",+ "ms": 1.9072989999999663,+ "agent": "architect",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r071",+ "ms": 3.5821580000000495,+ "agent": "swarm-specialist",+ "confidence": 0.4,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r072",+ "ms": 2.214448999999945,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r073",+ "ms": 3.398867999999993,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r074",+ "ms": 1.5871590000000424,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r075",+ "ms": 3.689128000000096,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r076",+ "ms": 1.859719000000041,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r077",+ "ms": 1.6036690000000817,+ "agent": "tester",+ "confidence": 0.46,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r078",+ "ms": 6.041396999999961,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r079",+ "ms": 1.4894089999999096,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r080",+ "ms": 3.6476080000001048,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r081",+ "ms": 1.1475399999999354,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r082",+ "ms": 3.1399880000000167,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r083",+ "ms": 1.620728999999983,+ "agent": "coder",+ "confidence": 0.48,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r084",+ "ms": 1.6006190000000515,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r085",+ "ms": 3.3158180000000357,+ "agent": "security-architect",+ "confidence": 0.52,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r086",+ "ms": 1.9674199999999473,+ "agent": "performance-engineer",+ "confidence": 0.44,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r087",+ "ms": 9.541094000000044,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r088",+ "ms": 5.011127999999985,+ "agent": "devops",+ "confidence": 0.57,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r089",+ "ms": 1.8519090000000915,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r090",+ "ms": 6.196177000000034,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r091",+ "ms": 1.4297389999999268,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r092",+ "ms": 1.4187689999999975,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r093",+ "ms": 7.127076000000102,+ "agent": "swarm-specialist",+ "confidence": 0.56,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r094",+ "ms": 5.117947999999956,+ "agent": "performance-engineer",+ "confidence": 0.4,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r095",+ "ms": 1.5308489999999892,+ "agent": "coder",+ "confidence": 0.47,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r096",+ "ms": 2.827547999999979,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r097",+ "ms": 1.056600000000003,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r098",+ "ms": 1.1615289999999732,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r099",+ "ms": 3.6230679999999893,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r100",+ "ms": 1.5382090000000517,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r101",+ "ms": 1.658728999999994,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r102",+ "ms": 6.7821969999999965,+ "agent": "security-architect",+ "confidence": 0.92,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r103",+ "ms": 1.5869590000000926,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r104",+ "ms": 1.7713790000000245,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r105",+ "ms": 1.0635389999999916,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r106",+ "ms": 0.95799999999997,+ "agent": "architect",+ "confidence": 0.43,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r107",+ "ms": 3.7623780000000124,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r108",+ "ms": 1.600229000000013,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r109",+ "ms": 1.7439090000000306,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r110",+ "ms": 2.1254290000000537,+ "agent": "tester",+ "confidence": 0.44,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r111",+ "ms": 2.186319000000026,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r112",+ "ms": 1.8709390000000212,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r113",+ "ms": 4.2056969999999865,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r114",+ "ms": 1.6632590000000391,+ "agent": "performance-engineer",+ "confidence": 0.5,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r115",+ "ms": 3.667728000000011,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r116",+ "ms": 1.177379999999971,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r117",+ "ms": 2.609937999999943,+ "agent": "architect",+ "confidence": 0.9,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r118",+ "ms": 1.3824299999999994,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r119",+ "ms": 4.540326999999934,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r120",+ "ms": 1.944389000000001,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r121",+ "ms": 7.078445999999985,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r122",+ "ms": 1.7731790000000274,+ "agent": "performance-engineer",+ "confidence": 0.47,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r123",+ "ms": 3.766978999999992,+ "agent": "devops",+ "confidence": 0.44,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r124",+ "ms": 1.6001790000000256,+ "agent": "tester",+ "confidence": 0.41,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r125",+ "ms": 2.3912579999999934,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r126",+ "ms": 3.1697889999999234,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r127",+ "ms": 1.589138999999932,+ "agent": "swarm-specialist",+ "confidence": 0.9,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r128",+ "ms": 1.7827589999999418,+ "agent": "performance-engineer",+ "confidence": 0.63,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r129",+ "ms": 1.6520590000000084,+ "agent": "memory-specialist",+ "confidence": 0.51,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r130",+ "ms": 1.3151189999999815,+ "agent": "performance-engineer",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r131",+ "ms": 3.3325989999999592,+ "agent": "devops",+ "confidence": 0.51,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r132",+ "ms": 1.5140390000000252,+ "agent": "swarm-specialist",+ "confidence": 0.48,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r133",+ "ms": 3.795317999999952,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r134",+ "ms": 3.3402580000000626,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r135",+ "ms": 3.672237999999993,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r136",+ "ms": 3.2291380000000345,+ "agent": "security-architect",+ "confidence": 0.4,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r137",+ "ms": 1.624798999999939,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r138",+ "ms": 1.4940000000000282,+ "agent": "performance-engineer",+ "confidence": 0.47,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r139",+ "ms": 1.2288590000000568,+ "agent": "security-architect",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r140",+ "ms": 4.8323270000000775,+ "agent": "security-architect",+ "confidence": 0.6,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r141",+ "ms": 1.5393100000000004,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r142",+ "ms": 1.62050899999997,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r143",+ "ms": 1.1410590000000411,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r144",+ "ms": 4.576976999999943,+ "agent": "tester",+ "confidence": 0.48,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r145",+ "ms": 1.4757600000000366,+ "agent": "coder",+ "confidence": 0.46,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r146",+ "ms": 1.535618999999997,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r147",+ "ms": 4.597438000000011,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r148",+ "ms": 2.5604980000000523,+ "agent": "architect",+ "confidence": 0.5,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r149",+ "ms": 1.4868289999999433,+ "agent": "swarm-specialist",+ "confidence": 0.43,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r150",+ "ms": 5.636806999999976,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r151",+ "ms": 1.6891389999999546,+ "agent": "tester",+ "confidence": 0.95,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r152",+ "ms": 2.8316089999999576,+ "agent": "architect",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r153",+ "ms": 1.5770989999999756,+ "agent": "swarm-specialist",+ "confidence": 0.45,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r154",+ "ms": 1.4812390000000732,+ "agent": "swarm-specialist",+ "confidence": 0.55,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r155",+ "ms": 3.76093800000001,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r156",+ "ms": 6.21257700000001,+ "agent": "swarm-specialist",+ "confidence": 0.44,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r157",+ "ms": 2.4511489999999867,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r158",+ "ms": 4.378917000000001,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r159",+ "ms": 1.954289000000017,+ "agent": "performance-engineer",+ "confidence": 0.42,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r160",+ "ms": 2.233389000000102,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r161",+ "ms": 2.350099,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r162",+ "ms": 4.255307000000016,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r163",+ "ms": 1.0955000000000155,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r164",+ "ms": 1.5175689999999804,+ "agent": "coder",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r165",+ "ms": 2.7229489999999714,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r166",+ "ms": 1.5463790000000017,+ "agent": "swarm-specialist",+ "confidence": 0.47,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r167",+ "ms": 1.7850089999999454,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r168",+ "ms": 2.4916390000000774,+ "agent": "coder",+ "confidence": 0.47,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r169",+ "ms": 1.2486889999998994,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r170",+ "ms": 1.2581989999999905,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r171",+ "ms": 3.3133779999999433,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r172",+ "ms": 1.4827999999999975,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r173",+ "ms": 1.4608989999999267,+ "agent": "devops",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r174",+ "ms": 5.346517000000063,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r175",+ "ms": 2.1893190000000686,+ "agent": "swarm-specialist",+ "confidence": 0.57,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r176",+ "ms": 3.204238000000032,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r177",+ "ms": 2.0532790000000887,+ "agent": "memory-specialist",+ "confidence": 0.41,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r178",+ "ms": 1.7608989999999949,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r179",+ "ms": 1.9372490000000653,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r180",+ "ms": 1.6875390000000152,+ "agent": "devops",+ "confidence": 0.54,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r181",+ "ms": 2.085939000000053,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r182",+ "ms": 1.4820290000000114,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r183",+ "ms": 1.848969000000011,+ "agent": "devops",+ "confidence": 0.85,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r184",+ "ms": 1.906739000000016,+ "agent": "swarm-specialist",+ "confidence": 0.57,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r185",+ "ms": 1.8327189999999973,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r186",+ "ms": 1.9924490000000787,+ "agent": "tester",+ "confidence": 0.42,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r187",+ "ms": 1.8459589999999935,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r188",+ "ms": 1.508179000000041,+ "agent": "performance-engineer",+ "confidence": 0.6,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r189",+ "ms": 1.7045590000000175,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r190",+ "ms": 1.981608999999935,+ "agent": "performance-engineer",+ "confidence": 0.6,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r191",+ "ms": 1.9004300000000285,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r192",+ "ms": 2.6538679999999886,+ "agent": "coder",+ "confidence": 0.41,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r193",+ "ms": 1.4085789999999179,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r194",+ "ms": 1.6688589999999976,+ "agent": "tester",+ "confidence": 0.46,+ "embedder": "minilm",+ "method": "semantic-native"+ },+ {+ "id": "r195",+ "ms": 3.3538489999999683,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r196",+ "ms": 3.69676800000002,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ },+ {+ "id": "r197",+ "ms": 1.67492900000002,+ "agent": "coder",+ "confidence": 0.7,+ "embedder": "minilm",+ "method": "keyword"+ }+ ]+ },+ "C": {+ "dev": {+ "n": 84,+ "accuracy": 0.2976,+ "macroF1": 0.2609,+ "wrongHighConfRate": 0.2738,+ "trapAccuracy": 0.303+ },+ "test": {+ "n": 113,+ "accuracy": 0.2655,+ "macroF1": 0.1992,+ "wrongHighConfRate": 0.2655,+ "trapAccuracy": 0.2903+ },+ "latencyMs": {+ "cold": 89.78,+ "p50": 0.766,+ "p95": 1.197+ },+ "predictions": [+ {+ "id": "r001",+ "ms": 89.78416200000001,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r002",+ "ms": 1.0515200000000107,+ "agent": "coder",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r003",+ "ms": 1.3397089999999992,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r004",+ "ms": 1.9090690000000023,+ "agent": "tester",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.16,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r005",+ "ms": 0.8308000000000106,+ "agent": "tester",+ "confidence": 0.46,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r006",+ "ms": 0.8440390000000093,+ "agent": "memory-specialist",+ "confidence": 0.1,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.10, lift 1.20, abstain 0.13, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r007",+ "ms": 0.8537999999999926,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r008",+ "ms": 0.8432190000000048,+ "agent": "tester",+ "confidence": 0.12,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "tester",+ "tsAbstain": 0.1,+ "tsReason": "typesafe choice \"tester\" (confidence 0.12, lift 1.29, abstain 0.10, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r009",+ "ms": 1.1802689999999956,+ "agent": "swarm-specialist",+ "confidence": 0.4,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.16,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r010",+ "ms": 0.737409999999997,+ "agent": "tester",+ "confidence": 0.56,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r011",+ "ms": 0.8317100000000011,+ "agent": "security-architect",+ "confidence": 0.92,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r012",+ "ms": 0.7392789999999962,+ "agent": "tester",+ "confidence": 0.46,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r013",+ "ms": 0.3088900000000052,+ "agent": "tester",+ "confidence": 0.64,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r014",+ "ms": 0.29375000000000284,+ "agent": "swarm-specialist",+ "confidence": 0.69,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.01 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r015",+ "ms": 0.7850190000000055,+ "agent": "performance-engineer",+ "confidence": 0.4,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r016",+ "ms": 0.6778599999999955,+ "agent": "performance-engineer",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.03 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r017",+ "ms": 0.6723199999999991,+ "agent": "tester",+ "confidence": 0.45,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r018",+ "ms": 0.8345589999999987,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.1,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r019",+ "ms": 0.6087300000000084,+ "agent": "architect",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r020",+ "ms": 0.7459190000000007,+ "agent": "tester",+ "confidence": 0.49,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r021",+ "ms": 0.7987300000000062,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r022",+ "ms": 0.7592399999999913,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r023",+ "ms": 0.7007289999999955,+ "agent": "swarm-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.26, abstain 0.12, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r024",+ "ms": 0.18896000000000868,+ "agent": "architect",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.00 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r025",+ "ms": 0.41107999999999834,+ "agent": "memory-specialist",+ "confidence": 0.57,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r026",+ "ms": 0.7024100000000146,+ "agent": "coder",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r027",+ "ms": 0.6583490000000154,+ "agent": "performance-engineer",+ "confidence": 0.46,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r028",+ "ms": 0.8247100000000103,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r029",+ "ms": 0.6644300000000101,+ "agent": "architect",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "architect",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"architect\" (confidence 0.11, lift 1.24, abstain 0.11, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r030",+ "ms": 0.6200389999999913,+ "agent": "performance-engineer",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe choice \"performance-engineer\" (confidence 0.11, lift 1.22, abstain 0.12, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r031",+ "ms": 0.8232899999999859,+ "agent": "coder",+ "confidence": 0.41,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r032",+ "ms": 0.883388999999994,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r033",+ "ms": 1.2668899999999894,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r034",+ "ms": 0.3749990000000025,+ "agent": "swarm-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.27, abstain 0.12, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r035",+ "ms": 0.5838899999999967,+ "agent": "coder",+ "confidence": 0.49,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r036",+ "ms": 0.758260000000007,+ "agent": "security-architect",+ "confidence": 0.92,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.19 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r037",+ "ms": 1.1356289999999944,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r038",+ "ms": 1.083708999999999,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r039",+ "ms": 1.2929100000000062,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r040",+ "ms": 1.1259689999999978,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r041",+ "ms": 0.5261700000000076,+ "agent": "architect",+ "confidence": 0.55,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r042",+ "ms": 1.1971790000000055,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r043",+ "ms": 0.863759999999985,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r044",+ "ms": 0.7298690000000079,+ "agent": "architect",+ "confidence": 0.9,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r045",+ "ms": 1.08565999999999,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r046",+ "ms": 0.7882490000000075,+ "agent": "performance-engineer",+ "confidence": 0.49,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r047",+ "ms": 0.7227199999999812,+ "agent": "architect",+ "confidence": 0.9,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.20 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r048",+ "ms": 0.5935900000000061,+ "agent": "tester",+ "confidence": 0.57,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r049",+ "ms": 0.8077890000000139,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.19 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r050",+ "ms": 0.7293000000000234,+ "agent": "tester",+ "confidence": 0.43,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r051",+ "ms": 0.880010000000027,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r052",+ "ms": 0.704858999999999,+ "agent": "tester",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r053",+ "ms": 0.8035499999999729,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r054",+ "ms": 0.38181900000000724,+ "agent": "tester",+ "confidence": 0.67,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe top-1 margin 0.004 < min 0.005 (no clear winner); kept existing router"+ },+ {+ "id": "r055",+ "ms": 1.0082299999999975,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r056",+ "ms": 0.8829989999999839,+ "agent": "researcher",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "researcher",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"researcher\" (confidence 0.11, lift 1.23, abstain 0.11, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r057",+ "ms": 0.49995000000001255,+ "agent": "architect",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r058",+ "ms": 1.0408800000000156,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r059",+ "ms": 0.30237900000000195,+ "agent": "reviewer",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.21, abstain 0.12, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r060",+ "ms": 0.7820199999999886,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r061",+ "ms": 0.9510189999999739,+ "agent": "memory-specialist",+ "confidence": 0.12,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.09,+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.12, lift 1.28, abstain 0.09, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r062",+ "ms": 0.5250900000000058,+ "agent": "tester",+ "confidence": 0.6,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.20 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r063",+ "ms": 0.6221899999999891,+ "agent": "coder",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.09,+ "tsReason": "typesafe lift 1.19 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r064",+ "ms": 0.4244600000000105,+ "agent": "architect",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r065",+ "ms": 0.7871389999999963,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r066",+ "ms": 0.9542700000000082,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r067",+ "ms": 0.7059790000000135,+ "agent": "tester",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.16,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r068",+ "ms": 0.7147800000000188,+ "agent": "tester",+ "confidence": 0.4,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r069",+ "ms": 0.976239000000021,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r070",+ "ms": 0.830539999999985,+ "agent": "architect",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r071",+ "ms": 0.9879189999999767,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r072",+ "ms": 1.0242199999999855,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.09,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r073",+ "ms": 0.4943800000000067,+ "agent": "tester",+ "confidence": 0.57,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.02 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r074",+ "ms": 0.6057090000000187,+ "agent": "reviewer",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.21, abstain 0.12, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r075",+ "ms": 1.0891500000000178,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r076",+ "ms": 0.8810890000000029,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r077",+ "ms": 0.8713699999999847,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.19 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r078",+ "ms": 0.599679999999978,+ "agent": "tester",+ "confidence": 0.54,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.01 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r079",+ "ms": 0.7873089999999934,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r080",+ "ms": 1.0774000000000115,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r081",+ "ms": 0.28530900000001225,+ "agent": "coder",+ "confidence": 0.56,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r082",+ "ms": 0.6287700000000029,+ "agent": "tester",+ "confidence": 0.43,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r083",+ "ms": 0.4077699999999993,+ "agent": "tester",+ "confidence": 0.75,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r084",+ "ms": 0.8777489999999943,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r085",+ "ms": 0.6126799999999832,+ "agent": "tester",+ "confidence": 0.54,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r086",+ "ms": 0.8951589999999783,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r087",+ "ms": 1.0204999999999984,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe top-1 margin 0.003 < min 0.005 (no clear winner); kept existing router"+ },+ {+ "id": "r088",+ "ms": 0.43677999999999884,+ "agent": "tester",+ "confidence": 0.68,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r089",+ "ms": 0.9272890000000018,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r090",+ "ms": 0.14791999999999916,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.00 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r091",+ "ms": 0.4730599999999754,+ "agent": "tester",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r092",+ "ms": 0.7090490000000216,+ "agent": "tester",+ "confidence": 0.62,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.1,+ "tsReason": "typesafe top-1 margin 0.004 < min 0.005 (no clear winner); kept existing router"+ },+ {+ "id": "r093",+ "ms": 1.0338600000000042,+ "agent": "swarm-specialist",+ "confidence": 0.9,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r094",+ "ms": 0.9493490000000122,+ "agent": "performance-engineer",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r095",+ "ms": 0.5759400000000028,+ "agent": "memory-specialist",+ "confidence": 0.43,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.20 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r096",+ "ms": 0.6752400000000023,+ "agent": "tester",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r097",+ "ms": 0.256149999999991,+ "agent": "memory-specialist",+ "confidence": 0.65,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r098",+ "ms": 0.4616589999999974,+ "agent": "architect",+ "confidence": 0.62,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.02 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r099",+ "ms": 0.6078800000000228,+ "agent": "tester",+ "confidence": 0.49,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r100",+ "ms": 0.7351400000000012,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.1,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r101",+ "ms": 0.8538990000000126,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r102",+ "ms": 0.9906000000000006,+ "agent": "security-architect",+ "confidence": 0.92,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r103",+ "ms": 0.6858789999999999,+ "agent": "reviewer",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "reviewer",+ "tsAbstain": 0.09,+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.23, abstain 0.09, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r104",+ "ms": 0.40576999999998975,+ "agent": "tester",+ "confidence": 0.61,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r105",+ "ms": 0.3535399999999811,+ "agent": "security-architect",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "security-architect",+ "tsAbstain": 0.14,+ "tsReason": "typesafe choice \"security-architect\" (confidence 0.11, lift 1.27, abstain 0.14, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r106",+ "ms": 0.18804000000000087,+ "agent": "devops",+ "confidence": 0.51,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.00 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r107",+ "ms": 1.145889000000011,+ "agent": "memory-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.27, abstain 0.11, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r108",+ "ms": 0.6301400000000115,+ "agent": "performance-engineer",+ "confidence": 0.42,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r109",+ "ms": 0.9892689999999789,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r110",+ "ms": 0.5044100000000071,+ "agent": "tester",+ "confidence": 0.67,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r111",+ "ms": 0.7672400000000152,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r112",+ "ms": 0.9476789999999937,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r113",+ "ms": 1.2030190000000118,+ "agent": "memory-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.1,+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.25, abstain 0.10, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r114",+ "ms": 1.039779999999979,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r115",+ "ms": 0.8168589999999938,+ "agent": "architect",+ "confidence": 0.1,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "architect",+ "tsAbstain": 0.14,+ "tsReason": "typesafe choice \"architect\" (confidence 0.10, lift 1.22, abstain 0.14, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r116",+ "ms": 0.2743600000000015,+ "agent": "security-architect",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.00 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r117",+ "ms": 0.9303199999999947,+ "agent": "architect",+ "confidence": 0.9,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.16,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r118",+ "ms": 0.5653390000000229,+ "agent": "architect",+ "confidence": 0.46,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.16,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r119",+ "ms": 0.9479200000000105,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r120",+ "ms": 1.2012389999999868,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r121",+ "ms": 1.0345800000000054,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r122",+ "ms": 0.7114290000000096,+ "agent": "tester",+ "confidence": 0.47,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r123",+ "ms": 0.8806499999999744,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r124",+ "ms": 0.5119100000000003,+ "agent": "tester",+ "confidence": 0.13,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "tester",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"tester\" (confidence 0.13, lift 1.41, abstain 0.11, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r125",+ "ms": 0.9953689999999824,+ "agent": "devops",+ "confidence": 0.54,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r126",+ "ms": 1.2339100000000087,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r127",+ "ms": 0.5513589999999908,+ "agent": "swarm-specialist",+ "confidence": 0.1,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.10, lift 1.21, abstain 0.14, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r128",+ "ms": 0.7529499999999985,+ "agent": "devops",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.09,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r129",+ "ms": 0.8839590000000044,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r130",+ "ms": 0.3159199999999771,+ "agent": "performance-engineer",+ "confidence": 0.79,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r131",+ "ms": 1.1393700000000138,+ "agent": "swarm-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.30, abstain 0.13, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r132",+ "ms": 0.7625990000000229,+ "agent": "tester",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r133",+ "ms": 0.5882000000000005,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r134",+ "ms": 0.9354590000000087,+ "agent": "tester",+ "confidence": 0.13,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "tester",+ "tsAbstain": 0.1,+ "tsReason": "typesafe choice \"tester\" (confidence 0.13, lift 1.40, abstain 0.10, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r135",+ "ms": 0.7351899999999887,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r136",+ "ms": 0.7658399999999972,+ "agent": "tester",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "tester",+ "tsAbstain": 0.1,+ "tsReason": "typesafe choice \"tester\" (confidence 0.11, lift 1.21, abstain 0.10, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r137",+ "ms": 0.9619690000000105,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r138",+ "ms": 0.7622900000000072,+ "agent": "swarm-specialist",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r139",+ "ms": 0.5408390000000054,+ "agent": "tester",+ "confidence": 0.65,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r140",+ "ms": 0.9322300000000041,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.20 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r141",+ "ms": 0.6131190000000117,+ "agent": "tester",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.1,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r142",+ "ms": 1.0785199999999975,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r143",+ "ms": 0.3811600000000226,+ "agent": "architect",+ "confidence": 0.64,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r144",+ "ms": 0.6811689999999828,+ "agent": "tester",+ "confidence": 0.55,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r145",+ "ms": 0.6266799999999932,+ "agent": "architect",+ "confidence": 0.43,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r146",+ "ms": 0.9323599999999885,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.09,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r147",+ "ms": 0.9164089999999874,+ "agent": "memory-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.23, abstain 0.11, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r148",+ "ms": 0.18795000000000073,+ "agent": "devops",+ "confidence": 0.6,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.02 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r149",+ "ms": 0.7511900000000082,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.1,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r150",+ "ms": 1.121249000000006,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r151",+ "ms": 0.837459999999993,+ "agent": "tester",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "tester",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"tester\" (confidence 0.11, lift 1.21, abstain 0.11, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r152",+ "ms": 0.6902190000000132,+ "agent": "tester",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r153",+ "ms": 0.925200000000018,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.20 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r154",+ "ms": 0.7308189999999968,+ "agent": "architect",+ "confidence": 0.41,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r155",+ "ms": 0.9761399999999867,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r156",+ "ms": 1.2050089999999898,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r157",+ "ms": 1.4718990000000076,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r158",+ "ms": 0.9263899999999978,+ "agent": "researcher",+ "confidence": 0.12,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "researcher",+ "tsAbstain": 0.09,+ "tsReason": "typesafe choice \"researcher\" (confidence 0.12, lift 1.27, abstain 0.09, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r159",+ "ms": 0.9709489999999903,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.09,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r160",+ "ms": 0.7213600000000042,+ "agent": "swarm-specialist",+ "confidence": 0.45,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r161",+ "ms": 0.9614389999999844,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.11,+ "tsReason": "typesafe top-1 margin 0.001 < min 0.005 (no clear winner); kept existing router"+ },+ {+ "id": "r162",+ "ms": 0.6744199999999978,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r163",+ "ms": 0.31828000000001566,+ "agent": "memory-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.21, abstain 0.11, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r164",+ "ms": 0.6816889999999773,+ "agent": "performance-engineer",+ "confidence": 0.47,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r165",+ "ms": 0.5611900000000105,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r166",+ "ms": 0.7891100000000222,+ "agent": "swarm-specialist",+ "confidence": 0.9,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r167",+ "ms": 0.6759789999999839,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r168",+ "ms": 0.597910000000013,+ "agent": "tester",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r169",+ "ms": 0.47473999999999705,+ "agent": "tester",+ "confidence": 0.62,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.01 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r170",+ "ms": 0.6033199999999965,+ "agent": "tester",+ "confidence": 0.61,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.04 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r171",+ "ms": 0.589289000000008,+ "agent": "architect",+ "confidence": 0.65,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r172",+ "ms": 0.8337800000000186,+ "agent": "tester",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.16,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r173",+ "ms": 1.1043689999999913,+ "agent": "devops",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r174",+ "ms": 0.7817699999999945,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r175",+ "ms": 1.0981690000000128,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r176",+ "ms": 0.537700000000001,+ "agent": "memory-specialist",+ "confidence": 0.54,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r177",+ "ms": 0.6071799999999996,+ "agent": "devops",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.15,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r178",+ "ms": 0.6615889999999922,+ "agent": "memory-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.26, abstain 0.11, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r179",+ "ms": 1.138229999999993,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r180",+ "ms": 0.5328490000000272,+ "agent": "memory-specialist",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r181",+ "ms": 0.9709099999999751,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r182",+ "ms": 0.48512999999999806,+ "agent": "tester",+ "confidence": 0.65,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.00 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r183",+ "ms": 0.9013989999999978,+ "agent": "devops",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r184",+ "ms": 0.7587099999999793,+ "agent": "memory-specialist",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.1,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r185",+ "ms": 0.8375790000000052,+ "agent": "security-architect",+ "confidence": 0.4,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.1,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r186",+ "ms": 1.0024800000000198,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r187",+ "ms": 0.8109990000000096,+ "agent": "reviewer",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "reviewer",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.21, abstain 0.11, UNCALIBRATED hash embedder)"+ },+ {+ "id": "r188",+ "ms": 0.4828799999999944,+ "agent": "memory-specialist",+ "confidence": 0.55,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r189",+ "ms": 0.5638800000000117,+ "agent": "performance-engineer",+ "confidence": 0.41,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r190",+ "ms": 0.7799689999999941,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r191",+ "ms": 0.5746899999999755,+ "agent": "tester",+ "confidence": 0.45,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r192",+ "ms": 0.6727189999999723,+ "agent": "architect",+ "confidence": 0.42,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r193",+ "ms": 0.14687000000003536,+ "agent": "devops",+ "confidence": 0.56,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.17,+ "tsReason": "typesafe lift 1.00 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r194",+ "ms": 0.5548200000000065,+ "agent": "tester",+ "confidence": 0.59,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r195",+ "ms": 0.9417599999999879,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.1,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r196",+ "ms": 0.9004889999999932,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r197",+ "ms": 1.0082899999999881,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ }+ ],+ "rawTypesafeTest": {+ "n": 113,+ "accuracy": 0.3009,+ "macroF1": 0.261,+ "wrongHighConfRate": 0,+ "trapAccuracy": 0.3548+ },+ "typesafeUsedRate": 0.132+ },+ "D": {+ "dev": {+ "n": 84,+ "accuracy": 0.2619,+ "macroF1": 0.201,+ "wrongHighConfRate": 0.3214,+ "trapAccuracy": 0.303+ },+ "test": {+ "n": 113,+ "accuracy": 0.292,+ "macroF1": 0.2269,+ "wrongHighConfRate": 0.2655,+ "trapAccuracy": 0.3226+ },+ "latencyMs": {+ "cold": 680.49,+ "p50": 6.065,+ "p95": 8.348+ },+ "predictions": [+ {+ "id": "r001",+ "ms": 680.489166,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r002",+ "ms": 6.946136000000024,+ "agent": "coder",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r003",+ "ms": 7.140436000000022,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r004",+ "ms": 6.21740699999998,+ "agent": "tester",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r005",+ "ms": 6.7190669999999955,+ "agent": "tester",+ "confidence": 0.46,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r006",+ "ms": 6.2287859999999,+ "agent": "tester",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r007",+ "ms": 7.089035999999965,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r008",+ "ms": 6.475187000000005,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r009",+ "ms": 6.52781600000003,+ "agent": "swarm-specialist",+ "confidence": 0.4,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r010",+ "ms": 5.121347999999898,+ "agent": "tester",+ "confidence": 0.56,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r011",+ "ms": 6.134055999999987,+ "agent": "security-architect",+ "confidence": 0.92,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r012",+ "ms": 5.956986999999913,+ "agent": "tester",+ "confidence": 0.46,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r013",+ "ms": 3.498277999999914,+ "agent": "tester",+ "confidence": 0.64,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r014",+ "ms": 3.1682690000000093,+ "agent": "swarm-specialist",+ "confidence": 0.69,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.03 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r015",+ "ms": 7.187885999999935,+ "agent": "performance-engineer",+ "confidence": 0.4,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r016",+ "ms": 5.657317000000035,+ "agent": "performance-engineer",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.04 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r017",+ "ms": 5.902686000000017,+ "agent": "tester",+ "confidence": 0.45,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r018",+ "ms": 6.00802699999997,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r019",+ "ms": 4.699857999999949,+ "agent": "architect",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r020",+ "ms": 4.6604169999999385,+ "agent": "tester",+ "confidence": 0.49,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r021",+ "ms": 5.967307000000005,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r022",+ "ms": 5.916116999999986,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r023",+ "ms": 5.097266999999988,+ "agent": "swarm-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.27, abstain 0.11, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r024",+ "ms": 2.91074900000001,+ "agent": "architect",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.04 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r025",+ "ms": 4.3762069999999085,+ "agent": "memory-specialist",+ "confidence": 0.57,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.03 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r026",+ "ms": 4.957988,+ "agent": "coder",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r027",+ "ms": 5.694837000000007,+ "agent": "performance-engineer",+ "confidence": 0.46,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r028",+ "ms": 6.261406000000079,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r029",+ "ms": 5.26420799999994,+ "agent": "tester",+ "confidence": 0.43,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r030",+ "ms": 4.848856999999953,+ "agent": "swarm-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.21, abstain 0.11, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r031",+ "ms": 5.924626999999987,+ "agent": "coder",+ "confidence": 0.41,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r032",+ "ms": 7.963415999999938,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r033",+ "ms": 9.136655000000019,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r034",+ "ms": 4.268607000000088,+ "agent": "architect",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r035",+ "ms": 5.081647999999973,+ "agent": "coder",+ "confidence": 0.49,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r036",+ "ms": 5.530596999999943,+ "agent": "security-architect",+ "confidence": 0.92,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r037",+ "ms": 7.447426000000064,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r038",+ "ms": 7.825866000000019,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r039",+ "ms": 7.7432549999999765,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r040",+ "ms": 7.328505999999948,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r041",+ "ms": 5.469566999999984,+ "agent": "architect",+ "confidence": 0.55,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r042",+ "ms": 8.28758599999992,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r043",+ "ms": 7.244645999999989,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r044",+ "ms": 5.9551870000000235,+ "agent": "architect",+ "confidence": 0.9,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r045",+ "ms": 7.259896000000026,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r046",+ "ms": 5.957816999999977,+ "agent": "performance-engineer",+ "confidence": 0.49,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r047",+ "ms": 5.919226999999978,+ "agent": "architect",+ "confidence": 0.9,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r048",+ "ms": 5.682547,+ "agent": "tester",+ "confidence": 0.57,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r049",+ "ms": 6.210485999999946,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r050",+ "ms": 5.677227000000016,+ "agent": "tester",+ "confidence": 0.43,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r051",+ "ms": 6.083387000000016,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r052",+ "ms": 4.955638000000022,+ "agent": "tester",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r053",+ "ms": 6.133625999999936,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r054",+ "ms": 3.587218000000007,+ "agent": "tester",+ "confidence": 0.67,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r055",+ "ms": 6.393257000000062,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r056",+ "ms": 6.1659969999999475,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r057",+ "ms": 5.630175999999892,+ "agent": "architect",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r058",+ "ms": 7.0834370000000035,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r059",+ "ms": 3.9812480000000505,+ "agent": "swarm-specialist",+ "confidence": 0.47,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r060",+ "ms": 5.821956,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r061",+ "ms": 7.385346000000027,+ "agent": "performance-engineer",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe choice \"performance-engineer\" (confidence 0.11, lift 1.21, abstain 0.13, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r062",+ "ms": 5.49386800000002,+ "agent": "tester",+ "confidence": 0.6,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r063",+ "ms": 6.600755999999819,+ "agent": "coder",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r064",+ "ms": 4.2856279999998605,+ "agent": "architect",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.04 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r065",+ "ms": 6.302116999999953,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r066",+ "ms": 7.1125959999999395,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r067",+ "ms": 6.025355999999874,+ "agent": "tester",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "architect",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r068",+ "ms": 5.989237000000003,+ "agent": "tester",+ "confidence": 0.4,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r069",+ "ms": 7.343625999999858,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r070",+ "ms": 7.0737360000000535,+ "agent": "architect",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r071",+ "ms": 7.304817000000185,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r072",+ "ms": 8.46296499999994,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r073",+ "ms": 4.576477000000068,+ "agent": "tester",+ "confidence": 0.57,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r074",+ "ms": 5.888447000000042,+ "agent": "reviewer",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.24, abstain 0.14, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r075",+ "ms": 9.41539499999999,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r076",+ "ms": 7.252967000000126,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r077",+ "ms": 6.406545999999935,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r078",+ "ms": 5.118386999999984,+ "agent": "tester",+ "confidence": 0.54,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r079",+ "ms": 6.082007000000203,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r080",+ "ms": 7.613286000000016,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r081",+ "ms": 3.448378000000048,+ "agent": "coder",+ "confidence": 0.56,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r082",+ "ms": 6.549297000000024,+ "agent": "tester",+ "confidence": 0.43,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r083",+ "ms": 4.335017000000107,+ "agent": "tester",+ "confidence": 0.75,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r084",+ "ms": 6.480127000000039,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r085",+ "ms": 5.122626999999966,+ "agent": "tester",+ "confidence": 0.54,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r086",+ "ms": 6.8501269999999295,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r087",+ "ms": 8.347665000000006,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r088",+ "ms": 4.112217999999984,+ "agent": "tester",+ "confidence": 0.68,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r089",+ "ms": 6.311796999999842,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r090",+ "ms": 2.778088000000025,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.03 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r091",+ "ms": 5.390506999999843,+ "agent": "tester",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r092",+ "ms": 5.788297000000057,+ "agent": "tester",+ "confidence": 0.62,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r093",+ "ms": 7.283595999999989,+ "agent": "swarm-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.23, abstain 0.12, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r094",+ "ms": 7.009215999999924,+ "agent": "performance-engineer",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r095",+ "ms": 5.647676999999931,+ "agent": "memory-specialist",+ "confidence": 0.43,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r096",+ "ms": 5.9246669999999995,+ "agent": "tester",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r097",+ "ms": 3.026438999999982,+ "agent": "memory-specialist",+ "confidence": 0.65,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r098",+ "ms": 4.429276999999956,+ "agent": "architect",+ "confidence": 0.62,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r099",+ "ms": 5.645426999999927,+ "agent": "tester",+ "confidence": 0.49,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r100",+ "ms": 5.836987000000136,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r101",+ "ms": 6.541795999999977,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r102",+ "ms": 7.222107000000051,+ "agent": "security-architect",+ "confidence": 0.92,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r103",+ "ms": 5.862517000000025,+ "agent": "tester",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r104",+ "ms": 4.199446999999964,+ "agent": "tester",+ "confidence": 0.61,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r105",+ "ms": 3.4350379999998495,+ "agent": "architect",+ "confidence": 0.75,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r106",+ "ms": 2.7094889999998486,+ "agent": "devops",+ "confidence": 0.51,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r107",+ "ms": 8.454934999999978,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.19 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r108",+ "ms": 4.913187999999991,+ "agent": "performance-engineer",+ "confidence": 0.42,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r109",+ "ms": 6.556205999999975,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r110",+ "ms": 4.737817999999834,+ "agent": "tester",+ "confidence": 0.67,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r111",+ "ms": 6.772435999999971,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r112",+ "ms": 7.206455999999889,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r113",+ "ms": 9.83678500000019,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r114",+ "ms": 6.603885999999875,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.04 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r115",+ "ms": 6.386226999999963,+ "agent": "performance-engineer",+ "confidence": 0.41,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r116",+ "ms": 2.899548999999979,+ "agent": "security-architect",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.03 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r117",+ "ms": 7.245886000000155,+ "agent": "architect",+ "confidence": 0.9,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r118",+ "ms": 5.5369969999999284,+ "agent": "architect",+ "confidence": 0.46,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r119",+ "ms": 7.3438260000000355,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r120",+ "ms": 8.364295000000084,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r121",+ "ms": 6.585527000000184,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r122",+ "ms": 6.06540700000005,+ "agent": "tester",+ "confidence": 0.47,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r123",+ "ms": 7.354736000000003,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r124",+ "ms": 6.149785999999949,+ "agent": "tester",+ "confidence": 0.53,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r125",+ "ms": 5.242158000000018,+ "agent": "devops",+ "confidence": 0.54,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r126",+ "ms": 8.344994999999926,+ "agent": "performance-engineer",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe choice \"performance-engineer\" (confidence 0.11, lift 1.22, abstain 0.13, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r127",+ "ms": 6.014847000000145,+ "agent": "architect",+ "confidence": 0.45,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r128",+ "ms": 5.68466699999999,+ "agent": "devops",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.19 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r129",+ "ms": 6.8815759999999955,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r130",+ "ms": 3.466568000000052,+ "agent": "performance-engineer",+ "confidence": 0.1,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe choice \"performance-engineer\" (confidence 0.10, lift 1.21, abstain 0.13, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r131",+ "ms": 7.774255999999923,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r132",+ "ms": 6.018326999999999,+ "agent": "swarm-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.24, abstain 0.12, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r133",+ "ms": 6.236196999999947,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r134",+ "ms": 6.421205999999984,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r135",+ "ms": 5.934407000000192,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r136",+ "ms": 6.184917000000041,+ "agent": "devops",+ "confidence": 0.42,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r137",+ "ms": 6.462146000000075,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r138",+ "ms": 5.651927000000114,+ "agent": "swarm-specialist",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.19 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r139",+ "ms": 4.940247999999883,+ "agent": "tester",+ "confidence": 0.65,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r140",+ "ms": 7.294225999999981,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r141",+ "ms": 5.843875999999909,+ "agent": "tester",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r142",+ "ms": 6.983197000000018,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r143",+ "ms": 4.129478000000063,+ "agent": "architect",+ "confidence": 0.64,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r144",+ "ms": 5.622386000000006,+ "agent": "tester",+ "confidence": 0.55,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r145",+ "ms": 4.950728000000026,+ "agent": "architect",+ "confidence": 0.43,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r146",+ "ms": 6.295747000000119,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r147",+ "ms": 6.224605999999994,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r148",+ "ms": 2.6061090000000604,+ "agent": "devops",+ "confidence": 0.6,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r149",+ "ms": 5.934477000000015,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r150",+ "ms": 7.685555999999906,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r151",+ "ms": 6.848195999999916,+ "agent": "tester",+ "confidence": 0.4,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r152",+ "ms": 5.977187000000185,+ "agent": "tester",+ "confidence": 0.48,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r153",+ "ms": 6.50947599999995,+ "agent": "swarm-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.11,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.20, abstain 0.11, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r154",+ "ms": 5.789916999999832,+ "agent": "architect",+ "confidence": 0.41,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.17 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r155",+ "ms": 6.55345699999998,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r156",+ "ms": 8.374455000000125,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r157",+ "ms": 9.950925000000097,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r158",+ "ms": 7.04041600000005,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r159",+ "ms": 8.033665999999812,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r160",+ "ms": 5.2252770000000055,+ "agent": "swarm-specialist",+ "confidence": 0.45,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r161",+ "ms": 6.1733070000000225,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r162",+ "ms": 6.148975999999948,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r163",+ "ms": 3.3668190000000777,+ "agent": "tester",+ "confidence": 0.77,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r164",+ "ms": 6.06908599999997,+ "agent": "performance-engineer",+ "confidence": 0.47,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.08 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r165",+ "ms": 5.017358000000058,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r166",+ "ms": 5.860226999999895,+ "agent": "swarm-specialist",+ "confidence": 0.9,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r167",+ "ms": 5.78173599999991,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.07 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r168",+ "ms": 4.936807999999928,+ "agent": "tester",+ "confidence": 0.52,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r169",+ "ms": 4.650176999999985,+ "agent": "tester",+ "confidence": 0.62,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.11,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r170",+ "ms": 5.164177999999993,+ "agent": "tester",+ "confidence": 0.61,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r171",+ "ms": 4.569786999999906,+ "agent": "architect",+ "confidence": 0.65,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r172",+ "ms": 6.253367000000026,+ "agent": "tester",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r173",+ "ms": 7.1146259999998165,+ "agent": "devops",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.13 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r174",+ "ms": 6.306606999999985,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r175",+ "ms": 8.70054499999992,+ "agent": "coder",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r176",+ "ms": 5.005916999999954,+ "agent": "memory-specialist",+ "confidence": 0.54,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r177",+ "ms": 5.658337000000074,+ "agent": "devops",+ "confidence": 0.44,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r178",+ "ms": 5.706226999999899,+ "agent": "memory-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.21, abstain 0.12, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r179",+ "ms": 7.0876160000000255,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.16 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r180",+ "ms": 5.418577000000141,+ "agent": "memory-specialist",+ "confidence": 0.5,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r181",+ "ms": 7.45031599999993,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "security-architect",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r182",+ "ms": 4.161928000000216,+ "agent": "tester",+ "confidence": 0.65,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "performance-engineer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.05 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r183",+ "ms": 6.0329770000000735,+ "agent": "devops",+ "confidence": 0.85,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r184",+ "ms": 6.228517000000011,+ "agent": "swarm-specialist",+ "confidence": 0.11,+ "routedBy": "typesafe",+ "tsUsed": true,+ "tsRaw": "swarm-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.24, abstain 0.12, UNCALIBRATED onnx embedder)"+ },+ {+ "id": "r185",+ "ms": 6.4125360000000455,+ "agent": "security-architect",+ "confidence": 0.4,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "devops",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r186",+ "ms": 7.1195759999998245,+ "agent": "tester",+ "confidence": 0.95,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r187",+ "ms": 5.655626999999868,+ "agent": "architect",+ "confidence": 0.41,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.12 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r188",+ "ms": 4.3254779999999755,+ "agent": "memory-specialist",+ "confidence": 0.55,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.14 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r189",+ "ms": 5.599047000000155,+ "agent": "performance-engineer",+ "confidence": 0.41,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.14,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r190",+ "ms": 6.21515700000009,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.19 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r191",+ "ms": 6.528366000000005,+ "agent": "tester",+ "confidence": 0.45,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.11 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r192",+ "ms": 5.6939870000001065,+ "agent": "architect",+ "confidence": 0.42,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "coder",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.15 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r193",+ "ms": 2.7621990000000096,+ "agent": "devops",+ "confidence": 0.56,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "researcher",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.03 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r194",+ "ms": 4.839997000000039,+ "agent": "tester",+ "confidence": 0.59,+ "routedBy": "semantic-native",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.10 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r195",+ "ms": 7.125735999999961,+ "agent": "memory-specialist",+ "confidence": 0.88,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "memory-specialist",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.18 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r196",+ "ms": 6.921207000000095,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "tester",+ "tsAbstain": 0.13,+ "tsReason": "typesafe lift 1.09 (top-1 Γ 10 options) < min 1.20; kept existing router"+ },+ {+ "id": "r197",+ "ms": 6.566915999999992,+ "agent": "coder",+ "confidence": 0.7,+ "routedBy": "keyword",+ "tsUsed": false,+ "tsRaw": "reviewer",+ "tsAbstain": 0.12,+ "tsReason": "typesafe lift 1.06 (top-1 Γ 10 options) < min 1.20; kept existing router"+ }+ ],+ "rawTypesafeTest": {+ "n": 113,+ "accuracy": 0.4425,+ "macroF1": 0.4105,+ "wrongHighConfRate": 0,+ "trapAccuracy": 0.3226+ },+ "typesafeUsedRate": 0.0558+ }+ }+}diff --git a/v3/@claude-flow/cli/benchmarks/router/run-bench.mjs b/v3/@claude-flow/cli/benchmarks/router/run-bench.mjsnew file mode 100644index 0000000000..b87a552108--- /dev/null+++ b/v3/@claude-flow/cli/benchmarks/router/run-bench.mjs@@ -0,0 +1,168 @@+#!/usr/bin/env node+/**+ * ADR-391 router benchmark.+ *+ * node benchmarks/router/run-bench.mjs # all candidates, writes results/+ * node benchmarks/router/run-bench.mjs --candidate A # one candidate (child mode)+ *+ * Candidates (ADR-391 Β§Context):+ * A current routeTaskForBench, hash embedder (default router)+ * B minilm routeTaskForBench, MiniLM embedder (ADR-390)+ * C ts-hash hooks_route + CLAUDE_FLOW_ROUTER_TYPESAFE=1, hash embedder+ * D ts-onnx hooks_route + typesafe, ONNX (bge-small) β needs+ * ROUTER_BENCH_TYPESAFE_MODEL_DIR pointing at a fetched models/ dir+ *+ * Each candidate runs in its own process from an empty temp cwd so no engine,+ * index or stored memory leaks between candidates. Requires a built dist/.+ * The corpus is read-only and frozen (see README.md for its sha256).+ */+import { spawnSync } from 'node:child_process';+import { createHash } from 'node:crypto';+import { mkdtempSync, readFileSync, writeFileSync, mkdirSync } from 'node:fs';+import { tmpdir } from 'node:os';+import { dirname, join } from 'node:path';+import { fileURLToPath, pathToFileURL } from 'node:url';++const HERE = dirname(fileURLToPath(import.meta.url));+const CLI_ROOT = join(HERE, '..', '..');+const CORPUS = join(HERE, 'corpus.jsonl');+const HOOKS = pathToFileURL(join(CLI_ROOT, 'dist', 'src', 'mcp-tools', 'hooks-tools.js')).href;+const CANDIDATES = ['A', 'B', 'C', 'D'];+const HIGH_CONF = 0.7;++const argv = process.argv.slice(2);+const arg = (k) => { const i = argv.indexOf(k); return i >= 0 ? argv[i + 1] : undefined; };++function loadCorpus() {+ const raw = readFileSync(CORPUS);+ const rows = raw.toString('utf8').split('\n').filter(Boolean).map((l) => JSON.parse(l));+ return { rows, sha256: createHash('sha256').update(raw).digest('hex') };+}++const pct = (xs, p) => { const s = [...xs].sort((a, b) => a - b); return s.length ? s[Math.min(s.length - 1, Math.floor(p * s.length))] : 0; };++async function runChild(cand) {+ const { rows } = loadCorpus();+ const hooks = await import(HOOKS);+ const out = [];+ let cold = null;+ const route = async (prompt) => {+ if (cand === 'A' || cand === 'B') {+ const r = await hooks.routeTaskForBench(prompt, { embedder: cand === 'A' ? 'hash' : 'minilm' });+ return { agent: r.primaryAgent, confidence: r.confidence, embedder: r.embedder, method: r.method };+ }+ const r = await hooks.hooksRoute.handler({ task: prompt });+ const ts = r.typesafe ?? {};+ return {+ agent: r.primaryAgent?.type,+ confidence: r.primaryAgent?.confidence,+ routedBy: r.routedBy,+ tsUsed: !!ts.used,+ tsRaw: ts.choice ?? ts.answer?.choice ?? null,+ tsAbstain: ts.abstain ?? ts.answer?.abstain ?? null,+ tsReason: ts.reason,+ };+ };+ for (const row of rows) {+ const t0 = performance.now();+ const r = await route(row.prompt);+ const ms = performance.now() - t0;+ if (cold === null) cold = ms;+ out.push({ id: row.id, ms, ...r });+ }+ // The router keeps native handles (VectorDb, model sessions) alive; exit+ // explicitly once the result is flushed or spawnSync in the parent never returns.+ process.stdout.write('\n@@RESULT@@' + JSON.stringify({ cand, cold, out }) + '\n', () => process.exit(0));+}++function score(rows, preds, split) {+ const byId = new Map(preds.map((p) => [p.id, p]));+ const set = rows.filter((r) => split === 'all' || r.split === split);+ const labels = [...new Set(rows.map((r) => r.label))];+ let correct = 0, wrongHigh = 0, trapN = 0, trapOk = 0;+ const tp = {}, fp = {}, fn = {};+ for (const r of set) {+ const p = byId.get(r.id);+ const pred = p?.agent ?? 'none';+ const ok = pred === r.label;+ if (ok) correct++;+ else if ((p?.confidence ?? 0) >= HIGH_CONF) wrongHigh++;+ if (r.trap) { trapN++; if (ok) trapOk++; }+ if (ok) tp[r.label] = (tp[r.label] ?? 0) + 1;+ else { fn[r.label] = (fn[r.label] ?? 0) + 1; fp[pred] = (fp[pred] ?? 0) + 1; }+ }+ const f1s = labels.map((l) => {+ const t = tp[l] ?? 0, P = t + (fp[l] ?? 0), R = t + (fn[l] ?? 0);+ const prec = P ? t / P : 0, rec = R ? t / R : 0;+ return prec + rec ? (2 * prec * rec) / (prec + rec) : 0;+ });+ return {+ n: set.length,+ accuracy: +(correct / set.length).toFixed(4),+ macroF1: +(f1s.reduce((a, b) => a + b, 0) / f1s.length).toFixed(4),+ wrongHighConfRate: +(wrongHigh / set.length).toFixed(4),+ trapAccuracy: trapN ? +(trapOk / trapN).toFixed(4) : null,+ };+}++function runParent() {+ const { rows, sha256 } = loadCorpus();+ const only = arg('--only') ? arg('--only').split(',') : CANDIDATES;+ const results = {};+ for (const cand of only) {+ const env = { ...process.env };+ delete env.CLAUDE_FLOW_ROUTER_TYPESAFE; delete env.CLAUDE_FLOW_ROUTER_EMBEDDER;+ delete env.CLAUDE_FLOW_ROUTER_TYPESAFE_MODEL_DIR; delete env.CLAUDE_FLOW_ROUTER_TYPESAFE_MANIFEST;+ if (cand === 'C' || cand === 'D') env.CLAUDE_FLOW_ROUTER_TYPESAFE = '1';+ if (cand === 'D') {+ const dir = process.env.ROUTER_BENCH_TYPESAFE_MODEL_DIR;+ if (!dir) { results[cand] = { skipped: 'ROUTER_BENCH_TYPESAFE_MODEL_DIR not set' }; continue; }+ env.CLAUDE_FLOW_ROUTER_TYPESAFE_MODEL_DIR = dir;+ env.CLAUDE_FLOW_ROUTER_TYPESAFE_MANIFEST = join(dir, 'manifest.json');+ }+ const cwd = mkdtempSync(join(tmpdir(), `router-bench-${cand}-`));+ const res = spawnSync(process.execPath, [fileURLToPath(import.meta.url), '--candidate', cand], { cwd, env, encoding: 'utf8', maxBuffer: 64 << 20 });+ const line = (res.stdout || '').split('\n').find((l) => l.startsWith('@@RESULT@@'));+ if (!line) { results[cand] = { error: (res.stderr || '').slice(-2000) }; continue; }+ const { cold, out } = JSON.parse(line.slice(10));+ const warm = out.slice(1).map((o) => o.ms);+ const r = {+ dev: score(rows, out, 'dev'),+ test: score(rows, out, 'test'),+ latencyMs: { cold: +cold.toFixed(2), p50: +pct(warm, 0.5).toFixed(3), p95: +pct(warm, 0.95).toFixed(3) },+ predictions: out,+ };+ if (cand === 'C' || cand === 'D') {+ // Raw typesafe pick before the lift/abstain gate, with abstain-gated rows counted as 'none'.+ const raw = out.map((o) => ({ id: o.id, agent: o.tsUsed ? o.tsRaw : (o.tsRaw && /abstain/.test(o.tsReason ?? '') ? 'none' : o.tsRaw), confidence: 0 }));+ r.rawTypesafeTest = score(rows, raw, 'test');+ r.typesafeUsedRate = +(out.filter((o) => o.tsUsed).length / out.length).toFixed(4);+ }+ results[cand] = r;+ console.log(`${cand}: test acc ${r.test.accuracy} macroF1 ${r.test.macroF1} traps ${r.test.trapAccuracy} wrong@β₯${HIGH_CONF} ${r.test.wrongHighConfRate} p50 ${r.latencyMs.p50}ms p95 ${r.latencyMs.p95}ms cold ${r.latencyMs.cold}ms` + (r.rawTypesafeTest ? ` | raw typesafe acc ${r.rawTypesafeTest.accuracy}, used ${r.typesafeUsedRate}` : ''));+ }+ // ADR-391 promotion gate, each candidate vs A on the TEST split.+ const A = results.A;+ const gate = {};+ for (const c of Object.keys(results)) {+ if (c === 'A' || !results[c]?.test || !A?.test) continue;+ const dAcc = +((results[c].test.accuracy - A.test.accuracy) * 100).toFixed(2);+ const latReg = A.latencyMs.p95 > 0 ? +(((results[c].latencyMs.p95 - A.latencyMs.p95) / A.latencyMs.p95) * 100).toFixed(1) : null;+ gate[c] = {+ accuracyDeltaPts: dAcc,+ p95LatencyRegressionPct: latReg,+ requiredDependencyAdded: c === 'C' || c === 'D',+ passesAccuracy: dAcc > 2,+ passesLatency: latReg !== null && latReg <= 5,+ passesDependency: !(c === 'C' || c === 'D') ? true : 'optional-peer (allowed only as opt-in)',+ };+ }+ const receipt = { adr: 'ADR-391', ts: new Date().toISOString(), corpusSha256: sha256, node: process.version, host: process.platform + '-' + process.arch, highConfidence: HIGH_CONF, gate, results };+ const dir = join(HERE, 'results'); mkdirSync(dir, { recursive: true });+ const file = join(dir, `router-bench-${receipt.ts.slice(0, 10)}.json`);+ writeFileSync(file, JSON.stringify(receipt, null, 2) + '\n');+ console.log('\ngate:', JSON.stringify(gate, null, 1), '\nreceipt:', file, '\ncorpus sha256:', sha256);+}++if (arg('--candidate')) await runChild(arg('--candidate'));+else runParent();diff --git a/v3/@claude-flow/cli/benchmarks/router/validate-corpus.mjs b/v3/@claude-flow/cli/benchmarks/router/validate-corpus.mjsnew file mode 100644index 0000000000..218dab4586--- /dev/null+++ b/v3/@claude-flow/cli/benchmarks/router/validate-corpus.mjs@@ -0,0 +1,91 @@+#!/usr/bin/env node+// ADR-391 router corpus validator. No dependencies.+// Usage: node validate-corpus.mjs [path/to/corpus.jsonl]+// Exits 1 on any failure; prints per-label x split counts and the sha256.+import { readFileSync } from 'node:fs';+import { createHash } from 'node:crypto';+import { dirname, join } from 'node:path';+import { fileURLToPath } from 'node:url';++const path = process.argv[2] ?? join(dirname(fileURLToPath(import.meta.url)), 'corpus.jsonl');+const LABELS = ['coder', 'tester', 'reviewer', 'researcher', 'architect', 'security-architect',+ 'performance-engineer', 'devops', 'swarm-specialist', 'memory-specialist', 'none'];+const MIN_PER_LABEL = 8;+const NONE_RANGE = [15, 20];+const TOTAL_RANGE = [180, 200];+const MIN_TRAPS = 30;++const buf = readFileSync(path);+const sha = createHash('sha256').update(buf).digest('hex');+const text = buf.toString('utf8');+const errors = [];+if (text.includes('\r')) errors.push('file contains CR characters (must be LF only)');+if (!text.endsWith('\n') || text.endsWith('\n\n')) errors.push('file must end with exactly one trailing newline');++const rows = [];+text.split('\n').forEach((line, i) => {+ if (line === '') return;+ try { rows.push(JSON.parse(line)); } catch (e) { errors.push(`line ${i + 1}: invalid JSON (${e.message})`); }+});++const ids = new Set();+for (const r of rows) {+ const where = r.id ?? '(no id)';+ if (typeof r.id !== 'string' || !/^r\d{3}$/.test(r.id)) errors.push(`${where}: id must match ^r\\d{3}$`);+ else if (ids.has(r.id)) errors.push(`${where}: duplicate id`);+ else ids.add(r.id);+ if (typeof r.prompt !== 'string' || r.prompt.trim() === '') errors.push(`${where}: empty prompt`);+ if (!LABELS.includes(r.label)) errors.push(`${where}: unknown label ${JSON.stringify(r.label)}`);+ if (r.split !== 'dev' && r.split !== 'test') errors.push(`${where}: split must be dev|test`);+ if (typeof r.trap !== 'boolean') errors.push(`${where}: trap must be boolean`);+ if (!['issue', 'pr', 'synthetic'].includes(r.source)) errors.push(`${where}: source must be issue|pr|synthetic`);+ if (typeof r.note !== 'string' || r.note.trim() === '') errors.push(`${where}: note required`);+}++const prompts = new Set();+for (const r of rows) {+ const k = String(r.prompt).trim().toLowerCase();+ if (prompts.has(k)) errors.push(`${r.id}: duplicate prompt`);+ prompts.add(k);+}++// Recompute the documented split rule: within each label, sort by id;+// 0-indexed position i -> dev iff i % 5 is 0 or 2, else test.+const byLabel = Object.fromEntries(LABELS.map((l) => [l, []]));+for (const r of rows) if (byLabel[r.label]) byLabel[r.label].push(r);+for (const list of Object.values(byLabel)) {+ [...list].sort((a, b) => a.id.localeCompare(b.id)).forEach((r, i) => {+ const want = i % 5 === 0 || i % 5 === 2 ? 'dev' : 'test';+ if (r.split !== want) errors.push(`${r.id}: split is ${r.split}, split rule says ${want}`);+ });+}++// Thresholds+if (rows.length < TOTAL_RANGE[0] || rows.length > TOTAL_RANGE[1]) errors.push(`total ${rows.length} outside ${TOTAL_RANGE.join('-')}`);+for (const l of LABELS) {+ const n = byLabel[l].length;+ if (l === 'none') { if (n < NONE_RANGE[0] || n > NONE_RANGE[1]) errors.push(`none has ${n}, want ${NONE_RANGE.join('-')}`); }+ else if (n < MIN_PER_LABEL) errors.push(`${l} has ${n}, want >= ${MIN_PER_LABEL}`);+}+const traps = rows.filter((r) => r.trap === true).length;+if (traps < MIN_TRAPS) errors.push(`only ${traps} trap cases, want >= ${MIN_TRAPS}`);++// Report+const pad = (s, n) => String(s).padEnd(n);+console.log(pad('label', 22) + pad('dev', 6) + pad('test', 6) + pad('total', 7) + 'traps');+let dev = 0, test = 0;+for (const l of LABELS) {+ const d = byLabel[l].filter((r) => r.split === 'dev').length;+ const t = byLabel[l].filter((r) => r.split === 'test').length;+ dev += d; test += t;+ console.log(pad(l, 22) + pad(d, 6) + pad(t, 6) + pad(d + t, 7) + byLabel[l].filter((r) => r.trap).length);+}+console.log(pad('TOTAL', 22) + pad(dev, 6) + pad(test, 6) + pad(rows.length, 7) + traps);+console.log(`sha256 ${sha} ${path}`);++if (errors.length) {+ console.error(`\nFAIL (${errors.length}):`);+ for (const e of errors) console.error(' - ' + e);+ process.exit(1);+}+console.log('OK');diff --git a/v3/@claude-flow/cli/scripts/sign-helpers.mjs b/v3/@claude-flow/cli/scripts/sign-helpers.mjsindex a416cf321d..88421b9985 100644--- a/v3/@claude-flow/cli/scripts/sign-helpers.mjs+++ b/v3/@claude-flow/cli/scripts/sign-helpers.mjs@@ -31,7 +31,7 @@ const __dirname = dirname(fileURLToPath(import.meta.url));const PKG_ROOT = join(__dirname, '..');const HELPERS_DIR = join(PKG_ROOT, '.claude', 'helpers');// Keep in sync with src/init/helper-refresh.ts:CRITICAL_HELPERS.-const CRITICAL = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs'];+const CRITICAL = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs', 'router.js'];function loadPrivateKey() {if (process.argv.includes('--stdin-key')) {diff --git a/v3/@claude-flow/cli/scripts/verify-helpers.mjs b/v3/@claude-flow/cli/scripts/verify-helpers.mjsindex c78cc08dd1..60dbd6d3d4 100644--- a/v3/@claude-flow/cli/scripts/verify-helpers.mjs+++ b/v3/@claude-flow/cli/scripts/verify-helpers.mjs@@ -22,7 +22,7 @@ const __dirname = dirname(fileURLToPath(import.meta.url));const PKG_ROOT = join(__dirname, '..');const HELPERS_DIR = resolve(process.argv[2] || join(PKG_ROOT, '.claude', 'helpers'));// Keep in sync with sign-helpers.mjs:CRITICAL and src/init/helper-refresh.ts:CRITICAL_HELPERS.-const CRITICAL = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs'];+const CRITICAL = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs', 'router.js'];function die(msg) { console.error(`[verify-helpers] ${msg}`); process.exit(1); }diff --git a/v3/@claude-flow/cli/src/init/executor.ts b/v3/@claude-flow/cli/src/init/executor.tsindex 27cda7f88e..41dc8d8255 100644--- a/v3/@claude-flow/cli/src/init/executor.ts+++ b/v3/@claude-flow/cli/src/init/executor.ts@@ -575,7 +575,7 @@ export async function executeUpgrade(targetDir: string, upgradeSettings = false)const sourceHelpersForUpgrade = findSourceHelpersDir();if (sourceHelpersForUpgrade) {// Keep in sync with helper-refresh.ts:CRITICAL_HELPERS.- const criticalHelpers = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs'];+ const criticalHelpers = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs', 'router.js'];for (const helperName of criticalHelpers) {const targetPath = path.join(targetDir, '.claude', 'helpers', helperName);const sourcePath = path.join(sourceHelpersForUpgrade, helperName);@@ -595,6 +595,7 @@ export async function executeUpgrade(targetDir: string, upgradeSettings = false)'hook-handler.cjs': generateHookHandler(),'intelligence.cjs': generateIntelligenceStub(),'auto-memory-hook.mjs': generateAutoMemoryHook(),+ 'router.js': generateAgentRouter(), // ADR-389};for (const [helperName, content] of Object.entries(generatedCritical)) {const targetPath = path.join(targetDir, '.claude', 'helpers', helperName);diff --git a/v3/@claude-flow/cli/src/init/helper-refresh.ts b/v3/@claude-flow/cli/src/init/helper-refresh.tsindex 633440d077..1f00b33aaf 100644--- a/v3/@claude-flow/cli/src/init/helper-refresh.ts+++ b/v3/@claude-flow/cli/src/init/helper-refresh.ts@@ -84,6 +84,10 @@ export const CRITICAL_HELPERS = [// statusline.cjs is here so the funnel disclosure row (ADR-301) reaches// existing installs on the next `ruflo` command, not only fresh `ruflo init`.'statusline.cjs',+ // router.js is loaded by hook-handler.cjs to label each prompt with an agent.+ // Without it here, installs kept the pre-#2257 substring router forever+ // ("latest" -> tester). ADR-389 / #3401.+ 'router.js',];function errorCode(error: unknown): string | undefined {@@ -301,6 +305,7 @@ async function writeCriticalHelpers('hook-handler.cjs': gen.generateHookHandler(),'intelligence.cjs': gen.generateIntelligenceStub(),'auto-memory-hook.mjs': gen.generateAutoMemoryHook(),+ 'router.js': gen.generateAgentRouter(), // ADR-389// Fallback needs the same generator inputs `ruflo init` uses. We match the// hardcoded default (maxAgents 15) because the fallback fires when the// installed package is unresolvable β no way to read the user's projectdiff --git a/v3/@claude-flow/cli/src/mcp-tools/hooks-tools.ts b/v3/@claude-flow/cli/src/mcp-tools/hooks-tools.tsindex 955b91f215..32cf57dbc4 100644--- a/v3/@claude-flow/cli/src/mcp-tools/hooks-tools.ts+++ b/v3/@claude-flow/cli/src/mcp-tools/hooks-tools.ts@@ -15,6 +15,12 @@ import {type LearnedRoutingPattern,} from '../services/learned-routing.js';import { applyTypesafeRouting, getTypesafeRouter } from '../ruvector/typesafe-router.js';+import {+ DEFAULT_ROUTER_EMBEDDER,+ embedForRouter,+ resolveRouterEmbedder,+ type RouterEmbedderKind,+} from '../ruvector/router-embedder.js';// Real vector search functions - lazy loaded to avoid circular importslet searchEntriesFn: ((options: {@@ -139,54 +145,18 @@ async function getMoERouter() {// Tries native VectorDb first (16k+ routes/s HNSW), falls back to pure JS (47k routes/s cosine)let semanticRouter: import('../ruvector/semantic-router.js').SemanticRouter | null = null;let nativeVectorDb: unknown = null;-let semanticRouterInitialized = false;let routerBackend: 'native' | 'pure-js' | 'none' = 'none';// Pre-computed embeddings for common task patterns (cached)const TASK_PATTERN_EMBEDDINGS: Map<string, Float32Array> = new Map();-function generateSimpleEmbedding(text: string, dimension: number = 384): Float32Array {- // Simple deterministic embedding based on character codes- // This is for routing purposes where we need consistent, fast embeddings- const embedding = new Float32Array(dimension);- const normalized = text.toLowerCase().replace(/[^a-z0-9\s]/g, '');- const words = normalized.split(/\s+/).filter(w => w.length > 0);-- // Combine word-level and character-level features- for (let i = 0; i < dimension; i++) {- let value = 0;-- // Word-level features- for (let w = 0; w < words.length; w++) {- const word = words[w];- for (let c = 0; c < word.length; c++) {- const charCode = word.charCodeAt(c);- value += Math.sin((charCode * (i + 1) + w * 17 + c * 23) * 0.0137);- }- }-- // Character-level features- for (let c = 0; c < text.length; c++) {- value += Math.cos((text.charCodeAt(c) * (i + 1) + c * 7) * 0.0073);- }-- embedding[i] = value / Math.max(1, text.length);- }-- // Normalize- let norm = 0;- for (let i = 0; i < dimension; i++) {- norm += embedding[i] * embedding[i];- }- norm = Math.sqrt(norm);- if (norm > 0) {- for (let i = 0; i < dimension; i++) {- embedding[i] /= norm;- }- }-- return embedding;-}+// ADR-390: the router's embedder (MiniLM or the historical hash). Pattern and+// query vectors always come from the SAME embedder; `routerEmbedder` records the+// one that actually built the current index (after any degradation to hash).+let routerEmbedder: RouterEmbedderKind = DEFAULT_ROUTER_EMBEDDER;+let routerEmbedderReason: string | undefined;+let routerRequestedEmbedder: RouterEmbedderKind | null = null;+let routerInitPromise: Promise<SemanticRouterHandle> | null = null;// ββ Runtime routing outcome persistence ββββββββββββββββββββββββββββββ// Closes the learning loop: post-task records outcomes β route loads them.@@ -243,7 +213,8 @@ function saveRoutingOutcomes(outcomes: RoutingOutcome[]): void {// The prior singleton cache made the learned store inert until restart.semanticRouter = null;nativeVectorDb = null;- semanticRouterInitialized = false;+ routerInitPromise = null;+ routerRequestedEmbedder = null;routerBackend = 'none';TASK_PATTERN_EMBEDDINGS.clear();} catch { /* non-critical */ }@@ -332,15 +303,76 @@ function withTypesafeRouting(legacy: (params: Record<string, unknown>) => PromisapplyTypesafeRouting(params, (await legacy(params)) as Record<string, unknown>, TASK_PATTERNS, getTypesafeRouter());}+interface SemanticRouterHandle {+ router: import('../ruvector/semantic-router.js').SemanticRouter | null;+ backend: 'native' | 'pure-js' | 'none';+ native: unknown;+ /** Embedder that built this index (ADR-390); the query MUST use the same one. */+ embedder: RouterEmbedderKind;+ embedderReason?: string;+}+/*** Get the semantic router with environment detection.* Tries native VectorDb first (HNSW, 16k routes/s), falls back to pure JS (47k routes/s cosine).+ *+ * ADR-390: `requested` (else CLAUDE_FLOW_ROUTER_EMBEDDER, else the default)+ * picks the embedder. The index is rebuilt when the requested embedder changes.+ * Concurrent callers share one in-flight build.*/-async function getSemanticRouter() {- if (semanticRouterInitialized) {- return { router: semanticRouter, backend: routerBackend, native: nativeVectorDb };+async function getSemanticRouter(requested?: RouterEmbedderKind): Promise<SemanticRouterHandle> {+ const selection = resolveRouterEmbedder(requested);+ if (routerInitPromise && routerRequestedEmbedder === selection.kind) {+ return routerInitPromise;+ }+ semanticRouter = null;+ nativeVectorDb = null;+ routerBackend = 'none';+ TASK_PATTERN_EMBEDDINGS.clear();+ routerRequestedEmbedder = selection.kind;+ routerInitPromise = buildSemanticRouter(selection.kind, selection.reason);+ return routerInitPromise;+}++/** Test hook: drop the cached semantic index so the next route rebuilds it. */+export function resetSemanticRouterForTests(): void {+ semanticRouter = null;+ nativeVectorDb = null;+ routerBackend = 'none';+ routerInitPromise = null;+ routerRequestedEmbedder = null;+ TASK_PATTERN_EMBEDDINGS.clear();+}++/** Embed every pattern keyword with ONE embedder (ADR-390: never mix spaces). */+async function embedPatternKeywords(+ patterns: Record<string, RoutingPattern>,+ kind: RouterEmbedderKind,+): Promise<{ vectors: Map<string, Float32Array[]>; embedder: RouterEmbedderKind; reason?: string }> {+ const entries = Object.entries(patterns);+ const flat = entries.flatMap(([, p]) => p.keywords);+ const res = await embedForRouter(flat, kind);+ const vectors = new Map<string, Float32Array[]>();+ let i = 0;+ for (const [name, p] of entries) {+ vectors.set(name, res.vectors.slice(i, i + p.keywords.length));+ i += p.keywords.length;}- semanticRouterInitialized = true;+ return { vectors, embedder: res.embedder, reason: res.reason };+}++async function buildSemanticRouter(kind: RouterEmbedderKind, selectionReason?: string): Promise<SemanticRouterHandle> {+ const patterns = getMergedTaskPatterns();+ const embedded = await embedPatternKeywords(patterns, kind);+ routerEmbedder = embedded.embedder;+ routerEmbedderReason = embedded.reason ?? selectionReason;+ const handle = (): SemanticRouterHandle => ({+ router: semanticRouter,+ backend: routerBackend,+ native: nativeVectorDb,+ embedder: routerEmbedder,+ ...(routerEmbedderReason ? { embedderReason: routerEmbedderReason } : {}),+ });// STEP 1: Try native VectorDb from @ruvector/router (HNSW-backed)// Note: Native VectorDb uses a persistent database file which can have lock issues@@ -364,18 +396,18 @@ async function getSemanticRouter() {});// Initialize with static + runtime-learned task patterns- for (const [patternName, { keywords }] of Object.entries(getMergedTaskPatterns())) {- for (const keyword of keywords) {- const embedding = generateSimpleEmbedding(keyword);- db.insert(`${patternName}:${keyword}`, embedding);- TASK_PATTERN_EMBEDDINGS.set(`${patternName}:${keyword}`, embedding);- }+ for (const [patternName, { keywords }] of Object.entries(patterns)) {+ const embeddings = embedded.vectors.get(patternName) ?? [];+ keywords.forEach((keyword, i) => {+ db.insert(`${patternName}:${keyword}`, embeddings[i]);+ TASK_PATTERN_EMBEDDINGS.set(`${patternName}:${keyword}`, embeddings[i]);+ });}nativeVectorDb = db;routerBackend = 'native';- console.log('[hooks] Semantic router initialized: native VectorDb (HNSW, 16k+ routes/s)');- return { router: null, backend: routerBackend, native: nativeVectorDb };+ console.log(`[hooks] Semantic router initialized: native VectorDb (HNSW, 16k+ routes/s), embedder=${routerEmbedder}`);+ return handle();}} catch (err) {// Native not available or database locked - fall back to pure JS@@ -388,8 +420,8 @@ async function getSemanticRouter() {const { SemanticRouter } = await import('../ruvector/semantic-router.js');semanticRouter = new SemanticRouter({ dimension: 384 });- for (const [patternName, { keywords, agents, source, support, reliability }] of Object.entries(getMergedTaskPatterns())) {- const embeddings = keywords.map(kw => generateSimpleEmbedding(kw));+ for (const [patternName, { keywords, agents, source, support, reliability }] of Object.entries(patterns)) {+ const embeddings = embedded.vectors.get(patternName) ?? [];semanticRouter.addIntentWithEmbeddings(patternName, embeddings, {agents,keywords,@@ -405,14 +437,14 @@ async function getSemanticRouter() {}routerBackend = 'pure-js';- console.log('[hooks] Semantic router initialized: pure JS (cosine, 47k routes/s)');+ console.log(`[hooks] Semantic router initialized: pure JS (cosine, 47k routes/s), embedder=${routerEmbedder}`);} catch {semanticRouter = null;routerBackend = 'none';console.log('[hooks] Semantic router initialized: none (no backend available)');}- return { router: semanticRouter, backend: routerBackend, native: nativeVectorDb };+ return handle();}/**@@ -1183,10 +1215,30 @@ export const hooksRoute: MCPTool = {}}+ return routeTaskLocal(task, context, useSemanticRouter);+ }),+};++/**+ * hooks_route's local routing (semantic index + keyword fallback), run after the+ * AgentDB pre-route. Shared with {@link routeTaskForBench} so the benchmark+ * measures exactly the path hooks_route takes. (Body kept at its original+ * indentation to keep this refactor's diff small.)+ */+async function routeTaskLocal(+ task: string,+ context: string | undefined,+ useSemanticRouter: boolean,+ embedderOverride?: RouterEmbedderKind,+): Promise<LocalRouteResult> {// Get router (tries native VectorDb first, falls back to pure JS)- const { router, backend, native } = useSemanticRouter- ? await getSemanticRouter()- : { router: null, backend: 'none' as const, native: null };+ let handle: SemanticRouterHandle = useSemanticRouter+ ? await getSemanticRouter(embedderOverride)+ : {+ router: null, backend: 'none', native: null,+ embedder: resolveRouterEmbedder(embedderOverride).kind,+ embedderReason: 'semantic router disabled (useSemanticRouter=false)',+ };let semanticResult: { intent: string; score: number; metadata: Record<string, unknown> }[] = [];let routingMethod = 'keyword';@@ -1194,10 +1246,22 @@ export const hooksRoute: MCPTool = {let backendInfo = '';const queryText = context ? `${task} ${context}` : task;- const queryEmbedding = generateSimpleEmbedding(queryText);+ // ADR-390: the query is embedded with the embedder that built the index.+ let queryEmbedding: Float32Array | null = null;+ if (handle.router || handle.native) {+ const q = await embedForRouter([queryText], handle.embedder);+ if (q.embedder !== handle.embedder) {+ // MiniLM failed on the query after building a MiniLM index: rebuild the+ // index with the hash so patterns and query share one space again.+ routerInitPromise = buildSemanticRouter('hash', q.reason);+ handle = await routerInitPromise;+ }+ queryEmbedding = q.vectors[0];+ }+ const { router, backend, native } = handle;// Try native VectorDb (HNSW-backed)- if (native && backend === 'native') {+ if (native && backend === 'native' && queryEmbedding) {const routeStart = performance.now();try {// eslint-disable-next-line @typescript-eslint/no-explicit-any@@ -1228,7 +1292,7 @@ export const hooksRoute: MCPTool = {}// Try pure JS SemanticRouter fallback- if (router && backend === 'pure-js' && semanticResult.length === 0) {+ if (router && backend === 'pure-js' && queryEmbedding && semanticResult.length === 0) {const routeStart = performance.now();semanticResult = router.routeWithEmbedding(queryEmbedding, 3);routingLatencyMs = performance.now() - routeStart;@@ -1313,10 +1377,59 @@ export const hooksRoute: MCPTool = {agents,coordination: 'queen-led',} : null,+ // ADR-390: which embedder the semantic index + query used ('hash' when degraded).+ embedder: handle.embedder,+ ...(handle.embedderReason ? { embedderReason: handle.embedderReason } : {}),};- }),+}++type LocalRouteResult = Record<string, unknown> & {+ primaryAgent: { type: string; confidence: number; reason: string };+ matchedPattern: string;+ embedder: RouterEmbedderKind;+ embedderReason?: string;};+/** Result of {@link routeTaskForBench}. */+export interface BenchRouteResult {+ primaryAgent: string;+ confidence: number;+ /** Matched pattern name, or 'keyword-fallback'. */+ pattern: string;+ /** Embedder actually used ('hash' if MiniLM was requested but unavailable). */+ embedder: RouterEmbedderKind;+ embedderReason?: string;+ /** routing.method of the underlying route ('semantic-native' | 'semantic-pure-js' | 'keyword'). */+ method: string;+}++/**+ * INTERNAL / BENCH-ONLY (ADR-391). Not a public API; may change without notice.+ *+ * Routes `task` through the same local path `hooks_route` uses (semantic index ++ * keyword fallback) with an explicit embedder, without the MCP layer. It skips+ * the two steps that are neither ADR-391 candidate A nor B: the AgentDB+ * pre-route (`bridgeRouteTask`, which answers first when its confidence > 0.5)+ * and the opt-in typesafe wrapper (CLAUDE_FLOW_ROUTER_TYPESAFE). With those+ * inactive, `primaryAgent` equals `hooks_route`'s `primaryAgent.type`.+ *+ * Switching `embedder` between calls rebuilds the index; benchmark in blocks.+ */+export async function routeTaskForBench(+ task: string,+ opts: { embedder: RouterEmbedderKind; context?: string },+): Promise<BenchRouteResult> {+ const r = await routeTaskLocal(task, opts.context, true, opts.embedder);+ return {+ primaryAgent: r.primaryAgent.type,+ confidence: r.primaryAgent.confidence,+ pattern: r.matchedPattern,+ embedder: r.embedder,+ ...(r.embedderReason ? { embedderReason: r.embedderReason } : {}),+ method: String((r.routing as { method?: unknown } | undefined)?.method ?? ''),+ };+}+export const hooksMetrics: MCPTool = {name: 'hooks_metrics',description: 'View learning metrics dashboard Use when native Bash hooks (via Claude Code\'s settings.json) are wrong because you need Ruflo-side state β pattern persistence, neural training signals, model-routing learning, cost tracking, audit chain. For one-off shell commands, plain Bash hooks are fine.',diff --git a/v3/@claude-flow/cli/src/ruvector/router-embedder.ts b/v3/@claude-flow/cli/src/ruvector/router-embedder.tsnew file mode 100644index 0000000000..4832d92f45--- /dev/null+++ b/v3/@claude-flow/cli/src/ruvector/router-embedder.ts@@ -0,0 +1,166 @@+/**+ * Router embedder (ADR-390).+ *+ * `hooks_route` compares a task with each agent pattern's keywords in a 384-d+ * vector index. Historically both sides came from a character hash+ * (`generateSimpleEmbedding`), which measures spelling, not meaning. This+ * module lets the router use the local sentence model (all-MiniLM-L6-v2, 384-d)+ * instead, with the hash as the fallback.+ *+ * Rules (ADR-390 Β§Decision):+ * - The MiniLM path uses `generateLocalEmbedding` ONLY. Never the bridge-first+ * `generateEmbedding` β that recursed without bound in #2312.+ * - One embedder per index: if ANY text cannot be embedded by the real model+ * (throw, backend !== 'onnx', or a non-384 vector), EVERY text in the call+ * is embedded with the hash, and the result says so.+ * - The default stays `hash` until ADR-391's benchmark says otherwise.+ *+ * Selection: `CLAUDE_FLOW_ROUTER_EMBEDDER=minilm|hash`. The router index is+ * process-lifetime state, so the env var is read when the index is (re)built,+ * not per CLI invocation.+ */+// memory-initializer is imported lazily (as hooks-tools does elsewhere): it is+// heavy, and the default `hash` path must not load it at all.++export type RouterEmbedderKind = 'minilm' | 'hash';++/** Default embedder. ADR-391 decides whether this flips to 'minilm'. */+export const DEFAULT_ROUTER_EMBEDDER: RouterEmbedderKind = 'hash';++/** Dimension of the router index (VectorDb + SemanticRouter are built at 384). */+export const ROUTER_EMBEDDING_DIM = 384;++export const ROUTER_EMBEDDER_ENV = 'CLAUDE_FLOW_ROUTER_EMBEDDER';++export interface RouterEmbedderSelection {+ kind: RouterEmbedderKind;+ /** Set when the requested value was invalid and the default was used. */+ reason?: string;+}++export interface RouterEmbeddingResult {+ vectors: Float32Array[];+ /** The embedder that actually produced `vectors` (after any degradation). */+ embedder: RouterEmbedderKind;+ /** Why the result is `hash` when `minilm` was requested. */+ reason?: string;+}++/**+ * Resolve which embedder the router should use.+ * Precedence: explicit override > CLAUDE_FLOW_ROUTER_EMBEDDER > DEFAULT_ROUTER_EMBEDDER.+ */+export function resolveRouterEmbedder(+ override?: RouterEmbedderKind,+ env: NodeJS.ProcessEnv = process.env,+): RouterEmbedderSelection {+ if (override) return { kind: override };+ // Env-only by design (registered in scripts/audit-env-var-precedence.mjs):+ // the router index is process-lifetime MCP state, not owned by one CLI call.+ const raw = env.CLAUDE_FLOW_ROUTER_EMBEDDER?.trim().toLowerCase();+ if (!raw) return { kind: DEFAULT_ROUTER_EMBEDDER };+ if (raw === 'minilm' || raw === 'hash') return { kind: raw };+ return {+ kind: DEFAULT_ROUTER_EMBEDDER,+ reason: `${ROUTER_EMBEDDER_ENV}=${JSON.stringify(raw)} is not 'minilm' or 'hash'; using '${DEFAULT_ROUTER_EMBEDDER}'`,+ };+}++/**+ * Deterministic character-hash embedding (the router's historical embedder).+ * Moved verbatim from hooks-tools.ts; do not change the math β existing routes+ * and thresholds were calibrated against it.+ */+export function generateSimpleEmbedding(text: string, dimension: number = ROUTER_EMBEDDING_DIM): Float32Array {+ const embedding = new Float32Array(dimension);+ const normalized = text.toLowerCase().replace(/[^a-z0-9\s]/g, '');+ const words = normalized.split(/\s+/).filter(w => w.length > 0);++ for (let i = 0; i < dimension; i++) {+ let value = 0;+ // Word-level features+ for (let w = 0; w < words.length; w++) {+ const word = words[w];+ for (let c = 0; c < word.length; c++) {+ const charCode = word.charCodeAt(c);+ value += Math.sin((charCode * (i + 1) + w * 17 + c * 23) * 0.0137);+ }+ }+ // Character-level features+ for (let c = 0; c < text.length; c++) {+ value += Math.cos((text.charCodeAt(c) * (i + 1) + c * 7) * 0.0073);+ }+ embedding[i] = value / Math.max(1, text.length);+ }++ return l2Normalize(embedding);+}++function l2Normalize(v: Float32Array): Float32Array {+ let norm = 0;+ for (let i = 0; i < v.length; i++) norm += v[i] * v[i];+ norm = Math.sqrt(norm);+ if (norm > 0) for (let i = 0; i < v.length; i++) v[i] /= norm;+ return v;+}++// Per-(embedder, text) memo. Keyword vectors don't change when the pattern set+// changes, so this survives router rebuilds (e.g. after saveRoutingOutcomes).+const MINILM_CACHE = new Map<string, Float32Array>();+const MINILM_CACHE_MAX = 2048;++async function embedOneMiniLM(text: string): Promise<Float32Array> {+ const cached = MINILM_CACHE.get(text);+ if (cached) return cached;+ const { generateLocalEmbedding } = await import('../memory/memory-initializer.js');+ const out = await generateLocalEmbedding(text);+ if (out.backend !== 'onnx') {+ throw new RouterEmbedderDegraded(`local embedder backend is '${out.backend}' (model '${out.model}'), not onnx`);+ }+ if (!out.embedding || out.embedding.length !== ROUTER_EMBEDDING_DIM) {+ throw new RouterEmbedderDegraded(+ `local embedder returned ${out.embedding?.length ?? 0}-d vectors; router index is ${ROUTER_EMBEDDING_DIM}-d`,+ );+ }+ const vec = l2Normalize(Float32Array.from(out.embedding));+ if (MINILM_CACHE.size >= MINILM_CACHE_MAX) {+ const oldest = MINILM_CACHE.keys().next().value;+ if (oldest !== undefined) MINILM_CACHE.delete(oldest);+ }+ MINILM_CACHE.set(text, vec);+ return vec;+}++class RouterEmbedderDegraded extends Error {}++/**+ * Embed texts for the router. All vectors in one result come from ONE embedder.+ * `hash` never touches the model (no load cost for default users).+ */+export async function embedForRouter(+ texts: readonly string[],+ kind: RouterEmbedderKind = resolveRouterEmbedder().kind,+): Promise<RouterEmbeddingResult> {+ if (kind === 'hash') {+ return { vectors: texts.map(t => generateSimpleEmbedding(t)), embedder: 'hash' };+ }+ try {+ const vectors: Float32Array[] = [];+ for (const t of texts) vectors.push(await embedOneMiniLM(t));+ return { vectors, embedder: 'minilm' };+ } catch (err) {+ const why = err instanceof RouterEmbedderDegraded+ ? err.message+ : `local embedder threw: ${err instanceof Error ? err.message : String(err)}`;+ return {+ vectors: texts.map(t => generateSimpleEmbedding(t)),+ embedder: 'hash',+ reason: `minilm unavailable (${why}); using hash for patterns and query`,+ };+ }+}++/** Test hook: clear the MiniLM vector memo. */+export function clearRouterEmbedderCache(): void {+ MINILM_CACHE.clear();+}diff --git a/v3/docs/adr/ADR-389-refresh-the-keyword-router-helper.md b/v3/docs/adr/ADR-389-refresh-the-keyword-router-helper.mdnew file mode 100644index 0000000000..050622920a--- /dev/null+++ b/v3/docs/adr/ADR-389-refresh-the-keyword-router-helper.md@@ -0,0 +1,58 @@+# ADR-389 β Refresh the Keyword Router Helper on Upgrade++**Status**: Implemented (3.44.0)+**Date**: 2026-09-23+**Related**: ADR-174 (signed helpers manifest), ADR-390 (semantic router embedder), ADR-391 (router benchmark gate), #2257, #3401, PR #3402+**Surfaces**: `v3/@claude-flow/cli/src/init/helper-refresh.ts`, `v3/@claude-flow/cli/.claude/helpers/helpers.manifest.json`++## Context++Claude Code's prompt hook runs `~/.claude/helpers/hook-handler.cjs`, which loads+`router.js` from the same directory (`hook-handler.cjs:235`) to label each prompt+with a suggested agent. That router matched keywords as **substrings**:++- "sync and review la**test** issues" β `tester` at 0.8+- "are we **u**s**i**ngβ¦" (typed as "uing") β `frontend-dev` via `ui`+- "**auth**or" β auth, "pre**fix**" β fix++The generator was fixed in #2257, and the remaining copies in PR #3402 (3.43.0).+**Installed copies never receive it.** The copy on the maintainer's own machine is+dated 2026-04-15, still matches substrings, and misrouted prompts throughout the+3.43.0 release session.++Why no install gets the fix: `helper-refresh.ts` only re-copies the helpers named+in `CRITICAL_HELPERS` (`auto-memory-hook.mjs`, `hook-handler.cjs`, `intelligence.cjs`,+`statusline.cjs`). `router.js` isn't on that list, and `init` skips files that+already exist. So once `router.js` is written, it's frozen.++The refresh already reaches the right place. It has a global pass for+`~/.claude/helpers/`, which the real CLI entry enables. The only gap is the list.++## Decision++1. Add `router.js` to `CRITICAL_HELPERS`.+2. Re-sign `helpers.manifest.json` in the same release. The refresh is fail-closed+ and refuses any helper without a signed hash (ADR-174), so the list change and+ the re-sign must ship together.+3. Leave `router.js`'s behaviour unchanged here. This ADR is only about delivery; the+ word-boundary logic already shipped in 3.43.0.++## Consequences++- Every existing install gets the word-boundary router on its next `ruflo` command,+ through the same signed, fail-closed path as the other four helpers.+- A user who hand-edited `router.js` will have it overwritten. The same is already+ true of `hook-handler.cjs`, and a hand-edited copy fails the hash check anyway.+- The release checklist gains nothing new. The re-sign already happens every+ release, because the manifest is pinned to the package version.+- **Risk:** the concurrent-session helper overwrite described in CLAUDE.md now+ covers one more file. Mitigation is unchanged: `git diff --stat` the helpers+ immediately before signing.++## Verification++- A unit test asserts `router.js` is in `CRITICAL_HELPERS` and in the signed manifest.+- Pack the CLI, install it into a directory that has a stale April `router.js`, run+ any `ruflo` command, and check that `router.js "sync and review latest issues"`+ no longer returns `tester`.+- `scripts/verify-helpers.mjs` reports 5 helpers.diff --git a/v3/docs/adr/ADR-390-semantic-router-uses-the-real-embedder.md b/v3/docs/adr/ADR-390-semantic-router-uses-the-real-embedder.mdnew file mode 100644index 0000000000..6c99551758--- /dev/null+++ b/v3/docs/adr/ADR-390-semantic-router-uses-the-real-embedder.md@@ -0,0 +1,63 @@+# ADR-390 β The Semantic Router Uses the Real Sentence Embedder++**Status**: Implemented as opt-in (3.44.0); default unchanged β did not pass the ADR-391 gate+**Date**: 2026-09-23+**Related**: ADR-389 (keyword router refresh), ADR-391 (router benchmark gate), #2312 (embedder recursion), #3375, PR #3407+**Surfaces**: `v3/@claude-flow/cli/src/mcp-tools/hooks-tools.ts` (`getSemanticRouter`, `hooks_route`)++## Context++`hooks_route` picks an agent by comparing the task with each agent pattern's+keywords in a vector index (`@ruvector/router` VectorDb, or a pure-JS fallback).+Both sides of that comparison come from `generateSimpleEmbedding`+(`hooks-tools.ts:148`): the pattern keywords (`:369`, `:392`) and the incoming+task (`:1197`). That function is a character-hash, not a language model. It measures+spelling overlap, not meaning.++Observed on the published 3.43.0: "sync and review latest issues" routes to+`tester` at **58%** through the semantic path. The word-boundary fix (#3402) doesn't+help here, because this path never matches words; it compares hash vectors, and+"latest" shares character patterns with "test".++RuFlo already ships and loads a real sentence model. Memory uses+`all-MiniLM-L6-v2`, 384-d, the same dimension the router index uses, through+`generateEmbedding` / `generateLocalEmbedding` in `memory-initializer.ts`. On the+3.43.0 release check it found a stored entry by meaning at 0.83. The router uses+none of it.++## Decision++Embed the router's pattern keywords and incoming tasks with the local sentence+model, keeping the hash embedder as the fallback:++1. At router init, embed each pattern's keywords with `generateLocalEmbedding`.+ It must be the **local** chain, never the bridge-first `generateEmbedding`,+ which recursed without bound in #2312. Cache the vectors per pattern set.+2. Embed the incoming task with the same function, so both sides share one space.+ Mixing hash and model vectors in one index is forbidden.+3. If the local model reports `backend !== 'onnx'` (mock or hash), use+ `generateSimpleEmbedding` for **both** sides, as today, and report+ `embedder: 'hash'` in the routing result.+4. Every result gains an `embedder` field (`minilm` | `hash`), so a degraded route+ is visible, not silent.++Model loading is lazy and happens once per process. `hooks_route` already awaits+async work.++## Consequences++- Routing should follow meaning, not spelling. This is a hypothesis until ADR-391+ measures it. The ADR ships behind its gate, not on faith.+- First-call latency rises by the model load if memory hasn't already loaded it.+ Per-call cost is one 384-d embedding. ADR-391's latency criterion decides whether+ that's acceptable.+- No new dependency. Installs without the model behave exactly as today and say so.++## Verification++- Unit tests (London-school, with the embedder mocked):+ - when onnx is available, pattern and query vectors come from the same function+ - mock/hash backend falls back to `generateSimpleEmbedding` on both sides+ - the `embedder` field is reported+ - there is no call path to the bridge-first `generateEmbedding`+- Promotion to default happens only if ADR-391's gate passes.diff --git a/v3/docs/adr/ADR-391-router-benchmark-gate.md b/v3/docs/adr/ADR-391-router-benchmark-gate.mdnew file mode 100644index 0000000000..aaf33017d1--- /dev/null+++ b/v3/docs/adr/ADR-391-router-benchmark-gate.md@@ -0,0 +1,129 @@+# ADR-391 β Change the Default Router Only on a Measured Win++**Status**: Implemented (3.44.0) β first run: no candidate promoted+**Date**: 2026-09-23+**Related**: ADR-150 (MetaHarness AND-gate), ADR-389, ADR-390, PR #3406 (opt-in `@ruvector/typesafe` router)+**Surfaces**: `hooks_route`, `v3/@claude-flow/cli/src/ruvector/router-parallel-recorder.ts`, a new bench under `v3/@claude-flow/cli/benchmarks/`++## Context++There are now four ways RuFlo could pick an agent, and no evidence on which is best:++| Candidate | What it is | Status |+|---|---|---|+| **A** current | semantic router over hash embeddings + keyword fallback | default |+| **B** MiniLM | A, with the real sentence embedder (ADR-390) | proposed |+| **C** typesafe-hash | `@ruvector/typesafe`, default hash embedder | opt-in since 3.43.0 |+| **D** typesafe-onnx | `@ruvector/typesafe` with bge-small / MiniLM | untested |++The evidence so far is a handful of hand-picked prompts. Typesafe's own lift+threshold (1.2Γ) was set from a **10-task** sample. That isn't enough to justify+changing what every user gets.++The data source this needs isn't populated yet. `router-parallel-recorder.ts`+writes `.swarm/router-parallel.jsonl`, but:+- only when `CLAUDE_FLOW_ROUTER_PARALLEL_LOG=1`+- task text is excluded unless `CLAUDE_FLOW_ROUTER_PARALLEL_LOG_TASK=1`++On the maintainer's machine the file does not exist. There is no history to mine+today.++## Decision++1. **Build the corpus first.**+ - Collect **150β200 real task prompts**. Sources: the parallel log (collected+ with both env flags on, and scrubbed of anything sensitive), plus+ prompts from this repo's issues and PR titles.+ - Label each with the correct agent, blind to any router's output.+ - Include negatives: prompts that fit no agent, where abstaining is correct.+ - Freeze the corpus with a hash and split it into **dev** (tuning thresholds) and+ **test** (the decision). The test split is touched once per candidate.+2. **Run all four candidates on the same frozen test split.** For each, measure:+ - top-1 accuracy+ - macro-F1+ - wrong-with-high-confidence rate+ - abstain precision (C and D)+ - p50/p95 latency, cold and warm+ - dependency and install cost+3. **Promotion rule** (the ADR-150 AND-gate, restated for routing). A candidate+ replaces the default only if, against A:+ - accuracy is **more than 2 points** better+ - it adds no required dependency (optional peers and fallbacks are allowed)+ - p95 latency regresses by **no more than 5%** warm, with cold start reported+ separately+4. **Tie-break role for typesafe.** If C or D doesn't win outright but its abstain+ signal predicts A's errors, it may become a second opinion: consulted only when+ A's top two scores are within a margin. That needs its own measured win on the+ same split.+5. Results, the corpus hash and the per-candidate receipts are committed under+ `benchmarks/results/`, whatever the outcome. A loss is recorded, not deleted.++## Consequences++- The default router changes only on evidence. B (no new dependency) is the+ expected winner, but that's a prediction this ADR exists to test.+- Typesafe stays opt-in unless it earns more. PR #3406's design already allows+ either outcome.+- Labelling 150β200 prompts is real work. It's also reusable: the same corpus+ evaluates any future router change.++## Verification++- The bench script re-runs deterministically from the frozen corpus (fixed seeds,+ pinned model hashes).+- A CI job re-runs the bench on changes to `hooks_route` and fails if the default's+ accuracy on the test split drops below the committed receipt.++## Results β first run (2026-09-23)++Corpus: 197 prompts, frozen at sha256 `b0c1923b2813b61907304dff56c53d199b709797bfb9600a7c1f496cf0c0bf04`+(84 dev / 113 test, 64 trap cases), labelled blind by an agent that never ran or read any router.+Receipt: `v3/@claude-flow/cli/benchmarks/router/results/router-bench-2026-09-23.json`.+Re-run: `node benchmarks/router/run-bench.mjs` (D needs `ROUTER_BENCH_TYPESAFE_MODEL_DIR`).++**Test split (n=113):**++| Candidate | Accuracy | Macro-F1 | Trap accuracy | Wrong at β₯0.7 confidence | p50 / p95 warm | Cold |+|---|---|---|---|---|---|---|+| A current (hash) | **25.7%** | 0.178 | 29.0% | 29.2% | 0.66 / 1.06 ms | 38 ms |+| B MiniLM (ADR-390) | **36.3%** | 0.334 | 25.8% | 46.9%* | 2.19 / 6.21 ms | 326 ms |+| C typesafe, hash | 26.5% | 0.199 | 29.0% | 26.6% | 0.77 / 1.20 ms | 90 ms |+| D typesafe, ONNX (bge-small-en-v1.5) | 29.2% | 0.227 | 32.3% | 26.6% | 6.07 / 8.35 ms | 680 ms |++Raw typesafe pick before its lift/abstain gate: C 30.1%, D **44.3%**. The gate+let typesafe decide on only 13.2% (C) and 5.6% (D) of prompts.++**Gate verdict: no candidate is promoted.**++- **B** clears accuracy (+10.6 pts) and dependency, but fails latency: p95 +485%+ (1.06 β 6.21 ms).+- **C** fails accuracy (+0.9 pts) and latency.+- **D** clears accuracy (+3.5 pts), but fails latency (+686%) and is an optional+ peer, so it can only ever be opt-in.++`DEFAULT_ROUTER_EMBEDDER` stays `hash`, and typesafe stays opt-in.++**Findings (recorded, not acted on in this run):**++1. **The router structurally cannot answer 59 of 197 prompts.** No `TASK_PATTERNS`+ entry returns `researcher`, `reviewer` or `none` as the primary agent, so A and+ B have a ceiling of about 70% before any embedder question. Adding+ research/review patterns is likely worth more than any embedder change. First+ follow-up.+2. **The latency criterion is mis-specified for this workload.** A relative bound+ (β€5% p95) on a ~1 ms baseline fails any embedder that does real work, even+ though B's absolute cost is about 5 ms on a pre-task hook. Proposed revision,+ for the owner and **not applied here**: an absolute bound (e.g. p95 β€ 10 ms+ warm, cold reported), then re-run. Changing the gate in the same commit as the+ result it would flip is exactly what this ADR forbids.+3. *B's "wrong at β₯0.7" isn't comparable with A's.* The 0.4 score gate and the+ `1 - distance` confidence were calibrated for hash vectors; MiniLM cosines sit+ on a different scale. B needs its own threshold, tuned on the dev split, before+ this metric means anything.+4. **Typesafe is held back by its gate, not its accuracy.** D's raw pick is the+ most accurate of anything measured (44.3%), but the lift/abstain thresholds were+ set from a 10-task hash sample and admit only 5.6% of its decisions. Tune them on+ the dev split, then re-run on test.+5. The labeller flagged three debatable rows (two memory-area design prompts, one+ benchmark-measurement fix, one topology question). They were left as labelled,+ because relabelling after seeing router output would break the blind protocol.