Skip to content

armgit / ruflo

Public Imported from GitHub
0

🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated

feat(router): ADR-389–391 β€” refresh router helper, opt-in MiniLM embedder, benchmark gate (no default change) (#3410)

rUv82dac70fd785
diff --git a/scripts/audit-env-var-precedence.mjs b/scripts/audit-env-var-precedence.mjs
index 22a9ed35eb..c5755cac6b 100644
--- a/scripts/audit-env-var-precedence.mjs
+++ b/scripts/audit-env-var-precedence.mjs
@@ -82,6 +82,7 @@ const KNOWN_ESCAPE_HATCHES = new Set([
'RUFLO_METAHARNESS_SKIP_LOCAL', // plugins/ruflo-metaharness/scripts/_invoke.mjs β€” CI seam that forces the invoke shim off the local vendored metaharness and onto the pinned-cache resolver. Plugin script has no CLI-flag surface (invoked internally by MCP tools)
'RUFLO_HELPERS_LOCKED', // v3.30.0 β€” env-level opt-out for the .claude/helpers/ auto-refresh (init/helper-refresh.ts). Sibling to the `.LOCKED` marker file; helper-refresh runs from a hook, not a user-typed CLI command β€” no per-invocation flag surface. See CLAUDE.md "Concurrent-session helper corruption" for rationale
'CLAUDE_FLOW_DISABLE_NATIVE_ROUTER', // Test/lock-constrained MCP escape hatch: forces hooks routing onto the deterministic pure-JS backend. The router is process-lifetime state, not owned by one CLI invocation.
+ 'CLAUDE_FLOW_ROUTER_EMBEDDER', // ADR-390/391: selects the hooks_route semantic-index embedder (minilm|hash; default hash). Same process-lifetime MCP router state as CLAUDE_FLOW_DISABLE_NATIVE_ROUTER β€” the index is built once per process, not per CLI invocation; the ADR-391 bench passes the embedder explicitly instead.
'RUFLO_FLYWHEEL_ALLOW_BUILTIN_ANCHOR', // Explicit compatibility escape hatch for pre-ADR-331 downstream behavior. Intentionally env-only and visibly unsafe-by-choice; normal CLI/MCP use supplies a project anchor path + hash.
// ── Embedding substrate toggles (3.25.x β€” opt-in tier + fail-closed ops flag) ─
diff --git a/scripts/smoke-helper-signing-security.mjs b/scripts/smoke-helper-signing-security.mjs
index 1e9bc97731..be3ce98163 100644
--- a/scripts/smoke-helper-signing-security.mjs
+++ b/scripts/smoke-helper-signing-security.mjs
@@ -35,7 +35,7 @@ try {
mkdirSync(join(fixture, 'scripts'), { recursive: true });
mkdirSync(join(fixture, '.claude', 'helpers'), { recursive: true });
cpSync(signer, join(fixture, 'scripts', 'sign-helpers.mjs'));
- for (const name of ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs']) {
+ for (const name of ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs', 'router.js']) {
cpSync(join(cli, '.claude', 'helpers', name), join(fixture, '.claude', 'helpers', name));
}
writeFileSync(join(fixture, 'package.json'), JSON.stringify({ version: '0.0.0-security-test' }));
diff --git a/v3/@claude-flow/cli/__tests__/adr-389-router-helper-refresh.test.ts b/v3/@claude-flow/cli/__tests__/adr-389-router-helper-refresh.test.ts
new file mode 100644
index 0000000000..99698165c9
--- /dev/null
+++ b/v3/@claude-flow/cli/__tests__/adr-389-router-helper-refresh.test.ts
@@ -0,0 +1,127 @@
+/**
+ * ADR-389 / #3401 β€” the keyword router helper must be refreshed on upgrade.
+ *
+ * `hook-handler.cjs` loads `router.js` from the same helpers dir to label each
+ * prompt with a suggested agent. The April-era router matched keywords as
+ * SUBSTRINGS ("la*test*" β†’ tester). The word-boundary fix shipped in the
+ * package (PR #3402) but never reached existing installs, because `router.js`
+ * was not in CRITICAL_HELPERS and `init` skips files that already exist.
+ *
+ * Like helper-refresh.test.ts, the copy path is exercised against a
+ * throwaway-keypair-signed fixture so this suite does not depend on the real
+ * manifest being re-signed. The fixture's router.js IS the real package copy,
+ * so the test also proves the package ships the fixed router.
+ */
+import { describe, it, expect } from 'vitest';
+import { mkdtempSync, mkdirSync, writeFileSync, readFileSync } from 'node:fs';
+import { join, dirname } from 'node:path';
+import { tmpdir } from 'node:os';
+import { fileURLToPath } from 'node:url';
+import { createRequire } from 'node:module';
+import { generateKeyPairSync, sign as edSign } from 'node:crypto';
+
+import {
+ autoRefreshHelpersIfStale,
+ getInstalledCliVersion,
+ CRITICAL_HELPERS,
+ HELPERS_STAMP_FILE,
+} from '../src/init/helper-refresh.js';
+import { canonicalManifestBytes, sha256Hex } from '../src/init/helper-signing.js';
+import { generateAgentRouter } from '../src/init/helpers-generator.js';
+
+const PKG_HELPERS_DIR = join(dirname(fileURLToPath(import.meta.url)), '..', '.claude', 'helpers');
+const PROMPT = 'sync and review latest issues';
+
+// The pre-#2257 router as installed on real machines (dated 2026-04-15):
+// plain substring alternations compiled with new RegExp(pattern, 'i').
+const STALE_APRIL_ROUTER = `#!/usr/bin/env node
+const TASK_PATTERNS = {
+ 'implement|create|build|add|write code': 'coder',
+ 'test|spec|coverage|unit test|integration': 'tester',
+ 'review|audit|check|validate|security': 'reviewer',
+ 'research|find|search|documentation|explore': 'researcher',
+ 'design|architect|structure|plan': 'architect',
+ 'api|endpoint|server|backend|database': 'backend-dev',
+ 'ui|frontend|component|react|css|style': 'frontend-dev',
+ 'deploy|docker|ci|cd|pipeline|infrastructure': 'devops',
+};
+function routeTask(task) {
+ const taskLower = task.toLowerCase();
+ for (const [pattern, agent] of Object.entries(TASK_PATTERNS)) {
+ const regex = new RegExp(pattern, 'i');
+ if (regex.test(taskLower)) {
+ return { agent, confidence: 0.8, reason: 'Matched pattern: ' + pattern };
+ }
+ }
+ return { agent: 'coder', confidence: 0.5, reason: 'Default routing - no specific pattern matched' };
+}
+module.exports = { routeTask, TASK_PATTERNS };
+`;
+
+/** Load a CommonJS router.js fresh (no require cache reuse between loads). */
+function loadRouter(file: string): { routeTask: (t: string) => { agent: string; confidence: number } } {
+ const req = createRequire(file);
+ delete req.cache[req.resolve(file)];
+ return req(file);
+}
+
+/** Signed source fixture: the real package hook-handler.cjs + router.js. */
+function makeSignedSource(version: string): { sourceDir: string; pubkeyPem: string } {
+ const sourceDir = mkdtempSync(join(tmpdir(), 'adr389-source-'));
+ const files: Record<string, string> = {};
+ for (const name of ['hook-handler.cjs', 'router.js']) {
+ const content = readFileSync(join(PKG_HELPERS_DIR, name));
+ writeFileSync(join(sourceDir, name), content);
+ files[name] = sha256Hex(content);
+ }
+ const { publicKey, privateKey } = generateKeyPairSync('ed25519');
+ const manifest = { version, files };
+ const signature = edSign(null, canonicalManifestBytes(manifest), privateKey).toString('base64');
+ writeFileSync(
+ join(sourceDir, 'helpers.manifest.json'),
+ JSON.stringify({ manifest, signature, algorithm: 'ed25519' }),
+ );
+ return { sourceDir, pubkeyPem: publicKey.export({ type: 'spki', format: 'pem' }).toString() };
+}
+
+describe('ADR-389 β€” router.js is a refreshed critical helper', () => {
+ it('CRITICAL_HELPERS includes router.js', () => {
+ expect(CRITICAL_HELPERS).toContain('router.js');
+ });
+
+ it('the stale April router really does misroute the prompt (fixture sanity)', () => {
+ const dir = mkdtempSync(join(tmpdir(), 'adr389-stale-'));
+ writeFileSync(join(dir, 'router.js'), STALE_APRIL_ROUTER);
+ const r = loadRouter(join(dir, 'router.js')).routeTask(PROMPT);
+ expect(r.agent).toBe('tester');
+ expect(r.confidence).toBe(0.8);
+ });
+
+ it('refresh replaces a stale substring router.js with the package copy', async () => {
+ const version = getInstalledCliVersion();
+ const cwd = mkdtempSync(join(tmpdir(), 'adr389-project-'));
+ const helpersDir = join(cwd, '.claude', 'helpers');
+ mkdirSync(helpersDir, { recursive: true });
+ writeFileSync(join(helpersDir, 'hook-handler.cjs'), '// old hook-handler\n');
+ writeFileSync(join(helpersDir, 'router.js'), STALE_APRIL_ROUTER);
+ writeFileSync(join(helpersDir, HELPERS_STAMP_FILE), '0.0.1-old');
+ const { sourceDir, pubkeyPem } = makeSignedSource(version);
+
+ const res = await autoRefreshHelpersIfStale(cwd, { sourceDirOverride: sourceDir, pubkeyPemOverride: pubkeyPem });
+ expect(res.blocked).toBeUndefined();
+ expect(res.refreshed).toBe(true);
+
+ const installed = readFileSync(join(helpersDir, 'router.js'));
+ expect(sha256Hex(installed)).toBe(sha256Hex(readFileSync(join(PKG_HELPERS_DIR, 'router.js'))));
+
+ const r = loadRouter(join(helpersDir, 'router.js')).routeTask(PROMPT);
+ expect(r.agent).not.toBe('tester');
+ expect(r.agent).toBe('reviewer');
+ });
+
+ it('the generator fallback router (unresolvable package source) is also word-boundary', () => {
+ const dir = mkdtempSync(join(tmpdir(), 'adr389-gen-'));
+ writeFileSync(join(dir, 'router.js'), generateAgentRouter());
+ expect(loadRouter(join(dir, 'router.js')).routeTask(PROMPT).agent).not.toBe('tester');
+ });
+});
diff --git a/v3/@claude-flow/cli/__tests__/adr-390-router-embedder.test.ts b/v3/@claude-flow/cli/__tests__/adr-390-router-embedder.test.ts
new file mode 100644
index 0000000000..0596b72600
--- /dev/null
+++ b/v3/@claude-flow/cli/__tests__/adr-390-router-embedder.test.ts
@@ -0,0 +1,229 @@
+/**
+ * ADR-390 β€” the semantic router uses the real sentence embedder.
+ *
+ * London-school: the local embedder (`generateLocalEmbedding`) is mocked so
+ * each test pins one collaborator behaviour (onnx / mock backend / throws) and
+ * asserts how hooks_route and the router embedder react. The bridge-first
+ * `generateEmbedding` is also mocked, and must never be called (#2312).
+ *
+ * One real (unmocked) test runs only when the MiniLM model is cached locally.
+ */
+import { describe, it, expect, vi, beforeEach, afterEach } from 'vitest';
+import { createRequire } from 'module';
+import { execFileSync } from 'child_process';
+import { existsSync, readFileSync } from 'fs';
+import { dirname, join } from 'path';
+import { fileURLToPath, pathToFileURL } from 'url';
+
+vi.mock('../src/memory/memory-initializer.js', async (importOriginal) => ({
+ ...(await importOriginal<Record<string, unknown>>()),
+ generateLocalEmbedding: vi.fn(),
+ generateEmbedding: vi.fn(async () => { throw new Error('bridge-first generateEmbedding must not be called by the router'); }),
+}));
+// Keep hooks_route on the local path: the AgentDB pre-route answers "nothing".
+vi.mock('../src/memory/memory-bridge.js', () => ({ bridgeRouteTask: vi.fn(async () => null) }));
+
+import * as memoryInit from '../src/memory/memory-initializer.js';
+import { hooksRoute, routeTaskForBench, resetSemanticRouterForTests } from '../src/mcp-tools/hooks-tools.js';
+import {
+ DEFAULT_ROUTER_EMBEDDER,
+ clearRouterEmbedderCache,
+ embedForRouter,
+ generateSimpleEmbedding,
+ resolveRouterEmbedder,
+} from '../src/ruvector/router-embedder.js';
+
+const localEmbed = vi.mocked(memoryInit.generateLocalEmbedding);
+const bridgeEmbed = vi.mocked(memoryInit.generateEmbedding);
+
+/** A deterministic "onnx" vector (distinct from the hash so provenance is checkable). */
+function fakeOnnx(text: string) {
+ const v = Array.from(generateSimpleEmbedding(`onnx::${text}`));
+ return { embedding: v, dimensions: 384, model: 'onnx', backend: 'onnx' as const };
+}
+
+type RouteOut = { primaryAgent: { type: string }; embedder: string; embedderReason?: string; routing: { method: string } };
+const route = (task: string) => hooksRoute.handler({ task }) as Promise<RouteOut>;
+
+const ENV_KEYS = ['CLAUDE_FLOW_ROUTER_EMBEDDER', 'CLAUDE_FLOW_DISABLE_NATIVE_ROUTER', 'CLAUDE_FLOW_ROUTER_TYPESAFE'] as const;
+const savedEnv: Record<string, string | undefined> = {};
+
+beforeEach(() => {
+ for (const k of ENV_KEYS) savedEnv[k] = process.env[k];
+ // Deterministic pure-JS backend (the native VectorDb is required via createRequire, not mockable).
+ process.env.CLAUDE_FLOW_DISABLE_NATIVE_ROUTER = '1';
+ delete process.env.CLAUDE_FLOW_ROUTER_TYPESAFE;
+ delete process.env.CLAUDE_FLOW_ROUTER_EMBEDDER;
+ vi.spyOn(console, 'log').mockImplementation(() => {});
+ localEmbed.mockReset();
+ bridgeEmbed.mockClear();
+ clearRouterEmbedderCache();
+ resetSemanticRouterForTests();
+});
+
+afterEach(() => {
+ for (const k of ENV_KEYS) {
+ if (savedEnv[k] === undefined) delete process.env[k];
+ else process.env[k] = savedEnv[k];
+ }
+ vi.restoreAllMocks();
+});
+
+describe('ADR-390 router embedder selection', () => {
+ it('defaults to hash when CLAUDE_FLOW_ROUTER_EMBEDDER is unset, and never loads the model', async () => {
+ expect(DEFAULT_ROUTER_EMBEDDER).toBe('hash');
+ expect(resolveRouterEmbedder().kind).toBe('hash');
+
+ const out = await route('write unit tests for the auth module');
+
+ expect(out.embedder).toBe('hash');
+ expect(out.embedderReason).toBeUndefined();
+ expect(localEmbed).not.toHaveBeenCalled();
+ expect(bridgeEmbed).not.toHaveBeenCalled();
+ });
+
+ it('rejects an unknown env value and falls back to the default with a reason', () => {
+ const sel = resolveRouterEmbedder(undefined, { CLAUDE_FLOW_ROUTER_EMBEDDER: 'bert' } as NodeJS.ProcessEnv);
+ expect(sel.kind).toBe('hash');
+ expect(sel.reason).toMatch(/bert/);
+ });
+});
+
+describe('ADR-390 MiniLM path', () => {
+ it('onnx available: pattern and query vectors come from generateLocalEmbedding; embedder=minilm', async () => {
+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';
+ localEmbed.mockImplementation(async (t: string) => fakeOnnx(t));
+
+ const task = 'write unit tests for the auth module';
+ const out = await route(task);
+
+ expect(out.embedder).toBe('minilm');
+ expect(out.embedderReason).toBeUndefined();
+ expect(out.routing.method).not.toBe(undefined);
+ const texts = localEmbed.mock.calls.map(c => c[0]);
+ // patterns (every static keyword) ...
+ for (const kw of ['test', 'authentication', 'refactor', 'deploy']) expect(texts).toContain(kw);
+ // ... and the query, through the SAME function
+ expect(texts).toContain(task);
+ expect(bridgeEmbed).not.toHaveBeenCalled();
+ });
+
+ it('mock/hash backend: hash on BOTH sides, embedder=hash with a reason', async () => {
+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';
+ localEmbed.mockImplementation(async () => ({ embedding: new Array(128).fill(0.1), dimensions: 128, model: 'hash-fallback', backend: 'mock' as const }));
+
+ const out = await route('write unit tests for the auth module');
+
+ expect(out.embedder).toBe('hash');
+ expect(out.embedderReason).toMatch(/not onnx/);
+ // Degradation is decided once at index build: the query is not re-tried on the model.
+ expect(localEmbed).toHaveBeenCalledTimes(1);
+ expect(bridgeEmbed).not.toHaveBeenCalled();
+ });
+
+ it('generateLocalEmbedding throws: hash on both sides, embedder=hash with a reason', async () => {
+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';
+ localEmbed.mockRejectedValue(new Error('onnx runtime missing'));
+
+ const out = await route('write unit tests for the auth module');
+
+ expect(out.embedder).toBe('hash');
+ expect(out.embedderReason).toMatch(/onnx runtime missing/);
+ expect(bridgeEmbed).not.toHaveBeenCalled();
+ });
+
+ it('a non-384-d onnx vector is rejected (router index is 384-d)', async () => {
+ localEmbed.mockImplementation(async () => ({ embedding: new Array(768).fill(0.01), dimensions: 768, model: 'onnx', backend: 'onnx' as const }));
+ const res = await embedForRouter(['a', 'b'], 'minilm');
+ expect(res.embedder).toBe('hash');
+ expect(res.reason).toMatch(/768-d/);
+ expect(res.vectors).toHaveLength(2);
+ expect(Array.from(res.vectors[0])).toEqual(Array.from(generateSimpleEmbedding('a')));
+ });
+
+ it('query fails after a MiniLM index was built: index is rebuilt with hash so spaces never mix', async () => {
+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';
+ const task = 'profile the slow query';
+ localEmbed.mockImplementation(async (t: string) => {
+ if (t === task) throw new Error('model evicted');
+ return fakeOnnx(t);
+ });
+
+ const out = await route(task);
+
+ expect(out.embedder).toBe('hash');
+ expect(out.embedderReason).toMatch(/model evicted/);
+ });
+
+ it('switching the env embedder rebuilds the index', async () => {
+ localEmbed.mockImplementation(async (t: string) => fakeOnnx(t));
+ expect((await route('improve test coverage')).embedder).toBe('hash');
+ expect(localEmbed).not.toHaveBeenCalled();
+
+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = 'minilm';
+ expect((await route('improve test coverage')).embedder).toBe('minilm');
+ expect(localEmbed).toHaveBeenCalled();
+ });
+});
+
+describe('ADR-390 bench entry', () => {
+ it('routeTaskForBench returns the same primary agent hooks_route does, for both embedders', async () => {
+ localEmbed.mockImplementation(async (t: string) => fakeOnnx(t));
+ const tasks = ['write unit tests for the auth module', 'deploy the service with docker', 'refactor the parser'];
+ for (const kind of ['hash', 'minilm'] as const) {
+ process.env.CLAUDE_FLOW_ROUTER_EMBEDDER = kind;
+ for (const task of tasks) {
+ const viaTool = await route(task);
+ const viaBench = await routeTaskForBench(task, { embedder: kind });
+ expect(viaBench.embedder).toBe(kind);
+ expect(viaBench.primaryAgent).toBe(viaTool.primaryAgent.type);
+ }
+ }
+ expect(bridgeEmbed).not.toHaveBeenCalled();
+ });
+});
+
+describe('ADR-390 static guard (#2312)', () => {
+ it('router-embedder.ts has no call path to the bridge-first generateEmbedding', () => {
+ const here = dirname(fileURLToPath(import.meta.url));
+ const src = readFileSync(join(here, '../src/ruvector/router-embedder.ts'), 'utf8')
+ .split('\n').filter(l => !/^\s*(\*|\/\/|\/\*)/.test(l)).join('\n'); // drop comments
+ expect(src).toMatch(/generateLocalEmbedding/);
+ expect(src).not.toMatch(/(?<![A-Za-z])generateEmbedding\s*\(/);
+ expect(src).not.toMatch(/\{\s*generateEmbedding\s*[,}]/);
+ });
+});
+
+// ── Real model (no mocks) ───────────────────────────────────────────────────
+function localMiniLMCached(): boolean {
+ const req = createRequire(import.meta.url);
+ for (const pkg of ['@huggingface/transformers', '@xenova/transformers']) {
+ try {
+ let dir = dirname(req.resolve(pkg));
+ for (let i = 0; i < 4 && !existsSync(join(dir, 'package.json')); i++) dir = dirname(dir);
+ if (existsSync(join(dir, '.cache', 'Xenova', 'all-MiniLM-L6-v2'))) return true;
+ } catch { /* not installed */ }
+ }
+ return false;
+}
+
+// The real model runs in a plain `node` child against the built dist: inside the
+// vitest worker the transformers pipeline does not initialise and the local
+// chain reports backend 'mock' (observed), which would test the harness, not
+// the router. Skips unless both the model cache and dist exist.
+const distHooks = join(dirname(fileURLToPath(import.meta.url)), '../dist/src/mcp-tools/hooks-tools.js');
+
+describe.skipIf(!localMiniLMCached() || !existsSync(distHooks))('ADR-390 real MiniLM (runs only when the model is cached locally)', () => {
+ it('routes "write unit tests for the auth module" to tester with embedder=minilm', () => {
+ const script = `import(${JSON.stringify(pathToFileURL(distHooks).href)}).then(async (h) => {
+ const r = await h.routeTaskForBench('write unit tests for the auth module', { embedder: 'minilm' });
+ process.stdout.write('\\nRESULT=' + JSON.stringify(r) + '\\n');
+ });`;
+ const stdout = execFileSync(process.execPath, ['-e', script], { encoding: 'utf8', timeout: 110_000, env: { ...process.env, CLAUDE_FLOW_ROUTER_TYPESAFE: '' } });
+ const line = stdout.split('\n').find(l => l.startsWith('RESULT='));
+ expect(line, stdout).toBeDefined();
+ const out = JSON.parse(line!.slice('RESULT='.length));
+ expect(out.embedder, out.embedderReason).toBe('minilm');
+ expect(out.primaryAgent).toBe('tester');
+ }, 120_000);
+});
diff --git a/v3/@claude-flow/cli/__tests__/typesafe-router.test.ts b/v3/@claude-flow/cli/__tests__/typesafe-router.test.ts
index a4a26f570e..92004fe1ce 100644
--- a/v3/@claude-flow/cli/__tests__/typesafe-router.test.ts
+++ b/v3/@claude-flow/cli/__tests__/typesafe-router.test.ts
@@ -193,7 +193,10 @@ describe.skipIf(!realModule)('typesafe-router: real @ruvector/typesafe (hash emb
expect(out.primaryAgent).toEqual(LEGACY.primaryAgent);
});
- it('(e) hooks_route end to end: the "latest"β†’tester keyword misroute is overridden to researcher', async () => {
+ // Since #3402 the keyword fallback matches whole words, so it no longer
+ // routes "latest" to tester; the legacy pick is whatever the local router
+ // returns now. What this test guards is the typesafe override itself.
+ it('(e) hooks_route end to end: typesafe routes "sync and review latest issues" to researcher, legacy kept as fallback', async () => {
process.env.CLAUDE_FLOW_ROUTER_TYPESAFE = '1';
try {
const { hooksRoute } = await import('../src/mcp-tools/hooks-tools.js');
@@ -201,7 +204,9 @@ describe.skipIf(!realModule)('typesafe-router: real @ruvector/typesafe (hash emb
expect(res.routedBy).toBe('typesafe');
expect((res.primaryAgent as Record<string, unknown>).type).toBe('researcher');
expect((res.primaryAgent as Record<string, unknown>).confidenceCalibrated).toBe(false);
- expect((res.fallbackRoute as Record<string, unknown>).agent).toBe('tester');
+ const fallback = res.fallbackRoute as Record<string, unknown>;
+ expect(typeof fallback.agent).toBe('string');
+ expect(fallback.agent).not.toBe('researcher');
} finally {
delete process.env.CLAUDE_FLOW_ROUTER_TYPESAFE;
}
diff --git a/v3/@claude-flow/cli/benchmarks/router/README.md b/v3/@claude-flow/cli/benchmarks/router/README.md
new file mode 100644
index 0000000000..e75f9f1f87
--- /dev/null
+++ b/v3/@claude-flow/cli/benchmarks/router/README.md
@@ -0,0 +1,116 @@
+# Router evaluation corpus (ADR-391)
+
+`corpus.jsonl` is the labelled, frozen evaluation set that ADR-391 uses to
+compare agent-routing candidates (A current, B MiniLM, C typesafe-hash,
+D typesafe-onnx). It contains 197 prompts, each labelled with the one agent a
+competent engineering lead would assign.
+
+**Frozen at sha256 `b0c1923b2813b61907304dff56c53d199b709797bfb9600a7c1f496cf0c0bf04`.**
+Any edit to `corpus.jsonl` changes this hash. A changed corpus is a new corpus:
+earlier receipts don't carry over to it.
+
+## Line format
+
+```json
+{"id":"r001","prompt":"...","label":"researcher","split":"dev","trap":false,"source":"issue","note":"why this label"}
+```
+
+- `source`: `issue` or `pr` means the prompt paraphrases a real ruflo issue or PR
+ title into how a developer would ask for it. `synthetic` means the labeller
+ wrote it.
+- `trap: true` marks an adversarial case, where a naive keyword match points to
+ the wrong agent. Examples: "review the latest issues" is `researcher`,
+ "update the test fixtures for the auth API" is `tester`, and "run the
+ benchmark" is `performance-engineer`.
+
+## Labels
+
+| label | primary work |
+|---|---|
+| `coder` | implement a feature or change, fix a bug, write code |
+| `tester` | write, extend or fix tests; coverage; test strategy |
+| `reviewer` | review a PR, diff or code for quality or correctness |
+| `researcher` | investigate, look up, compare, summarise, triage; explain how existing code or issues work |
+| `architect` | design, ADRs, API or schema design, module boundaries, refactor planning |
+| `security-architect` | security review, vulnerabilities, auth hardening, threat modelling, CVEs |
+| `performance-engineer` | profiling, latency and throughput, benchmarks, optimisation |
+| `devops` | CI/CD, deploy, Docker, release pipelines, infrastructure |
+| `swarm-specialist` | multi-agent, swarm or hive-mind orchestration and coordination |
+| `memory-specialist` | memory store, vector index, embeddings, AgentDB, HNSW |
+| `none` | not an engineering task: chit-chat, thanks, vague one-word asks, non-software requests |
+
+Tie-break rules, applied the same way to every prompt:
+
+- **Specialist vs `coder`.** A specialist label wins only when the work sits
+ squarely in that domain and needs its expertise, such as memory-store
+ persistence, HNSW or embeddings internals, auth exposure, or agent coordination.
+ When the domain is incidental, the label is `coder`. A wrong exit code in the
+ `memory` command, or a hiveId that is never saved, are both `coder`.
+- **`reviewer` vs `researcher`.** Reviewing a PR, diff or code is `reviewer`.
+ Reading issues, changelogs or docs to report back is `researcher`, even when
+ the prompt says "review".
+- **Mixed intent.** The label is the primary ask. For example, "profile X" is
+ performance work even when X is the memory store. The `note` field says why.
+
+Prompts that two reasonable leads could label differently were rewritten or
+dropped.
+
+## Split rule
+
+The split is deterministic and stratified by label. Within each label, sort
+rows by `id`. The row at 0-indexed position `i` goes to `dev` if `i % 5` is 0
+or 2, and to `test` otherwise. `validate-corpus.mjs` recomputes this rule and
+fails if any row disagrees.
+
+- **`dev`** is for tuning thresholds.
+- **`test`** decides promotion. Each candidate runs on it once.
+
+Ids were assigned after a seeded shuffle, so they don't encode the label.
+
+## Counts
+
+| label | dev | test | total | traps |
+|---|---|---|---|---|
+| coder | 12 | 16 | 28 | 12 |
+| tester | 8 | 10 | 18 | 10 |
+| reviewer | 6 | 9 | 15 | 4 |
+| researcher | 10 | 15 | 25 | 11 |
+| architect | 7 | 9 | 16 | 3 |
+| security-architect | 7 | 9 | 16 | 5 |
+| performance-engineer | 7 | 9 | 16 | 5 |
+| devops | 7 | 9 | 16 | 3 |
+| swarm-specialist | 6 | 7 | 13 | 6 |
+| memory-specialist | 6 | 9 | 15 | 3 |
+| none | 8 | 11 | 19 | 2 |
+| **total** | **84** | **113** | **197** | **64** |
+
+## Blindness rule
+
+The labeller never saw any router's output. No router was run while the corpus
+was built: not `hooks route`, `hooks_route`, `router.js`/`router.cjs`, or
+typesafe. The labeller also didn't read the router keyword/pattern tables
+(`TASK_PATTERNS` in `hooks-tools.ts`, `typesafe-router.ts`) or any routing test
+tables. Labels reflect only what the prompt asks for. That independence is what
+makes the corpus a fair benchmark, so keep it when extending or relabelling:
+whoever labels must not look at router output first.
+
+## Validate
+
+```bash
+node validate-corpus.mjs # defaults to ./corpus.jsonl
+```
+
+The validator uses no dependencies. It checks:
+
+- every line is valid JSON
+- ids are unique and match `r\d{3}`
+- no prompt appears twice
+- each label is in the set above
+- each split is `dev` or `test`, and matches the split rule
+- `trap` is a boolean
+- `source` is `issue`, `pr` or `synthetic`
+- the total is 180–200
+- every label except `none` has at least 8 rows, and `none` has 15–20
+- there are at least 30 traps
+
+It prints the counts table above and the file's sha256.
diff --git a/v3/@claude-flow/cli/benchmarks/router/corpus.jsonl b/v3/@claude-flow/cli/benchmarks/router/corpus.jsonl
new file mode 100644
index 0000000000..dd38b692a5
--- /dev/null
+++ b/v3/@claude-flow/cli/benchmarks/router/corpus.jsonl
@@ -0,0 +1,197 @@
+{"id":"r001","prompt":"the secret-scanner regex misses common real key formats, which patterns should it catch?","label":"security-architect","split":"dev","trap":false,"source":"issue","note":"secret detection coverage"}
+{"id":"r002","prompt":"catch me up on what changed in 3.43.0","label":"researcher","split":"dev","trap":false,"source":"pr","note":"summarise changes"}
+{"id":"r003","prompt":"native builds fail on the windows-latest runner, pin the runner image","label":"devops","split":"dev","trap":false,"source":"issue","note":"CI"}
+{"id":"r004","prompt":"set up RaBitQ quantization for the vector index","label":"memory-specialist","split":"dev","trap":false,"source":"synthetic","note":"vector quantization"}
+{"id":"r005","prompt":"cut allocations in the JSONL parser, it is dominating GC","label":"performance-engineer","split":"dev","trap":false,"source":"synthetic","note":"optimisation"}
+{"id":"r006","prompt":"memory_import_claude cuts sections off at 4096 chars","label":"memory-specialist","split":"test","trap":false,"source":"issue","note":"memory import"}
+{"id":"r007","prompt":"fix teh off-by-one in the date bucketing of cost-burn","label":"coder","split":"dev","trap":false,"source":"synthetic","note":"bug fix (typo intentional)"}
+{"id":"r008","prompt":"add a regression test that pins statusline --json stdout purity","label":"tester","split":"dev","trap":false,"source":"pr","note":"write a regression test"}
+{"id":"r009","prompt":"make `ruflo doctor` print a hint when node is older than 20","label":"coder","split":"test","trap":false,"source":"synthetic","note":"small feature"}
+{"id":"r010","prompt":"the author field is missing in the prefix list","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"a data/code omission to fix; \"prefix list\" is not a memory/search task"}
+{"id":"r011","prompt":"run a security scan on the new plugin before we publish it","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"security scan"}
+{"id":"r012","prompt":"how do plugins get registered with the MCP server?","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"how does X work"}
+{"id":"r013","prompt":"do the thing","label":"none","split":"dev","trap":false,"source":"synthetic","note":"vague, no identifiable task"}
+{"id":"r014","prompt":"good morning","label":"none","split":"test","trap":false,"source":"synthetic","note":"greeting"}
+{"id":"r015","prompt":"pnpm-lock.yaml drifted and every frozen-lockfile CI job fails","label":"devops","split":"test","trap":false,"source":"issue","note":"CI/lockfile"}
+{"id":"r016","prompt":"summarise the open Dream Cycle issues from this week","label":"researcher","split":"dev","trap":false,"source":"issue","note":"summarise"}
+{"id":"r017","prompt":"is this patch idiomatic TypeScript? pasting it below","label":"reviewer","split":"dev","trap":false,"source":"synthetic","note":"code quality review"}
+{"id":"r018","prompt":"launch a multi-agent team to triage all open issues in parallel","label":"swarm-specialist","split":"dev","trap":true,"source":"synthetic","note":"the ask is launching the team"}
+{"id":"r019","prompt":"import my Claude Code memories into AgentDB","label":"memory-specialist","split":"dev","trap":false,"source":"synthetic","note":"AgentDB import"}
+{"id":"r020","prompt":"consolidate duplicate memory entries across namespaces","label":"memory-specialist","split":"test","trap":false,"source":"synthetic","note":"memory consolidation"}
+{"id":"r021","prompt":"write up an ADR on versioning policy for MCP tool signatures","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"ADR"}
+{"id":"r022","prompt":"can you look over my diff before I push? mainly correctness","label":"reviewer","split":"test","trap":false,"source":"synthetic","note":"diff review"}
+{"id":"r023","prompt":"review the swarm topology PR before we merge it","label":"reviewer","split":"dev","trap":true,"source":"synthetic","note":"PR review; swarm is the subject"}
+{"id":"r024","prompt":"lol","label":"none","split":"dev","trap":false,"source":"synthetic","note":"chit-chat"}
+{"id":"r025","prompt":"remind me to call mom at 5","label":"none","split":"test","trap":false,"source":"synthetic","note":"non-software"}
+{"id":"r026","prompt":"run a byzantine consensus vote among the reviewer agents","label":"swarm-specialist","split":"test","trap":true,"source":"synthetic","note":"consensus orchestration, not code review"}
+{"id":"r027","prompt":"plan the refactor of commands/ into bounded contexts","label":"architect","split":"test","trap":false,"source":"synthetic","note":"refactor planning"}
+{"id":"r028","prompt":"add london-school mocks for the AgentDB controller in the hooks tests","label":"tester","split":"test","trap":true,"source":"synthetic","note":"mocking in tests, not AgentDB work"}
+{"id":"r029","prompt":"design the REST API for the gateway invites endpoint","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"API design"}
+{"id":"r030","prompt":"design the data model for the swarm state store","label":"architect","split":"test","trap":true,"source":"synthetic","note":"data model design; swarm is the subject"}
+{"id":"r031","prompt":"autopilot accepts task sources that are not valid, reject them","label":"coder","split":"test","trap":false,"source":"pr","note":"input handling fix"}
+{"id":"r032","prompt":"give me a review of the diff on the feat/adr-390-minilm-router branch","label":"reviewer","split":"test","trap":false,"source":"synthetic","note":"branch diff review"}
+{"id":"r033","prompt":"config_set writes under a `values` envelope that the daemon reader never unwraps. make the reader handle it","label":"coder","split":"test","trap":false,"source":"issue","note":"bug fix in config reader"}
+{"id":"r034","prompt":"bump node in CI to 24","label":"devops","split":"dev","trap":false,"source":"synthetic","note":"CI"}
+{"id":"r035","prompt":"list every place the CLI calls process.exit","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"code search"}
+{"id":"r036","prompt":"review the PR for security problems, it touches token handling","label":"security-architect","split":"dev","trap":true,"source":"synthetic","note":"security review is primary, not general code review"}
+{"id":"r037","prompt":"entries from one tenant might be readable by another in the memory store, investigate the isolation","label":"security-architect","split":"test","trap":true,"source":"synthetic","note":"cross-tenant exposure is a security question"}
+{"id":"r038","prompt":"npm audit flags a critical protobufjs issue through agentdb, figure out the remediation path","label":"security-architect","split":"test","trap":true,"source":"issue","note":"CVE remediation; agentdb is only the dependency chain"}
+{"id":"r039","prompt":"the loadEd25519 error message mentions an env var the function never reads β€” fix the message","label":"coder","split":"dev","trap":false,"source":"issue","note":"fix an incorrect error string"}
+{"id":"r040","prompt":"write a failing test that reproduces the secret-scanner false negative before anyone fixes it","label":"tester","split":"dev","trap":true,"source":"synthetic","note":"reproduction test; the security fix is someone else's task"}
+{"id":"r041","prompt":"profile ruflo cold start, it takes 2s","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"profiling"}
+{"id":"r042","prompt":"why does swarm status always say 0 agents? figure out which stores spawn and list use β€” just report, no fix","label":"researcher","split":"test","trap":true,"source":"issue","note":"investigation only"}
+{"id":"r043","prompt":"MMR reranking re-tokenizes every candidate on each call, optimise that","label":"performance-engineer","split":"dev","trap":false,"source":"pr","note":"optimisation"}
+{"id":"r044","prompt":"check my refactor did not change behaviour, diff attached","label":"reviewer","split":"test","trap":false,"source":"synthetic","note":"behaviour-preservation review"}
+{"id":"r045","prompt":"agents can inject instructions into each other β€” threat model cross-agent contagion","label":"security-architect","split":"dev","trap":true,"source":"issue","note":"threat model; swarm is the setting"}
+{"id":"r046","prompt":"optimise the hot loop in the cosine similarity function","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"optimisation"}
+{"id":"r047","prompt":"spin up a swarm of 5 agents to refactor the hooks package","label":"swarm-specialist","split":"dev","trap":true,"source":"synthetic","note":"the ask is to set up the multi-agent run"}
+{"id":"r048","prompt":"what does embeddings init actually download?","label":"researcher","split":"dev","trap":true,"source":"issue","note":"understand existing behaviour"}
+{"id":"r049","prompt":"check recall@10 of the vector index after re-embedding everything","label":"memory-specialist","split":"test","trap":true,"source":"synthetic","note":"index quality, not a test suite or latency task"}
+{"id":"r050","prompt":"fix the failing vitest snapshot in the doctor command tests","label":"tester","split":"test","trap":false,"source":"synthetic","note":"test maintenance"}
+{"id":"r051","prompt":"harden the MCP server against prompt injection coming back in tool results","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"hardening"}
+{"id":"r052","prompt":"increase test coverage for the memory bridge search path","label":"tester","split":"test","trap":true,"source":"synthetic","note":"coverage work; memory is only the subject under test"}
+{"id":"r053","prompt":"code review the memory bridge PR β€” is the WAL handle release right?","label":"reviewer","split":"dev","trap":true,"source":"pr","note":"reviewing a PR; memory is the subject"}
+{"id":"r054","prompt":"review the latest issues","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"reading and triaging issues, not a code review"}
+{"id":"r055","prompt":"review this change to the policy lock handling for correctness under concurrent callers","label":"reviewer","split":"test","trap":false,"source":"issue","note":"code review for correctness"}
+{"id":"r056","prompt":"go through the stale issues and tell me which are already fixed on main","label":"researcher","split":"dev","trap":false,"source":"issue","note":"triage"}
+{"id":"r057","prompt":"fast-uri has a CVE, are we affected?","label":"security-architect","split":"dev","trap":false,"source":"pr","note":"CVE triage"}
+{"id":"r058","prompt":"codex exec hangs forever because the dual-mode orchestrator never closes the worker stdin","label":"coder","split":"test","trap":true,"source":"issue","note":"process-handling bug; \"orchestrator\" is a class name, not swarm work"}
+{"id":"r059","prompt":"review PR #3406","label":"reviewer","split":"dev","trap":false,"source":"pr","note":"PR review"}
+{"id":"r060","prompt":"design a namespace scheme for storing agent patterns in AgentDB","label":"memory-specialist","split":"dev","trap":true,"source":"synthetic","note":"memory layout within AgentDB, not system architecture"}
+{"id":"r061","prompt":"memory_search takes 900ms on 50k entries, profile it and find where the time goes","label":"performance-engineer","split":"test","trap":true,"source":"synthetic","note":"latency profiling; memory is the subject"}
+{"id":"r062","prompt":"find where the daemon reads config.json","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"locate code"}
+{"id":"r063","prompt":"tune HNSW efSearch and M for our 20k-entry memory","label":"memory-specialist","split":"test","trap":false,"source":"synthetic","note":"HNSW tuning"}
+{"id":"r064","prompt":"write me a haiku about autumn","label":"none","split":"test","trap":false,"source":"synthetic","note":"non-software"}
+{"id":"r065","prompt":"write a function that parses ADR front-matter into a typed object","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"write code; ADR is the input format, not an architecture task"}
+{"id":"r066","prompt":"plan the migration from the v2 config format to v3 without breaking existing users","label":"architect","split":"test","trap":false,"source":"synthetic","note":"migration design"}
+{"id":"r067","prompt":"design the event schema for task lifecycle event sourcing","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"schema design"}
+{"id":"r068","prompt":"the smoke job times out during npm install behind the proxy","label":"devops","split":"test","trap":false,"source":"issue","note":"CI infrastructure"}
+{"id":"r069","prompt":"--provider and --model on agent spawn are ignored at execution time, wire them through","label":"coder","split":"test","trap":true,"source":"issue","note":"plumbing bug; \"agent spawn\" does not make it coordination work"}
+{"id":"r070","prompt":"how do the deploy paths for the api, website and meta-llm repos differ?","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"explain; not performing a deploy"}
+{"id":"r071","prompt":"the swarm lifecycle test runs against source instead of the built CLI, guard it on dist","label":"tester","split":"dev","trap":true,"source":"pr","note":"test harness fix"}
+{"id":"r072","prompt":"compare sql.js and better-sqlite3 β€” tradeoffs for a CLI that runs on Windows and Android","label":"researcher","split":"dev","trap":false,"source":"issue","note":"compare options"}
+{"id":"r073","prompt":"set up a staging environment on fly","label":"devops","split":"test","trap":false,"source":"synthetic","note":"infrastructure"}
+{"id":"r074","prompt":"do a code review pass on src/commands/doctor.ts","label":"reviewer","split":"test","trap":false,"source":"synthetic","note":"code review"}
+{"id":"r075","prompt":"hooks statusline --json writes [WARN] lines to stdout and breaks JSON parsers, send them to stderr","label":"coder","split":"test","trap":false,"source":"issue","note":"output-stream bug fix"}
+{"id":"r076","prompt":"implement the scaffold-drift fix described in ADR-382 in the init command","label":"coder","split":"dev","trap":true,"source":"pr","note":"implementation of an already-decided ADR"}
+{"id":"r077","prompt":"review the test changes in #3403 β€” are the assertions actually meaningful?","label":"reviewer","split":"test","trap":true,"source":"pr","note":"reviewing test code, not writing tests"}
+{"id":"r078","prompt":"check the plugin installer for path traversal","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"vulnerability check"}
+{"id":"r079","prompt":"second pair of eyes on the typesafe router integration PR please","label":"reviewer","split":"dev","trap":false,"source":"pr","note":"PR review"}
+{"id":"r080","prompt":"config.instructions is not being passed as the system prompt fallback in agent-execute-core","label":"coder","split":"test","trap":false,"source":"issue","note":"bug fix"}
+{"id":"r081","prompt":"tell me a joke","label":"none","split":"dev","trap":false,"source":"synthetic","note":"chit-chat"}
+{"id":"r082","prompt":"why is the MCP server at 1.2GB RSS after an hour?","label":"performance-engineer","split":"dev","trap":true,"source":"synthetic","note":"process memory/leak profiling, not the memory store"}
+{"id":"r083","prompt":"thanks, that fixed the test","label":"none","split":"test","trap":true,"source":"synthetic","note":"acknowledgement containing engineering words"}
+{"id":"r084","prompt":"throughput drops when 8 agents write at once, find where the time is spent","label":"performance-engineer","split":"test","trap":true,"source":"synthetic","note":"throughput profiling, not coordination"}
+{"id":"r085","prompt":"audit the auth middleware for session fixation","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"auth security audit"}
+{"id":"r086","prompt":"there are no tests for the percentile math in the benchmark harness, add some","label":"tester","split":"test","trap":true,"source":"synthetic","note":"write tests; not a performance measurement"}
+{"id":"r087","prompt":"running the CLI test suite edits my real ~/.claude/CLAUDE.md β€” isolate HOME in those tests","label":"tester","split":"dev","trap":false,"source":"issue","note":"test isolation fix"}
+{"id":"r088","prompt":"test whether the deploy works","label":"devops","split":"dev","trap":true,"source":"synthetic","note":"deployment verification, not test authoring"}
+{"id":"r089","prompt":"propose module boundaries for the hooks package, it has turned into a grab bag","label":"architect","split":"test","trap":false,"source":"synthetic","note":"module boundaries"}
+{"id":"r090","prompt":"?","label":"none","split":"dev","trap":false,"source":"synthetic","note":"no content"}
+{"id":"r091","prompt":"explain the ADR-150 AND-gate to me","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"explain an existing decision"}
+{"id":"r092","prompt":"migrate the entries in memory.db into agentdb-memory.db","label":"memory-specialist","split":"dev","trap":false,"source":"issue","note":"memory store migration"}
+{"id":"r093","prompt":"the swarm drifts off task after 20 minutes, tune the coordination so agents stay on track","label":"swarm-specialist","split":"test","trap":false,"source":"synthetic","note":"anti-drift coordination"}
+{"id":"r094","prompt":"the performance tab crashes when there are no metrics yet, pls add the null check","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"null-check crash fix; not an optimisation task"}
+{"id":"r095","prompt":"read issue #3327 and explain Finding A to me","label":"researcher","split":"dev","trap":false,"source":"issue","note":"read and explain an issue"}
+{"id":"r096","prompt":"add property-based tests for the semver range checker","label":"tester","split":"test","trap":false,"source":"synthetic","note":"write tests"}
+{"id":"r097","prompt":"never mind","label":"none","split":"test","trap":false,"source":"synthetic","note":"no task"}
+{"id":"r098","prompt":"threat model the x-gateway relay","label":"security-architect","split":"dev","trap":false,"source":"pr","note":"threat modelling"}
+{"id":"r099","prompt":"how does hooks post-task decide what to record?","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"how does X work"}
+{"id":"r100","prompt":"compare cold and warm latency of the four router candidates","label":"performance-engineer","split":"dev","trap":false,"source":"synthetic","note":"latency benchmarking"}
+{"id":"r101","prompt":"mock the embeddings provider so the unit tests stop downloading a model","label":"tester","split":"test","trap":true,"source":"synthetic","note":"test isolation; not embedding work"}
+{"id":"r102","prompt":"does init carry untrusted hooks and allow-rules forward on upgrade? security review it","label":"security-architect","split":"test","trap":false,"source":"issue","note":"security review"}
+{"id":"r103","prompt":"review what is in the patterns namespace and dedupe it","label":"memory-specialist","split":"test","trap":true,"source":"synthetic","note":"memory curation, not code review"}
+{"id":"r104","prompt":"who won the game last night","label":"none","split":"test","trap":false,"source":"synthetic","note":"non-software"}
+{"id":"r105","prompt":"great review, cheers","label":"none","split":"dev","trap":true,"source":"synthetic","note":"acknowledgement containing \"review\""}
+{"id":"r106","prompt":"stuff","label":"none","split":"test","trap":false,"source":"synthetic","note":"vague one-word"}
+{"id":"r107","prompt":"the quantization recall test is flaky on unseeded random vectors, seed it so it is deterministic","label":"tester","split":"dev","trap":true,"source":"issue","note":"fixing a flaky test, not tuning quantization"}
+{"id":"r108","prompt":"can you recommend a good pizza place in toronto","label":"none","split":"dev","trap":false,"source":"synthetic","note":"non-software"}
+{"id":"r109","prompt":"how should the plugin manifest v2 be structured so it stays backwards compatible?","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"format/API design"}
+{"id":"r110","prompt":"can u write tests for the new parser","label":"tester","split":"test","trap":false,"source":"synthetic","note":"write tests"}
+{"id":"r111","prompt":"what is NIP-98 and how does the relay use it? short summary pls","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"explain a spec"}
+{"id":"r112","prompt":"draft an ADR: typesafe as a tie-break second opinion behind the default router","label":"architect","split":"test","trap":false,"source":"synthetic","note":"ADR"}
+{"id":"r113","prompt":"init reads kebab-case flag keys but the parser gives camelCase, so --all-agents is always undefined. fix it","label":"coder","split":"test","trap":false,"source":"issue","note":"straightforward bug fix"}
+{"id":"r114","prompt":"what methodology does the intelligence-system audit doc use for its benchmark numbers?","label":"researcher","split":"dev","trap":true,"source":"synthetic","note":"read and explain a doc; not running a benchmark"}
+{"id":"r115","prompt":"add a config option uing camelCase for the daemon idle timeout","label":"coder","split":"test","trap":false,"source":"synthetic","note":"small feature (typo intentional)"}
+{"id":"r116","prompt":"thanks!","label":"none","split":"test","trap":false,"source":"synthetic","note":"acknowledgement"}
+{"id":"r117","prompt":"refactor the parseArgs helper to get rid of the duplicated switch statement","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"local code change, not refactor planning"}
+{"id":"r118","prompt":"configure dependabot to group minor bumps","label":"devops","split":"test","trap":false,"source":"pr","note":"repo automation"}
+{"id":"r119","prompt":"add a GitHub Actions job that re-runs the router bench when hooks_route changes","label":"devops","split":"dev","trap":true,"source":"synthetic","note":"CI job setup; the bench already exists"}
+{"id":"r120","prompt":"implement retry for transient rename failures in writeJsonAtomic and never leave the temp file behind","label":"coder","split":"test","trap":false,"source":"pr","note":"implement a behaviour change"}
+{"id":"r121","prompt":"add test cases for the ADR index rebuild when a source file was deleted","label":"tester","split":"dev","trap":true,"source":"issue","note":"test cases; ADR is the subject"}
+{"id":"r122","prompt":"design the schema for the router benchmark receipts","label":"architect","split":"test","trap":false,"source":"synthetic","note":"schema design"}
+{"id":"r123","prompt":"docker build cache is filling the disk on the build box, prune it safely","label":"devops","split":"test","trap":false,"source":"synthetic","note":"infrastructure"}
+{"id":"r124","prompt":"add e2e tests for `ruflo init --dual`","label":"tester","split":"test","trap":false,"source":"synthetic","note":"write tests"}
+{"id":"r125","prompt":"run three researchers in parallel and merge their findings","label":"swarm-specialist","split":"test","trap":true,"source":"synthetic","note":"orchestrating agents, not doing research"}
+{"id":"r126","prompt":"our cold-start benchmark measured setTimeout, not the CLI β€” fix the measurement so the numbers are real","label":"performance-engineer","split":"test","trap":false,"source":"issue","note":"benchmark correctness"}
+{"id":"r127","prompt":"add a --json flag to `ruflo swarm status`","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"small CLI feature; swarm is only the command name"}
+{"id":"r128","prompt":"benchmark the three kernel backends and compare throughput","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"benchmarking"}
+{"id":"r129","prompt":"sketch an architecture for an embeddings cache β€” design only, no code yet","label":"architect","split":"dev","trap":true,"source":"synthetic","note":"design, not memory tuning or perf work"}
+{"id":"r130","prompt":"run the benchmark","label":"performance-engineer","split":"dev","trap":true,"source":"synthetic","note":"running a benchmark is perf work, not CI/devops"}
+{"id":"r131","prompt":"set up a pipeline where the architect agent hands to the coder agent, which hands to the tester agent","label":"swarm-specialist","split":"dev","trap":true,"source":"synthetic","note":"multi-agent pipeline wiring"}
+{"id":"r132","prompt":"two agents are idle and one is overloaded, rebalance the swarm","label":"swarm-specialist","split":"test","trap":false,"source":"synthetic","note":"load balancing across agents"}
+{"id":"r133","prompt":"publish 3.43.1 to npm and update the dist-tags","label":"devops","split":"test","trap":false,"source":"synthetic","note":"release"}
+{"id":"r134","prompt":"the deploy script has zero test coverage β€” write tests for its argument parsing","label":"tester","split":"test","trap":true,"source":"synthetic","note":"unit tests for a script, not deployment"}
+{"id":"r135","prompt":"set up a mesh of agents across two machines over federation","label":"swarm-specialist","split":"dev","trap":false,"source":"synthetic","note":"cross-machine agent coordination"}
+{"id":"r136","prompt":"test whether the executor endpoint can be reached without auth","label":"security-architect","split":"dev","trap":true,"source":"synthetic","note":"probing an auth boundary, not writing tests"}
+{"id":"r137","prompt":"memory delete leaves the vector in the search index β€” clean up the orphaned vectors","label":"memory-specialist","split":"test","trap":false,"source":"issue","note":"vector index maintenance"}
+{"id":"r138","prompt":"which topology fits 12 agents doing independent benchmark runs?","label":"swarm-specialist","split":"test","trap":true,"source":"synthetic","note":"topology choice, not benchmarking"}
+{"id":"r139","prompt":"update the test fixtures for the auth API","label":"tester","split":"dev","trap":true,"source":"synthetic","note":"fixture maintenance is test work, not security"}
+{"id":"r140","prompt":"the design doc says the audit-list tool takes --since but it does not, add it","label":"coder","split":"test","trap":true,"source":"synthetic","note":"implement a missing flag; the design already exists"}
+{"id":"r141","prompt":"tag v3.43.0 and create the GitHub release","label":"devops","split":"dev","trap":false,"source":"synthetic","note":"release"}
+{"id":"r142","prompt":"policy_evaluate throws on a malformed request, make it return a validation error instead","label":"coder","split":"test","trap":false,"source":"pr","note":"bug fix"}
+{"id":"r143","prompt":"reduce CLI startup time","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"optimisation"}
+{"id":"r144","prompt":"the test suite takes 14 minutes, find out what is slow","label":"performance-engineer","split":"dev","trap":true,"source":"synthetic","note":"profiling runtime, not writing tests"}
+{"id":"r145","prompt":"build the UI component for the agent status panel","label":"coder","split":"dev","trap":true,"source":"synthetic","note":"\"build\" means write the component, not a CI build"}
+{"id":"r146","prompt":"write an ADR for splitting the memory bridge into separate read and write paths","label":"architect","split":"test","trap":true,"source":"synthetic","note":"ADR/boundary decision; memory is the subject"}
+{"id":"r147","prompt":"could the helpers signing key leak into tool output during publish? assess it","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"secret exposure assessment"}
+{"id":"r148","prompt":"hello","label":"none","split":"test","trap":false,"source":"synthetic","note":"greeting"}
+{"id":"r149","prompt":"configure a hierarchical topology with a queen and 6 workers","label":"swarm-specialist","split":"test","trap":false,"source":"synthetic","note":"topology"}
+{"id":"r150","prompt":"memory store reports success but nothing is persisted after the better-sqlite3 to sql.js fallback","label":"memory-specialist","split":"dev","trap":false,"source":"issue","note":"memory backend persistence"}
+{"id":"r151","prompt":"write unit tests for writeJsonAtomic covering the rename-retry path","label":"tester","split":"test","trap":false,"source":"pr","note":"write tests"}
+{"id":"r152","prompt":"configure the RRF weights in the hybrid memory backend","label":"memory-specialist","split":"test","trap":false,"source":"pr","note":"hybrid retrieval tuning"}
+{"id":"r153","prompt":"is there prior art for semantic agent routing? papers or open-source projects","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"literature search"}
+{"id":"r154","prompt":"coordinate a hive-mind with raft consensus for this release","label":"swarm-specialist","split":"dev","trap":false,"source":"synthetic","note":"hive-mind coordination"}
+{"id":"r155","prompt":"our agents keep editing the same files β€” set up ownership and handoff between them","label":"swarm-specialist","split":"test","trap":false,"source":"issue","note":"agent coordination"}
+{"id":"r156","prompt":"post-task drops the routing outcome when --agent has a colon in it, handle plugin-qualified agent names","label":"coder","split":"test","trap":false,"source":"issue","note":"parsing bug fix"}
+{"id":"r157","prompt":"statusline shows the baked-in version when run from a git worktree; resolve the package from the main repo node_modules instead","label":"coder","split":"dev","trap":false,"source":"issue","note":"path-resolution bug fix"}
+{"id":"r158","prompt":"our session tokens never expire β€” what is the risk and what should we do","label":"security-architect","split":"test","trap":false,"source":"synthetic","note":"auth hardening"}
+{"id":"r159","prompt":"`memory <unknown-subcommand>` prints usage and exits 0 β€” make it exit non-zero","label":"coder","split":"test","trap":true,"source":"issue","note":"CLI exit-code bug; no memory-store expertise involved"}
+{"id":"r160","prompt":"look into how other CLIs handle update notifications","label":"researcher","split":"dev","trap":false,"source":"synthetic","note":"external research"}
+{"id":"r161","prompt":"decide which packages may import which, and draw the allowed dependency graph","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"module boundaries"}
+{"id":"r162","prompt":"p95 of hooks_route got worse after 3.42 β€” measure it","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"latency measurement"}
+{"id":"r163","prompt":"what time is it","label":"none","split":"dev","trap":false,"source":"synthetic","note":"not an engineering task"}
+{"id":"r164","prompt":"pls review my PR, its the one fixing the kebab flags","label":"reviewer","split":"test","trap":false,"source":"pr","note":"PR review"}
+{"id":"r165","prompt":"add a CD workflow for the website repo","label":"devops","split":"test","trap":false,"source":"synthetic","note":"CD"}
+{"id":"r166","prompt":"shut the swarm down cleanly and hand off the unclaimed tasks","label":"swarm-specialist","split":"dev","trap":false,"source":"synthetic","note":"swarm lifecycle"}
+{"id":"r167","prompt":"design the public interface for a pluggable router","label":"architect","split":"test","trap":false,"source":"synthetic","note":"API design"}
+{"id":"r168","prompt":"critique the error handling in this function","label":"reviewer","split":"dev","trap":false,"source":"synthetic","note":"code quality review"}
+{"id":"r169","prompt":"translate \"good night\" into french","label":"none","split":"test","trap":false,"source":"synthetic","note":"non-software"}
+{"id":"r170","prompt":"the daemon sits at 100% CPU when idle","label":"performance-engineer","split":"test","trap":false,"source":"synthetic","note":"CPU profiling"}
+{"id":"r171","prompt":"flame graph the statusline render","label":"performance-engineer","split":"dev","trap":false,"source":"synthetic","note":"profiling"}
+{"id":"r172","prompt":"add pagination to the list output of the claims command","label":"coder","split":"test","trap":false,"source":"synthetic","note":"feature work"}
+{"id":"r173","prompt":"deploy the gateway to Cloud Run and confirm traffic moved to the new revision","label":"devops","split":"dev","trap":false,"source":"synthetic","note":"deploy"}
+{"id":"r174","prompt":"add a CI check that the packed tarball actually contains dist/","label":"devops","split":"test","trap":true,"source":"synthetic","note":"release pipeline gate, not a unit test"}
+{"id":"r175","prompt":"hive-mind init generates a hiveId but never saves it, so status shows a different id β€” fix that","label":"coder","split":"dev","trap":true,"source":"pr","note":"persistence bug in a CLI command, no coordination design needed"}
+{"id":"r176","prompt":"summarize the discussion on issue 2399","label":"researcher","split":"test","trap":false,"source":"issue","note":"summarise"}
+{"id":"r177","prompt":"which packages depend on @claude-flow/memory?","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"dependency lookup"}
+{"id":"r178","prompt":"switch memory search from hash embeddings to MiniLM","label":"memory-specialist","split":"dev","trap":false,"source":"synthetic","note":"embedding backend"}
+{"id":"r179","prompt":"memory search only sees the oldest rows because the candidate scan uses LIMIT 1000 without ORDER BY","label":"memory-specialist","split":"test","trap":false,"source":"issue","note":"retrieval correctness"}
+{"id":"r180","prompt":"write a Dockerfile for the MCP server","label":"devops","split":"test","trap":false,"source":"synthetic","note":"Docker"}
+{"id":"r181","prompt":"validateEnv() denylist is missing PATH and friends β€” assess the CWE-427 exposure","label":"security-architect","split":"dev","trap":false,"source":"issue","note":"vulnerability assessment"}
+{"id":"r182","prompt":"what is the weather like tomorrow","label":"none","split":"dev","trap":false,"source":"synthetic","note":"non-software"}
+{"id":"r183","prompt":"the CD workflow goes green without deploy credentials, make it fail loudly","label":"devops","split":"dev","trap":false,"source":"issue","note":"CD pipeline"}
+{"id":"r184","prompt":"what is the difference between hive-mind and swarm in ruflo?","label":"researcher","split":"dev","trap":true,"source":"synthetic","note":"conceptual question, not orchestration"}
+{"id":"r185","prompt":"we need a contract between the daemon and the MCP server β€” define it","label":"architect","split":"test","trap":false,"source":"synthetic","note":"interface definition"}
+{"id":"r186","prompt":"what should our test strategy be for the MCP tools β€” which parts unit vs integration?","label":"tester","split":"dev","trap":false,"source":"synthetic","note":"test strategy"}
+{"id":"r187","prompt":"review the changelog and tell me which releases touched hooks","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"reading history, not code review"}
+{"id":"r188","prompt":"what does the memory module do","label":"researcher","split":"dev","trap":true,"source":"synthetic","note":"explain existing code"}
+{"id":"r189","prompt":"add a --dry-run flag to the cleanup command","label":"coder","split":"test","trap":false,"source":"synthetic","note":"small feature"}
+{"id":"r190","prompt":"look at the benchmark script PR and tell me if the code is clean","label":"reviewer","split":"test","trap":true,"source":"synthetic","note":"code quality review, not benchmarking"}
+{"id":"r191","prompt":"LGTM or not? PR #3398, the rename retry logic","label":"reviewer","split":"test","trap":false,"source":"pr","note":"PR review"}
+{"id":"r192","prompt":"triage the new bug reports and group them by component","label":"researcher","split":"test","trap":false,"source":"synthetic","note":"triage"}
+{"id":"r193","prompt":"ok","label":"none","split":"test","trap":false,"source":"synthetic","note":"acknowledgement"}
+{"id":"r194","prompt":"how does the test runner find its fixtures?","label":"researcher","split":"test","trap":true,"source":"synthetic","note":"how does X work"}
+{"id":"r195","prompt":"Float32Array embeddings are not recognised and memory falls back to hash vectors","label":"memory-specialist","split":"test","trap":false,"source":"issue","note":"embedding handling"}
+{"id":"r196","prompt":"write a small CLI command that prints the ruflo version and the node version","label":"coder","split":"dev","trap":false,"source":"synthetic","note":"write code"}
+{"id":"r197","prompt":"should claims be one service or stay as four separate systems? sketch the options","label":"architect","split":"dev","trap":false,"source":"synthetic","note":"architecture options"}
diff --git a/v3/@claude-flow/cli/benchmarks/router/results/router-bench-2026-09-23.json b/v3/@claude-flow/cli/benchmarks/router/results/router-bench-2026-09-23.json
new file mode 100644
index 0000000000..5d682327a4
--- /dev/null
+++ b/v3/@claude-flow/cli/benchmarks/router/results/router-bench-2026-09-23.json
@@ -0,0 +1,7630 @@
+{
+ "adr": "ADR-391",
+ "ts": "2026-09-23T18:27:43.084Z",
+ "corpusSha256": "b0c1923b2813b61907304dff56c53d199b709797bfb9600a7c1f496cf0c0bf04",
+ "node": "v22.23.2",
+ "host": "linux-x64",
+ "highConfidence": 0.7,
+ "gate": {
+ "B": {
+ "accuracyDeltaPts": 10.62,
+ "p95LatencyRegressionPct": 485,
+ "requiredDependencyAdded": false,
+ "passesAccuracy": true,
+ "passesLatency": false,
+ "passesDependency": true
+ },
+ "C": {
+ "accuracyDeltaPts": 0.89,
+ "p95LatencyRegressionPct": 12.7,
+ "requiredDependencyAdded": true,
+ "passesAccuracy": false,
+ "passesLatency": false,
+ "passesDependency": "optional-peer (allowed only as opt-in)"
+ },
+ "D": {
+ "accuracyDeltaPts": 3.54,
+ "p95LatencyRegressionPct": 686.1,
+ "requiredDependencyAdded": true,
+ "passesAccuracy": true,
+ "passesLatency": false,
+ "passesDependency": "optional-peer (allowed only as opt-in)"
+ }
+ },
+ "results": {
+ "A": {
+ "dev": {
+ "n": 84,
+ "accuracy": 0.2619,
+ "macroF1": 0.1996,
+ "wrongHighConfRate": 0.3214,
+ "trapAccuracy": 0.303
+ },
+ "test": {
+ "n": 113,
+ "accuracy": 0.2566,
+ "macroF1": 0.1775,
+ "wrongHighConfRate": 0.292,
+ "trapAccuracy": 0.2903
+ },
+ "latencyMs": {
+ "cold": 37.99,
+ "p50": 0.659,
+ "p95": 1.062
+ },
+ "predictions": [
+ {
+ "id": "r001",
+ "ms": 37.99279,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r002",
+ "ms": 0.4868100000000055,
+ "agent": "coder",
+ "confidence": 0.48,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r003",
+ "ms": 0.9899389999999997,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r004",
+ "ms": 0.6015099999999975,
+ "agent": "tester",
+ "confidence": 0.52,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r005",
+ "ms": 0.6375290000000007,
+ "agent": "tester",
+ "confidence": 0.46,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r006",
+ "ms": 0.6031300000000002,
+ "agent": "tester",
+ "confidence": 0.44,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r007",
+ "ms": 0.6299799999999962,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r008",
+ "ms": 0.6999589999999998,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r009",
+ "ms": 0.7006599999999992,
+ "agent": "swarm-specialist",
+ "confidence": 0.4,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r010",
+ "ms": 0.5656400000000019,
+ "agent": "tester",
+ "confidence": 0.56,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r011",
+ "ms": 0.6567989999999924,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r012",
+ "ms": 0.5663300000000078,
+ "agent": "tester",
+ "confidence": 0.46,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r013",
+ "ms": 0.1967300000000023,
+ "agent": "tester",
+ "confidence": 0.64,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r014",
+ "ms": 0.19214999999999804,
+ "agent": "swarm-specialist",
+ "confidence": 0.69,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r015",
+ "ms": 0.6947289999999953,
+ "agent": "performance-engineer",
+ "confidence": 0.4,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r016",
+ "ms": 0.5883000000000038,
+ "agent": "performance-engineer",
+ "confidence": 0.44,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r017",
+ "ms": 0.5921699999999959,
+ "agent": "tester",
+ "confidence": 0.45,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r018",
+ "ms": 0.7051999999999907,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r019",
+ "ms": 0.5066290000000038,
+ "agent": "architect",
+ "confidence": 0.5,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r020",
+ "ms": 0.6468500000000006,
+ "agent": "tester",
+ "confidence": 0.49,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r021",
+ "ms": 0.6785599999999903,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r022",
+ "ms": 0.6626389999999986,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r023",
+ "ms": 0.576430000000002,
+ "agent": "memory-specialist",
+ "confidence": 0.44,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r024",
+ "ms": 0.10147000000000617,
+ "agent": "architect",
+ "confidence": 0.52,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r025",
+ "ms": 0.32793000000000916,
+ "agent": "memory-specialist",
+ "confidence": 0.57,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r026",
+ "ms": 0.6297390000000007,
+ "agent": "coder",
+ "confidence": 0.44,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r027",
+ "ms": 0.5824900000000071,
+ "agent": "performance-engineer",
+ "confidence": 0.46,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r028",
+ "ms": 0.8965900000000033,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r029",
+ "ms": 0.6745590000000021,
+ "agent": "tester",
+ "confidence": 0.43,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r030",
+ "ms": 0.5391900000000049,
+ "agent": "tester",
+ "confidence": 0.58,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r031",
+ "ms": 0.7666090000000025,
+ "agent": "coder",
+ "confidence": 0.41,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r032",
+ "ms": 0.7946100000000058,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r033",
+ "ms": 1.154869000000005,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r034",
+ "ms": 0.28396000000000754,
+ "agent": "architect",
+ "confidence": 0.52,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r035",
+ "ms": 0.5078999999999922,
+ "agent": "coder",
+ "confidence": 0.49,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r036",
+ "ms": 0.6894199999999984,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r037",
+ "ms": 1.061749000000006,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r038",
+ "ms": 0.9940290000000118,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r039",
+ "ms": 1.1766700000000014,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r040",
+ "ms": 1.062459000000004,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r041",
+ "ms": 0.4381699999999995,
+ "agent": "architect",
+ "confidence": 0.55,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r042",
+ "ms": 1.110439999999997,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r043",
+ "ms": 0.7684689999999961,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r044",
+ "ms": 0.6300999999999988,
+ "agent": "architect",
+ "confidence": 0.9,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r045",
+ "ms": 0.9714089999999942,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r046",
+ "ms": 0.6765999999999934,
+ "agent": "performance-engineer",
+ "confidence": 0.49,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r047",
+ "ms": 0.6453300000000013,
+ "agent": "architect",
+ "confidence": 0.9,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r048",
+ "ms": 0.5250589999999988,
+ "agent": "tester",
+ "confidence": 0.57,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r049",
+ "ms": 0.7258599999999973,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r050",
+ "ms": 0.6679600000000079,
+ "agent": "tester",
+ "confidence": 0.43,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r051",
+ "ms": 0.8108289999999982,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r052",
+ "ms": 0.627200000000002,
+ "agent": "tester",
+ "confidence": 0.52,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r053",
+ "ms": 0.726649000000009,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r054",
+ "ms": 0.30979000000000667,
+ "agent": "tester",
+ "confidence": 0.67,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r055",
+ "ms": 0.9439899999999994,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r056",
+ "ms": 0.7731590000000068,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r057",
+ "ms": 0.4160399999999953,
+ "agent": "architect",
+ "confidence": 0.5,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r058",
+ "ms": 0.9608800000000031,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r059",
+ "ms": 0.216668999999996,
+ "agent": "swarm-specialist",
+ "confidence": 0.47,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r060",
+ "ms": 0.7030999999999921,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r061",
+ "ms": 0.8719899999999967,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r062",
+ "ms": 0.45816899999999805,
+ "agent": "tester",
+ "confidence": 0.6,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r063",
+ "ms": 0.5518499999999875,
+ "agent": "coder",
+ "confidence": 0.44,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r064",
+ "ms": 0.3669700000000091,
+ "agent": "architect",
+ "confidence": 0.48,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r065",
+ "ms": 0.717219,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r066",
+ "ms": 0.90561000000001,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r067",
+ "ms": 0.6325800000000044,
+ "agent": "tester",
+ "confidence": 0.48,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r068",
+ "ms": 0.6485489999999885,
+ "agent": "tester",
+ "confidence": 0.4,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r069",
+ "ms": 0.8946100000000001,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r070",
+ "ms": 0.7625099999999918,
+ "agent": "architect",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r071",
+ "ms": 0.9282589999999971,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r072",
+ "ms": 0.9458500000000072,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r073",
+ "ms": 0.4197589999999991,
+ "agent": "tester",
+ "confidence": 0.57,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r074",
+ "ms": 0.530210000000011,
+ "agent": "memory-specialist",
+ "confidence": 0.43,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r075",
+ "ms": 1.0243389999999977,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r076",
+ "ms": 0.8301000000000016,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r077",
+ "ms": 0.7982400000000069,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r078",
+ "ms": 0.5173089999999974,
+ "agent": "tester",
+ "confidence": 0.54,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r079",
+ "ms": 0.7103800000000007,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r080",
+ "ms": 1.008538999999999,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r081",
+ "ms": 0.20626000000000033,
+ "agent": "coder",
+ "confidence": 0.56,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r082",
+ "ms": 0.5475799999999964,
+ "agent": "tester",
+ "confidence": 0.43,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r083",
+ "ms": 0.33740999999999133,
+ "agent": "tester",
+ "confidence": 0.75,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r084",
+ "ms": 0.798608999999999,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r085",
+ "ms": 0.5322299999999984,
+ "agent": "tester",
+ "confidence": 0.54,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r086",
+ "ms": 0.8296100000000024,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r087",
+ "ms": 0.9388690000000111,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r088",
+ "ms": 0.3638899999999978,
+ "agent": "tester",
+ "confidence": 0.68,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r089",
+ "ms": 0.8507689999999997,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r090",
+ "ms": 0.0712299999999999,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r091",
+ "ms": 0.40718999999999994,
+ "agent": "tester",
+ "confidence": 0.52,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r092",
+ "ms": 0.6127400000000023,
+ "agent": "tester",
+ "confidence": 0.62,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r093",
+ "ms": 0.95090900000001,
+ "agent": "swarm-specialist",
+ "confidence": 0.9,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r094",
+ "ms": 0.8726999999999947,
+ "agent": "performance-engineer",
+ "confidence": 0.88,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r095",
+ "ms": 0.4998899999999935,
+ "agent": "memory-specialist",
+ "confidence": 0.43,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r096",
+ "ms": 0.5971289999999954,
+ "agent": "tester",
+ "confidence": 0.5,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r097",
+ "ms": 0.17450000000000898,
+ "agent": "memory-specialist",
+ "confidence": 0.65,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r098",
+ "ms": 0.38515999999999906,
+ "agent": "architect",
+ "confidence": 0.62,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r099",
+ "ms": 0.5228699999999975,
+ "agent": "tester",
+ "confidence": 0.49,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r100",
+ "ms": 0.6590790000000055,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r101",
+ "ms": 0.7756399999999957,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r102",
+ "ms": 0.9204200000000071,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r103",
+ "ms": 0.5979990000000015,
+ "agent": "tester",
+ "confidence": 0.52,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r104",
+ "ms": 0.33292000000000144,
+ "agent": "tester",
+ "confidence": 0.61,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r105",
+ "ms": 0.2650700000000086,
+ "agent": "architect",
+ "confidence": 0.75,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r106",
+ "ms": 0.11467000000000382,
+ "agent": "devops",
+ "confidence": 0.51,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r107",
+ "ms": 1.1050389999999908,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r108",
+ "ms": 0.5528599999999955,
+ "agent": "performance-engineer",
+ "confidence": 0.42,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r109",
+ "ms": 0.8871589999999969,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r110",
+ "ms": 0.41853000000000407,
+ "agent": "tester",
+ "confidence": 0.67,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r111",
+ "ms": 0.6855500000000063,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r112",
+ "ms": 0.8302889999999934,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r113",
+ "ms": 1.1012099999999805,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r114",
+ "ms": 0.9312989999999957,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r115",
+ "ms": 0.6697599999999966,
+ "agent": "performance-engineer",
+ "confidence": 0.41,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r116",
+ "ms": 0.13606999999998948,
+ "agent": "security-architect",
+ "confidence": 0.52,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r117",
+ "ms": 0.8105589999999836,
+ "agent": "architect",
+ "confidence": 0.9,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r118",
+ "ms": 0.47147999999998547,
+ "agent": "architect",
+ "confidence": 0.46,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r119",
+ "ms": 0.8518600000000163,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r120",
+ "ms": 1.0783589999999776,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r121",
+ "ms": 0.756069999999994,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r122",
+ "ms": 0.5691690000000165,
+ "agent": "tester",
+ "confidence": 0.47,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r123",
+ "ms": 0.7787800000000118,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r124",
+ "ms": 0.40230999999999995,
+ "agent": "tester",
+ "confidence": 0.53,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r125",
+ "ms": 0.6398000000000081,
+ "agent": "devops",
+ "confidence": 0.54,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r126",
+ "ms": 1.0541389999999922,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r127",
+ "ms": 0.4547100000000057,
+ "agent": "architect",
+ "confidence": 0.45,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r128",
+ "ms": 0.6513789999999915,
+ "agent": "devops",
+ "confidence": 0.48,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r129",
+ "ms": 0.7888399999999933,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r130",
+ "ms": 0.23631999999997788,
+ "agent": "performance-engineer",
+ "confidence": 0.79,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r131",
+ "ms": 1.0420990000000074,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r132",
+ "ms": 0.6785800000000108,
+ "agent": "tester",
+ "confidence": 0.48,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r133",
+ "ms": 0.508340000000004,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r134",
+ "ms": 0.8485589999999945,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r135",
+ "ms": 0.6682299999999941,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r136",
+ "ms": 0.6773890000000051,
+ "agent": "devops",
+ "confidence": 0.42,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r137",
+ "ms": 0.8860699999999895,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r138",
+ "ms": 0.6921600000000012,
+ "agent": "swarm-specialist",
+ "confidence": 0.5,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r139",
+ "ms": 0.46905899999998724,
+ "agent": "tester",
+ "confidence": 0.65,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r140",
+ "ms": 0.811080000000004,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r141",
+ "ms": 0.4757099999999923,
+ "agent": "tester",
+ "confidence": 0.5,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r142",
+ "ms": 0.9391689999999926,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r143",
+ "ms": 0.29493999999999687,
+ "agent": "architect",
+ "confidence": 0.64,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r144",
+ "ms": 0.5916699999999935,
+ "agent": "tester",
+ "confidence": 0.55,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r145",
+ "ms": 0.5453290000000095,
+ "agent": "architect",
+ "confidence": 0.43,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r146",
+ "ms": 0.8434799999999996,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r147",
+ "ms": 0.8165889999999933,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r148",
+ "ms": 0.11932000000001608,
+ "agent": "devops",
+ "confidence": 0.6,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r149",
+ "ms": 0.663470000000018,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r150",
+ "ms": 1.1883100000000013,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r151",
+ "ms": 0.7772190000000023,
+ "agent": "tester",
+ "confidence": 0.4,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r152",
+ "ms": 0.6090199999999868,
+ "agent": "tester",
+ "confidence": 0.48,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r153",
+ "ms": 0.8162389999999959,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r154",
+ "ms": 0.6461800000000153,
+ "agent": "architect",
+ "confidence": 0.41,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r155",
+ "ms": 0.866928999999999,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r156",
+ "ms": 1.0815900000000056,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r157",
+ "ms": 1.2978789999999947,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r158",
+ "ms": 0.7680900000000008,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r159",
+ "ms": 0.8086590000000058,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r160",
+ "ms": 0.5948499999999797,
+ "agent": "swarm-specialist",
+ "confidence": 0.45,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r161",
+ "ms": 0.8232100000000173,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r162",
+ "ms": 0.564819,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r163",
+ "ms": 0.21762999999998556,
+ "agent": "tester",
+ "confidence": 0.77,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r164",
+ "ms": 0.5662799999999777,
+ "agent": "performance-engineer",
+ "confidence": 0.47,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r165",
+ "ms": 0.4380400000000009,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r166",
+ "ms": 0.6587089999999876,
+ "agent": "swarm-specialist",
+ "confidence": 0.9,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r167",
+ "ms": 0.5670500000000231,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r168",
+ "ms": 0.4999699999999905,
+ "agent": "tester",
+ "confidence": 0.52,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r169",
+ "ms": 0.39852899999999636,
+ "agent": "tester",
+ "confidence": 0.62,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r170",
+ "ms": 0.4193300000000022,
+ "agent": "tester",
+ "confidence": 0.61,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r171",
+ "ms": 0.39539000000002034,
+ "agent": "architect",
+ "confidence": 0.65,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r172",
+ "ms": 0.5979000000000099,
+ "agent": "tester",
+ "confidence": 0.44,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r173",
+ "ms": 0.8211990000000071,
+ "agent": "devops",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r174",
+ "ms": 0.6908799999999928,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r175",
+ "ms": 0.9775989999999979,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r176",
+ "ms": 0.43828999999999496,
+ "agent": "memory-specialist",
+ "confidence": 0.54,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r177",
+ "ms": 0.5094699999999932,
+ "agent": "devops",
+ "confidence": 0.44,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r178",
+ "ms": 0.5684300000000064,
+ "agent": "memory-specialist",
+ "confidence": 0.51,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r179",
+ "ms": 1.0348490000000083,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r180",
+ "ms": 0.43326999999999316,
+ "agent": "memory-specialist",
+ "confidence": 0.5,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r181",
+ "ms": 0.8423689999999908,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r182",
+ "ms": 0.3919300000000021,
+ "agent": "tester",
+ "confidence": 0.65,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r183",
+ "ms": 0.7918400000000076,
+ "agent": "devops",
+ "confidence": 0.85,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r184",
+ "ms": 0.6428989999999999,
+ "agent": "memory-specialist",
+ "confidence": 0.5,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r185",
+ "ms": 0.7232600000000105,
+ "agent": "security-architect",
+ "confidence": 0.4,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r186",
+ "ms": 0.8909500000000037,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r187",
+ "ms": 0.6708690000000104,
+ "agent": "architect",
+ "confidence": 0.41,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r188",
+ "ms": 0.36223000000001093,
+ "agent": "memory-specialist",
+ "confidence": 0.55,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r189",
+ "ms": 0.4732099999999946,
+ "agent": "performance-engineer",
+ "confidence": 0.41,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r190",
+ "ms": 0.6896490000000028,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r191",
+ "ms": 0.4930400000000077,
+ "agent": "tester",
+ "confidence": 0.45,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r192",
+ "ms": 0.5948999999999955,
+ "agent": "architect",
+ "confidence": 0.42,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r193",
+ "ms": 0.08334999999999582,
+ "agent": "devops",
+ "confidence": 0.56,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r194",
+ "ms": 0.4823389999999961,
+ "agent": "tester",
+ "confidence": 0.59,
+ "embedder": "hash",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r195",
+ "ms": 0.8602400000000046,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r196",
+ "ms": 0.8100689999999986,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ },
+ {
+ "id": "r197",
+ "ms": 0.8646699999999896,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "hash",
+ "method": "keyword"
+ }
+ ]
+ },
+ "B": {
+ "dev": {
+ "n": 84,
+ "accuracy": 0.3452,
+ "macroF1": 0.3279,
+ "wrongHighConfRate": 0.4643,
+ "trapAccuracy": 0.3636
+ },
+ "test": {
+ "n": 113,
+ "accuracy": 0.3628,
+ "macroF1": 0.3335,
+ "wrongHighConfRate": 0.469,
+ "trapAccuracy": 0.2581
+ },
+ "latencyMs": {
+ "cold": 325.56,
+ "p50": 2.189,
+ "p95": 6.213
+ },
+ "predictions": [
+ {
+ "id": "r001",
+ "ms": 325.558016,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r002",
+ "ms": 2.629488999999978,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r003",
+ "ms": 2.393957999999998,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r004",
+ "ms": 2.150148999999999,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r005",
+ "ms": 1.7406590000000506,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r006",
+ "ms": 1.6508890000000065,
+ "agent": "memory-specialist",
+ "confidence": 0.45,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r007",
+ "ms": 2.2936090000000036,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r008",
+ "ms": 1.7468390000000227,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r009",
+ "ms": 2.6653590000000236,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r010",
+ "ms": 1.4015590000000202,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r011",
+ "ms": 6.022057000000018,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r012",
+ "ms": 6.812935999999979,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r013",
+ "ms": 3.5920380000000023,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r014",
+ "ms": 1.0287399999999707,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r015",
+ "ms": 8.410005000000012,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r016",
+ "ms": 4.587437999999963,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r017",
+ "ms": 4.084738000000016,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r018",
+ "ms": 8.839744999999994,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r019",
+ "ms": 2.8909079999999676,
+ "agent": "swarm-specialist",
+ "confidence": 0.43,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r020",
+ "ms": 3.24323899999996,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r021",
+ "ms": 2.333558000000039,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r022",
+ "ms": 3.624968000000024,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r023",
+ "ms": 2.412538999999981,
+ "agent": "swarm-specialist",
+ "confidence": 0.58,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r024",
+ "ms": 1.0176590000000374,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r025",
+ "ms": 3.488427999999999,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r026",
+ "ms": 2.1083090000000198,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r027",
+ "ms": 3.619939000000045,
+ "agent": "architect",
+ "confidence": 0.5,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r028",
+ "ms": 3.92818699999998,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r029",
+ "ms": 2.144128999999964,
+ "agent": "architect",
+ "confidence": 0.42,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r030",
+ "ms": 4.8483980000000315,
+ "agent": "swarm-specialist",
+ "confidence": 0.54,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r031",
+ "ms": 1.4637189999999691,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r032",
+ "ms": 3.5434679999999616,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r033",
+ "ms": 4.504327999999987,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r034",
+ "ms": 2.1165280000000166,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r035",
+ "ms": 3.649907999999982,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r036",
+ "ms": 2.8382990000000063,
+ "agent": "security-architect",
+ "confidence": 0.47,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r037",
+ "ms": 8.506836000000021,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r038",
+ "ms": 5.100637000000006,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r039",
+ "ms": 6.274376000000018,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r040",
+ "ms": 2.832538999999997,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r041",
+ "ms": 1.4084589999999935,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r042",
+ "ms": 3.5218980000000215,
+ "agent": "swarm-specialist",
+ "confidence": 0.43,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r043",
+ "ms": 5.849846999999954,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r044",
+ "ms": 2.155858999999964,
+ "agent": "architect",
+ "confidence": 0.63,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r045",
+ "ms": 2.9345880000000193,
+ "agent": "swarm-specialist",
+ "confidence": 0.49,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r046",
+ "ms": 3.219589000000042,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r047",
+ "ms": 2.510778000000016,
+ "agent": "swarm-specialist",
+ "confidence": 0.47,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r048",
+ "ms": 4.20117799999997,
+ "agent": "memory-specialist",
+ "confidence": 0.43,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r049",
+ "ms": 2.2492490000000203,
+ "agent": "memory-specialist",
+ "confidence": 0.42,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r050",
+ "ms": 4.677236999999991,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r051",
+ "ms": 2.576238999999987,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r052",
+ "ms": 5.318687000000068,
+ "agent": "tester",
+ "confidence": 0.41,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r053",
+ "ms": 1.6511990000000196,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r054",
+ "ms": 1.026489999999967,
+ "agent": "coder",
+ "confidence": 0.51,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r055",
+ "ms": 3.427787999999964,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r056",
+ "ms": 1.487209000000007,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r057",
+ "ms": 2.230809000000022,
+ "agent": "security-architect",
+ "confidence": 0.51,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r058",
+ "ms": 2.703987999999981,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r059",
+ "ms": 1.2336800000000494,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r060",
+ "ms": 1.350738999999976,
+ "agent": "swarm-specialist",
+ "confidence": 0.45,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r061",
+ "ms": 5.630217000000016,
+ "agent": "performance-engineer",
+ "confidence": 0.46,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r062",
+ "ms": 1.4966890000000603,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r063",
+ "ms": 1.9040989999999738,
+ "agent": "memory-specialist",
+ "confidence": 0.43,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r064",
+ "ms": 3.6902679999999464,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r065",
+ "ms": 1.6024590000000671,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r066",
+ "ms": 2.480269000000021,
+ "agent": "architect",
+ "confidence": 0.52,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r067",
+ "ms": 4.043287999999961,
+ "agent": "architect",
+ "confidence": 0.46,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r068",
+ "ms": 1.4939190000000053,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r069",
+ "ms": 4.030897999999979,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r070",
+ "ms": 1.9072989999999663,
+ "agent": "architect",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r071",
+ "ms": 3.5821580000000495,
+ "agent": "swarm-specialist",
+ "confidence": 0.4,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r072",
+ "ms": 2.214448999999945,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r073",
+ "ms": 3.398867999999993,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r074",
+ "ms": 1.5871590000000424,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r075",
+ "ms": 3.689128000000096,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r076",
+ "ms": 1.859719000000041,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r077",
+ "ms": 1.6036690000000817,
+ "agent": "tester",
+ "confidence": 0.46,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r078",
+ "ms": 6.041396999999961,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r079",
+ "ms": 1.4894089999999096,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r080",
+ "ms": 3.6476080000001048,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r081",
+ "ms": 1.1475399999999354,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r082",
+ "ms": 3.1399880000000167,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r083",
+ "ms": 1.620728999999983,
+ "agent": "coder",
+ "confidence": 0.48,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r084",
+ "ms": 1.6006190000000515,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r085",
+ "ms": 3.3158180000000357,
+ "agent": "security-architect",
+ "confidence": 0.52,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r086",
+ "ms": 1.9674199999999473,
+ "agent": "performance-engineer",
+ "confidence": 0.44,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r087",
+ "ms": 9.541094000000044,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r088",
+ "ms": 5.011127999999985,
+ "agent": "devops",
+ "confidence": 0.57,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r089",
+ "ms": 1.8519090000000915,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r090",
+ "ms": 6.196177000000034,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r091",
+ "ms": 1.4297389999999268,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r092",
+ "ms": 1.4187689999999975,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r093",
+ "ms": 7.127076000000102,
+ "agent": "swarm-specialist",
+ "confidence": 0.56,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r094",
+ "ms": 5.117947999999956,
+ "agent": "performance-engineer",
+ "confidence": 0.4,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r095",
+ "ms": 1.5308489999999892,
+ "agent": "coder",
+ "confidence": 0.47,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r096",
+ "ms": 2.827547999999979,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r097",
+ "ms": 1.056600000000003,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r098",
+ "ms": 1.1615289999999732,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r099",
+ "ms": 3.6230679999999893,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r100",
+ "ms": 1.5382090000000517,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r101",
+ "ms": 1.658728999999994,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r102",
+ "ms": 6.7821969999999965,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r103",
+ "ms": 1.5869590000000926,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r104",
+ "ms": 1.7713790000000245,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r105",
+ "ms": 1.0635389999999916,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r106",
+ "ms": 0.95799999999997,
+ "agent": "architect",
+ "confidence": 0.43,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r107",
+ "ms": 3.7623780000000124,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r108",
+ "ms": 1.600229000000013,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r109",
+ "ms": 1.7439090000000306,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r110",
+ "ms": 2.1254290000000537,
+ "agent": "tester",
+ "confidence": 0.44,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r111",
+ "ms": 2.186319000000026,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r112",
+ "ms": 1.8709390000000212,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r113",
+ "ms": 4.2056969999999865,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r114",
+ "ms": 1.6632590000000391,
+ "agent": "performance-engineer",
+ "confidence": 0.5,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r115",
+ "ms": 3.667728000000011,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r116",
+ "ms": 1.177379999999971,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r117",
+ "ms": 2.609937999999943,
+ "agent": "architect",
+ "confidence": 0.9,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r118",
+ "ms": 1.3824299999999994,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r119",
+ "ms": 4.540326999999934,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r120",
+ "ms": 1.944389000000001,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r121",
+ "ms": 7.078445999999985,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r122",
+ "ms": 1.7731790000000274,
+ "agent": "performance-engineer",
+ "confidence": 0.47,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r123",
+ "ms": 3.766978999999992,
+ "agent": "devops",
+ "confidence": 0.44,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r124",
+ "ms": 1.6001790000000256,
+ "agent": "tester",
+ "confidence": 0.41,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r125",
+ "ms": 2.3912579999999934,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r126",
+ "ms": 3.1697889999999234,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r127",
+ "ms": 1.589138999999932,
+ "agent": "swarm-specialist",
+ "confidence": 0.9,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r128",
+ "ms": 1.7827589999999418,
+ "agent": "performance-engineer",
+ "confidence": 0.63,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r129",
+ "ms": 1.6520590000000084,
+ "agent": "memory-specialist",
+ "confidence": 0.51,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r130",
+ "ms": 1.3151189999999815,
+ "agent": "performance-engineer",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r131",
+ "ms": 3.3325989999999592,
+ "agent": "devops",
+ "confidence": 0.51,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r132",
+ "ms": 1.5140390000000252,
+ "agent": "swarm-specialist",
+ "confidence": 0.48,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r133",
+ "ms": 3.795317999999952,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r134",
+ "ms": 3.3402580000000626,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r135",
+ "ms": 3.672237999999993,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r136",
+ "ms": 3.2291380000000345,
+ "agent": "security-architect",
+ "confidence": 0.4,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r137",
+ "ms": 1.624798999999939,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r138",
+ "ms": 1.4940000000000282,
+ "agent": "performance-engineer",
+ "confidence": 0.47,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r139",
+ "ms": 1.2288590000000568,
+ "agent": "security-architect",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r140",
+ "ms": 4.8323270000000775,
+ "agent": "security-architect",
+ "confidence": 0.6,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r141",
+ "ms": 1.5393100000000004,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r142",
+ "ms": 1.62050899999997,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r143",
+ "ms": 1.1410590000000411,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r144",
+ "ms": 4.576976999999943,
+ "agent": "tester",
+ "confidence": 0.48,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r145",
+ "ms": 1.4757600000000366,
+ "agent": "coder",
+ "confidence": 0.46,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r146",
+ "ms": 1.535618999999997,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r147",
+ "ms": 4.597438000000011,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r148",
+ "ms": 2.5604980000000523,
+ "agent": "architect",
+ "confidence": 0.5,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r149",
+ "ms": 1.4868289999999433,
+ "agent": "swarm-specialist",
+ "confidence": 0.43,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r150",
+ "ms": 5.636806999999976,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r151",
+ "ms": 1.6891389999999546,
+ "agent": "tester",
+ "confidence": 0.95,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r152",
+ "ms": 2.8316089999999576,
+ "agent": "architect",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r153",
+ "ms": 1.5770989999999756,
+ "agent": "swarm-specialist",
+ "confidence": 0.45,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r154",
+ "ms": 1.4812390000000732,
+ "agent": "swarm-specialist",
+ "confidence": 0.55,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r155",
+ "ms": 3.76093800000001,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r156",
+ "ms": 6.21257700000001,
+ "agent": "swarm-specialist",
+ "confidence": 0.44,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r157",
+ "ms": 2.4511489999999867,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r158",
+ "ms": 4.378917000000001,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r159",
+ "ms": 1.954289000000017,
+ "agent": "performance-engineer",
+ "confidence": 0.42,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r160",
+ "ms": 2.233389000000102,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r161",
+ "ms": 2.350099,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r162",
+ "ms": 4.255307000000016,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r163",
+ "ms": 1.0955000000000155,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r164",
+ "ms": 1.5175689999999804,
+ "agent": "coder",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r165",
+ "ms": 2.7229489999999714,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r166",
+ "ms": 1.5463790000000017,
+ "agent": "swarm-specialist",
+ "confidence": 0.47,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r167",
+ "ms": 1.7850089999999454,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r168",
+ "ms": 2.4916390000000774,
+ "agent": "coder",
+ "confidence": 0.47,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r169",
+ "ms": 1.2486889999998994,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r170",
+ "ms": 1.2581989999999905,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r171",
+ "ms": 3.3133779999999433,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r172",
+ "ms": 1.4827999999999975,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r173",
+ "ms": 1.4608989999999267,
+ "agent": "devops",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r174",
+ "ms": 5.346517000000063,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r175",
+ "ms": 2.1893190000000686,
+ "agent": "swarm-specialist",
+ "confidence": 0.57,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r176",
+ "ms": 3.204238000000032,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r177",
+ "ms": 2.0532790000000887,
+ "agent": "memory-specialist",
+ "confidence": 0.41,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r178",
+ "ms": 1.7608989999999949,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r179",
+ "ms": 1.9372490000000653,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r180",
+ "ms": 1.6875390000000152,
+ "agent": "devops",
+ "confidence": 0.54,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r181",
+ "ms": 2.085939000000053,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r182",
+ "ms": 1.4820290000000114,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r183",
+ "ms": 1.848969000000011,
+ "agent": "devops",
+ "confidence": 0.85,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r184",
+ "ms": 1.906739000000016,
+ "agent": "swarm-specialist",
+ "confidence": 0.57,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r185",
+ "ms": 1.8327189999999973,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r186",
+ "ms": 1.9924490000000787,
+ "agent": "tester",
+ "confidence": 0.42,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r187",
+ "ms": 1.8459589999999935,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r188",
+ "ms": 1.508179000000041,
+ "agent": "performance-engineer",
+ "confidence": 0.6,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r189",
+ "ms": 1.7045590000000175,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r190",
+ "ms": 1.981608999999935,
+ "agent": "performance-engineer",
+ "confidence": 0.6,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r191",
+ "ms": 1.9004300000000285,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r192",
+ "ms": 2.6538679999999886,
+ "agent": "coder",
+ "confidence": 0.41,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r193",
+ "ms": 1.4085789999999179,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r194",
+ "ms": 1.6688589999999976,
+ "agent": "tester",
+ "confidence": 0.46,
+ "embedder": "minilm",
+ "method": "semantic-native"
+ },
+ {
+ "id": "r195",
+ "ms": 3.3538489999999683,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r196",
+ "ms": 3.69676800000002,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ },
+ {
+ "id": "r197",
+ "ms": 1.67492900000002,
+ "agent": "coder",
+ "confidence": 0.7,
+ "embedder": "minilm",
+ "method": "keyword"
+ }
+ ]
+ },
+ "C": {
+ "dev": {
+ "n": 84,
+ "accuracy": 0.2976,
+ "macroF1": 0.2609,
+ "wrongHighConfRate": 0.2738,
+ "trapAccuracy": 0.303
+ },
+ "test": {
+ "n": 113,
+ "accuracy": 0.2655,
+ "macroF1": 0.1992,
+ "wrongHighConfRate": 0.2655,
+ "trapAccuracy": 0.2903
+ },
+ "latencyMs": {
+ "cold": 89.78,
+ "p50": 0.766,
+ "p95": 1.197
+ },
+ "predictions": [
+ {
+ "id": "r001",
+ "ms": 89.78416200000001,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r002",
+ "ms": 1.0515200000000107,
+ "agent": "coder",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r003",
+ "ms": 1.3397089999999992,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r004",
+ "ms": 1.9090690000000023,
+ "agent": "tester",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.16,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r005",
+ "ms": 0.8308000000000106,
+ "agent": "tester",
+ "confidence": 0.46,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r006",
+ "ms": 0.8440390000000093,
+ "agent": "memory-specialist",
+ "confidence": 0.1,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.10, lift 1.20, abstain 0.13, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r007",
+ "ms": 0.8537999999999926,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r008",
+ "ms": 0.8432190000000048,
+ "agent": "tester",
+ "confidence": 0.12,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "tester",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe choice \"tester\" (confidence 0.12, lift 1.29, abstain 0.10, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r009",
+ "ms": 1.1802689999999956,
+ "agent": "swarm-specialist",
+ "confidence": 0.4,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.16,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r010",
+ "ms": 0.737409999999997,
+ "agent": "tester",
+ "confidence": 0.56,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r011",
+ "ms": 0.8317100000000011,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r012",
+ "ms": 0.7392789999999962,
+ "agent": "tester",
+ "confidence": 0.46,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r013",
+ "ms": 0.3088900000000052,
+ "agent": "tester",
+ "confidence": 0.64,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r014",
+ "ms": 0.29375000000000284,
+ "agent": "swarm-specialist",
+ "confidence": 0.69,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.01 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r015",
+ "ms": 0.7850190000000055,
+ "agent": "performance-engineer",
+ "confidence": 0.4,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r016",
+ "ms": 0.6778599999999955,
+ "agent": "performance-engineer",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.03 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r017",
+ "ms": 0.6723199999999991,
+ "agent": "tester",
+ "confidence": 0.45,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r018",
+ "ms": 0.8345589999999987,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r019",
+ "ms": 0.6087300000000084,
+ "agent": "architect",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r020",
+ "ms": 0.7459190000000007,
+ "agent": "tester",
+ "confidence": 0.49,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r021",
+ "ms": 0.7987300000000062,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r022",
+ "ms": 0.7592399999999913,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r023",
+ "ms": 0.7007289999999955,
+ "agent": "swarm-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.26, abstain 0.12, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r024",
+ "ms": 0.18896000000000868,
+ "agent": "architect",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.00 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r025",
+ "ms": 0.41107999999999834,
+ "agent": "memory-specialist",
+ "confidence": 0.57,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r026",
+ "ms": 0.7024100000000146,
+ "agent": "coder",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r027",
+ "ms": 0.6583490000000154,
+ "agent": "performance-engineer",
+ "confidence": 0.46,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r028",
+ "ms": 0.8247100000000103,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r029",
+ "ms": 0.6644300000000101,
+ "agent": "architect",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "architect",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"architect\" (confidence 0.11, lift 1.24, abstain 0.11, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r030",
+ "ms": 0.6200389999999913,
+ "agent": "performance-engineer",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe choice \"performance-engineer\" (confidence 0.11, lift 1.22, abstain 0.12, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r031",
+ "ms": 0.8232899999999859,
+ "agent": "coder",
+ "confidence": 0.41,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r032",
+ "ms": 0.883388999999994,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r033",
+ "ms": 1.2668899999999894,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r034",
+ "ms": 0.3749990000000025,
+ "agent": "swarm-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.27, abstain 0.12, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r035",
+ "ms": 0.5838899999999967,
+ "agent": "coder",
+ "confidence": 0.49,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r036",
+ "ms": 0.758260000000007,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.19 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r037",
+ "ms": 1.1356289999999944,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r038",
+ "ms": 1.083708999999999,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r039",
+ "ms": 1.2929100000000062,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r040",
+ "ms": 1.1259689999999978,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r041",
+ "ms": 0.5261700000000076,
+ "agent": "architect",
+ "confidence": 0.55,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r042",
+ "ms": 1.1971790000000055,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r043",
+ "ms": 0.863759999999985,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r044",
+ "ms": 0.7298690000000079,
+ "agent": "architect",
+ "confidence": 0.9,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r045",
+ "ms": 1.08565999999999,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r046",
+ "ms": 0.7882490000000075,
+ "agent": "performance-engineer",
+ "confidence": 0.49,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r047",
+ "ms": 0.7227199999999812,
+ "agent": "architect",
+ "confidence": 0.9,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.20 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r048",
+ "ms": 0.5935900000000061,
+ "agent": "tester",
+ "confidence": 0.57,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r049",
+ "ms": 0.8077890000000139,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.19 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r050",
+ "ms": 0.7293000000000234,
+ "agent": "tester",
+ "confidence": 0.43,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r051",
+ "ms": 0.880010000000027,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r052",
+ "ms": 0.704858999999999,
+ "agent": "tester",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r053",
+ "ms": 0.8035499999999729,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r054",
+ "ms": 0.38181900000000724,
+ "agent": "tester",
+ "confidence": 0.67,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe top-1 margin 0.004 < min 0.005 (no clear winner); kept existing router"
+ },
+ {
+ "id": "r055",
+ "ms": 1.0082299999999975,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r056",
+ "ms": 0.8829989999999839,
+ "agent": "researcher",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"researcher\" (confidence 0.11, lift 1.23, abstain 0.11, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r057",
+ "ms": 0.49995000000001255,
+ "agent": "architect",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r058",
+ "ms": 1.0408800000000156,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r059",
+ "ms": 0.30237900000000195,
+ "agent": "reviewer",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.21, abstain 0.12, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r060",
+ "ms": 0.7820199999999886,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r061",
+ "ms": 0.9510189999999739,
+ "agent": "memory-specialist",
+ "confidence": 0.12,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.09,
+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.12, lift 1.28, abstain 0.09, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r062",
+ "ms": 0.5250900000000058,
+ "agent": "tester",
+ "confidence": 0.6,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.20 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r063",
+ "ms": 0.6221899999999891,
+ "agent": "coder",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.09,
+ "tsReason": "typesafe lift 1.19 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r064",
+ "ms": 0.4244600000000105,
+ "agent": "architect",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r065",
+ "ms": 0.7871389999999963,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r066",
+ "ms": 0.9542700000000082,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r067",
+ "ms": 0.7059790000000135,
+ "agent": "tester",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.16,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r068",
+ "ms": 0.7147800000000188,
+ "agent": "tester",
+ "confidence": 0.4,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r069",
+ "ms": 0.976239000000021,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r070",
+ "ms": 0.830539999999985,
+ "agent": "architect",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r071",
+ "ms": 0.9879189999999767,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r072",
+ "ms": 1.0242199999999855,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.09,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r073",
+ "ms": 0.4943800000000067,
+ "agent": "tester",
+ "confidence": 0.57,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.02 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r074",
+ "ms": 0.6057090000000187,
+ "agent": "reviewer",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.21, abstain 0.12, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r075",
+ "ms": 1.0891500000000178,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r076",
+ "ms": 0.8810890000000029,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r077",
+ "ms": 0.8713699999999847,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.19 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r078",
+ "ms": 0.599679999999978,
+ "agent": "tester",
+ "confidence": 0.54,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.01 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r079",
+ "ms": 0.7873089999999934,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r080",
+ "ms": 1.0774000000000115,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r081",
+ "ms": 0.28530900000001225,
+ "agent": "coder",
+ "confidence": 0.56,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r082",
+ "ms": 0.6287700000000029,
+ "agent": "tester",
+ "confidence": 0.43,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r083",
+ "ms": 0.4077699999999993,
+ "agent": "tester",
+ "confidence": 0.75,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r084",
+ "ms": 0.8777489999999943,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r085",
+ "ms": 0.6126799999999832,
+ "agent": "tester",
+ "confidence": 0.54,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r086",
+ "ms": 0.8951589999999783,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r087",
+ "ms": 1.0204999999999984,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe top-1 margin 0.003 < min 0.005 (no clear winner); kept existing router"
+ },
+ {
+ "id": "r088",
+ "ms": 0.43677999999999884,
+ "agent": "tester",
+ "confidence": 0.68,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r089",
+ "ms": 0.9272890000000018,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r090",
+ "ms": 0.14791999999999916,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.00 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r091",
+ "ms": 0.4730599999999754,
+ "agent": "tester",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r092",
+ "ms": 0.7090490000000216,
+ "agent": "tester",
+ "confidence": 0.62,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe top-1 margin 0.004 < min 0.005 (no clear winner); kept existing router"
+ },
+ {
+ "id": "r093",
+ "ms": 1.0338600000000042,
+ "agent": "swarm-specialist",
+ "confidence": 0.9,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r094",
+ "ms": 0.9493490000000122,
+ "agent": "performance-engineer",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r095",
+ "ms": 0.5759400000000028,
+ "agent": "memory-specialist",
+ "confidence": 0.43,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.20 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r096",
+ "ms": 0.6752400000000023,
+ "agent": "tester",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r097",
+ "ms": 0.256149999999991,
+ "agent": "memory-specialist",
+ "confidence": 0.65,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r098",
+ "ms": 0.4616589999999974,
+ "agent": "architect",
+ "confidence": 0.62,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.02 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r099",
+ "ms": 0.6078800000000228,
+ "agent": "tester",
+ "confidence": 0.49,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r100",
+ "ms": 0.7351400000000012,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r101",
+ "ms": 0.8538990000000126,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r102",
+ "ms": 0.9906000000000006,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r103",
+ "ms": 0.6858789999999999,
+ "agent": "reviewer",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.09,
+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.23, abstain 0.09, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r104",
+ "ms": 0.40576999999998975,
+ "agent": "tester",
+ "confidence": 0.61,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r105",
+ "ms": 0.3535399999999811,
+ "agent": "security-architect",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe choice \"security-architect\" (confidence 0.11, lift 1.27, abstain 0.14, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r106",
+ "ms": 0.18804000000000087,
+ "agent": "devops",
+ "confidence": 0.51,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.00 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r107",
+ "ms": 1.145889000000011,
+ "agent": "memory-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.27, abstain 0.11, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r108",
+ "ms": 0.6301400000000115,
+ "agent": "performance-engineer",
+ "confidence": 0.42,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r109",
+ "ms": 0.9892689999999789,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r110",
+ "ms": 0.5044100000000071,
+ "agent": "tester",
+ "confidence": 0.67,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r111",
+ "ms": 0.7672400000000152,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r112",
+ "ms": 0.9476789999999937,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r113",
+ "ms": 1.2030190000000118,
+ "agent": "memory-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.25, abstain 0.10, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r114",
+ "ms": 1.039779999999979,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r115",
+ "ms": 0.8168589999999938,
+ "agent": "architect",
+ "confidence": 0.1,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "architect",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe choice \"architect\" (confidence 0.10, lift 1.22, abstain 0.14, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r116",
+ "ms": 0.2743600000000015,
+ "agent": "security-architect",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.00 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r117",
+ "ms": 0.9303199999999947,
+ "agent": "architect",
+ "confidence": 0.9,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.16,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r118",
+ "ms": 0.5653390000000229,
+ "agent": "architect",
+ "confidence": 0.46,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.16,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r119",
+ "ms": 0.9479200000000105,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r120",
+ "ms": 1.2012389999999868,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r121",
+ "ms": 1.0345800000000054,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r122",
+ "ms": 0.7114290000000096,
+ "agent": "tester",
+ "confidence": 0.47,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r123",
+ "ms": 0.8806499999999744,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r124",
+ "ms": 0.5119100000000003,
+ "agent": "tester",
+ "confidence": 0.13,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "tester",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"tester\" (confidence 0.13, lift 1.41, abstain 0.11, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r125",
+ "ms": 0.9953689999999824,
+ "agent": "devops",
+ "confidence": 0.54,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r126",
+ "ms": 1.2339100000000087,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r127",
+ "ms": 0.5513589999999908,
+ "agent": "swarm-specialist",
+ "confidence": 0.1,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.10, lift 1.21, abstain 0.14, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r128",
+ "ms": 0.7529499999999985,
+ "agent": "devops",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.09,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r129",
+ "ms": 0.8839590000000044,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r130",
+ "ms": 0.3159199999999771,
+ "agent": "performance-engineer",
+ "confidence": 0.79,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r131",
+ "ms": 1.1393700000000138,
+ "agent": "swarm-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.30, abstain 0.13, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r132",
+ "ms": 0.7625990000000229,
+ "agent": "tester",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r133",
+ "ms": 0.5882000000000005,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r134",
+ "ms": 0.9354590000000087,
+ "agent": "tester",
+ "confidence": 0.13,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "tester",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe choice \"tester\" (confidence 0.13, lift 1.40, abstain 0.10, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r135",
+ "ms": 0.7351899999999887,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r136",
+ "ms": 0.7658399999999972,
+ "agent": "tester",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "tester",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe choice \"tester\" (confidence 0.11, lift 1.21, abstain 0.10, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r137",
+ "ms": 0.9619690000000105,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r138",
+ "ms": 0.7622900000000072,
+ "agent": "swarm-specialist",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r139",
+ "ms": 0.5408390000000054,
+ "agent": "tester",
+ "confidence": 0.65,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r140",
+ "ms": 0.9322300000000041,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.20 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r141",
+ "ms": 0.6131190000000117,
+ "agent": "tester",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r142",
+ "ms": 1.0785199999999975,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r143",
+ "ms": 0.3811600000000226,
+ "agent": "architect",
+ "confidence": 0.64,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r144",
+ "ms": 0.6811689999999828,
+ "agent": "tester",
+ "confidence": 0.55,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r145",
+ "ms": 0.6266799999999932,
+ "agent": "architect",
+ "confidence": 0.43,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r146",
+ "ms": 0.9323599999999885,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.09,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r147",
+ "ms": 0.9164089999999874,
+ "agent": "memory-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.23, abstain 0.11, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r148",
+ "ms": 0.18795000000000073,
+ "agent": "devops",
+ "confidence": 0.6,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.02 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r149",
+ "ms": 0.7511900000000082,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r150",
+ "ms": 1.121249000000006,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r151",
+ "ms": 0.837459999999993,
+ "agent": "tester",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "tester",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"tester\" (confidence 0.11, lift 1.21, abstain 0.11, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r152",
+ "ms": 0.6902190000000132,
+ "agent": "tester",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r153",
+ "ms": 0.925200000000018,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.20 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r154",
+ "ms": 0.7308189999999968,
+ "agent": "architect",
+ "confidence": 0.41,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r155",
+ "ms": 0.9761399999999867,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r156",
+ "ms": 1.2050089999999898,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r157",
+ "ms": 1.4718990000000076,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r158",
+ "ms": 0.9263899999999978,
+ "agent": "researcher",
+ "confidence": 0.12,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.09,
+ "tsReason": "typesafe choice \"researcher\" (confidence 0.12, lift 1.27, abstain 0.09, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r159",
+ "ms": 0.9709489999999903,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.09,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r160",
+ "ms": 0.7213600000000042,
+ "agent": "swarm-specialist",
+ "confidence": 0.45,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r161",
+ "ms": 0.9614389999999844,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe top-1 margin 0.001 < min 0.005 (no clear winner); kept existing router"
+ },
+ {
+ "id": "r162",
+ "ms": 0.6744199999999978,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r163",
+ "ms": 0.31828000000001566,
+ "agent": "memory-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.21, abstain 0.11, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r164",
+ "ms": 0.6816889999999773,
+ "agent": "performance-engineer",
+ "confidence": 0.47,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r165",
+ "ms": 0.5611900000000105,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r166",
+ "ms": 0.7891100000000222,
+ "agent": "swarm-specialist",
+ "confidence": 0.9,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r167",
+ "ms": 0.6759789999999839,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r168",
+ "ms": 0.597910000000013,
+ "agent": "tester",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r169",
+ "ms": 0.47473999999999705,
+ "agent": "tester",
+ "confidence": 0.62,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.01 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r170",
+ "ms": 0.6033199999999965,
+ "agent": "tester",
+ "confidence": 0.61,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.04 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r171",
+ "ms": 0.589289000000008,
+ "agent": "architect",
+ "confidence": 0.65,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r172",
+ "ms": 0.8337800000000186,
+ "agent": "tester",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.16,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r173",
+ "ms": 1.1043689999999913,
+ "agent": "devops",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r174",
+ "ms": 0.7817699999999945,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r175",
+ "ms": 1.0981690000000128,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r176",
+ "ms": 0.537700000000001,
+ "agent": "memory-specialist",
+ "confidence": 0.54,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r177",
+ "ms": 0.6071799999999996,
+ "agent": "devops",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.15,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r178",
+ "ms": 0.6615889999999922,
+ "agent": "memory-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.26, abstain 0.11, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r179",
+ "ms": 1.138229999999993,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r180",
+ "ms": 0.5328490000000272,
+ "agent": "memory-specialist",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r181",
+ "ms": 0.9709099999999751,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r182",
+ "ms": 0.48512999999999806,
+ "agent": "tester",
+ "confidence": 0.65,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.00 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r183",
+ "ms": 0.9013989999999978,
+ "agent": "devops",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r184",
+ "ms": 0.7587099999999793,
+ "agent": "memory-specialist",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r185",
+ "ms": 0.8375790000000052,
+ "agent": "security-architect",
+ "confidence": 0.4,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r186",
+ "ms": 1.0024800000000198,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r187",
+ "ms": 0.8109990000000096,
+ "agent": "reviewer",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.21, abstain 0.11, UNCALIBRATED hash embedder)"
+ },
+ {
+ "id": "r188",
+ "ms": 0.4828799999999944,
+ "agent": "memory-specialist",
+ "confidence": 0.55,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r189",
+ "ms": 0.5638800000000117,
+ "agent": "performance-engineer",
+ "confidence": 0.41,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r190",
+ "ms": 0.7799689999999941,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r191",
+ "ms": 0.5746899999999755,
+ "agent": "tester",
+ "confidence": 0.45,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r192",
+ "ms": 0.6727189999999723,
+ "agent": "architect",
+ "confidence": 0.42,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r193",
+ "ms": 0.14687000000003536,
+ "agent": "devops",
+ "confidence": 0.56,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.17,
+ "tsReason": "typesafe lift 1.00 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r194",
+ "ms": 0.5548200000000065,
+ "agent": "tester",
+ "confidence": 0.59,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r195",
+ "ms": 0.9417599999999879,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.1,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r196",
+ "ms": 0.9004889999999932,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r197",
+ "ms": 1.0082899999999881,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ }
+ ],
+ "rawTypesafeTest": {
+ "n": 113,
+ "accuracy": 0.3009,
+ "macroF1": 0.261,
+ "wrongHighConfRate": 0,
+ "trapAccuracy": 0.3548
+ },
+ "typesafeUsedRate": 0.132
+ },
+ "D": {
+ "dev": {
+ "n": 84,
+ "accuracy": 0.2619,
+ "macroF1": 0.201,
+ "wrongHighConfRate": 0.3214,
+ "trapAccuracy": 0.303
+ },
+ "test": {
+ "n": 113,
+ "accuracy": 0.292,
+ "macroF1": 0.2269,
+ "wrongHighConfRate": 0.2655,
+ "trapAccuracy": 0.3226
+ },
+ "latencyMs": {
+ "cold": 680.49,
+ "p50": 6.065,
+ "p95": 8.348
+ },
+ "predictions": [
+ {
+ "id": "r001",
+ "ms": 680.489166,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r002",
+ "ms": 6.946136000000024,
+ "agent": "coder",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r003",
+ "ms": 7.140436000000022,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r004",
+ "ms": 6.21740699999998,
+ "agent": "tester",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r005",
+ "ms": 6.7190669999999955,
+ "agent": "tester",
+ "confidence": 0.46,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r006",
+ "ms": 6.2287859999999,
+ "agent": "tester",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r007",
+ "ms": 7.089035999999965,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r008",
+ "ms": 6.475187000000005,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r009",
+ "ms": 6.52781600000003,
+ "agent": "swarm-specialist",
+ "confidence": 0.4,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r010",
+ "ms": 5.121347999999898,
+ "agent": "tester",
+ "confidence": 0.56,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r011",
+ "ms": 6.134055999999987,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r012",
+ "ms": 5.956986999999913,
+ "agent": "tester",
+ "confidence": 0.46,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r013",
+ "ms": 3.498277999999914,
+ "agent": "tester",
+ "confidence": 0.64,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r014",
+ "ms": 3.1682690000000093,
+ "agent": "swarm-specialist",
+ "confidence": 0.69,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.03 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r015",
+ "ms": 7.187885999999935,
+ "agent": "performance-engineer",
+ "confidence": 0.4,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r016",
+ "ms": 5.657317000000035,
+ "agent": "performance-engineer",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.04 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r017",
+ "ms": 5.902686000000017,
+ "agent": "tester",
+ "confidence": 0.45,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r018",
+ "ms": 6.00802699999997,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r019",
+ "ms": 4.699857999999949,
+ "agent": "architect",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r020",
+ "ms": 4.6604169999999385,
+ "agent": "tester",
+ "confidence": 0.49,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r021",
+ "ms": 5.967307000000005,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r022",
+ "ms": 5.916116999999986,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r023",
+ "ms": 5.097266999999988,
+ "agent": "swarm-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.27, abstain 0.11, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r024",
+ "ms": 2.91074900000001,
+ "agent": "architect",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.04 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r025",
+ "ms": 4.3762069999999085,
+ "agent": "memory-specialist",
+ "confidence": 0.57,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.03 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r026",
+ "ms": 4.957988,
+ "agent": "coder",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r027",
+ "ms": 5.694837000000007,
+ "agent": "performance-engineer",
+ "confidence": 0.46,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r028",
+ "ms": 6.261406000000079,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r029",
+ "ms": 5.26420799999994,
+ "agent": "tester",
+ "confidence": 0.43,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r030",
+ "ms": 4.848856999999953,
+ "agent": "swarm-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.21, abstain 0.11, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r031",
+ "ms": 5.924626999999987,
+ "agent": "coder",
+ "confidence": 0.41,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r032",
+ "ms": 7.963415999999938,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r033",
+ "ms": 9.136655000000019,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r034",
+ "ms": 4.268607000000088,
+ "agent": "architect",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r035",
+ "ms": 5.081647999999973,
+ "agent": "coder",
+ "confidence": 0.49,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r036",
+ "ms": 5.530596999999943,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r037",
+ "ms": 7.447426000000064,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r038",
+ "ms": 7.825866000000019,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r039",
+ "ms": 7.7432549999999765,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r040",
+ "ms": 7.328505999999948,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r041",
+ "ms": 5.469566999999984,
+ "agent": "architect",
+ "confidence": 0.55,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r042",
+ "ms": 8.28758599999992,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r043",
+ "ms": 7.244645999999989,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r044",
+ "ms": 5.9551870000000235,
+ "agent": "architect",
+ "confidence": 0.9,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r045",
+ "ms": 7.259896000000026,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r046",
+ "ms": 5.957816999999977,
+ "agent": "performance-engineer",
+ "confidence": 0.49,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r047",
+ "ms": 5.919226999999978,
+ "agent": "architect",
+ "confidence": 0.9,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r048",
+ "ms": 5.682547,
+ "agent": "tester",
+ "confidence": 0.57,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r049",
+ "ms": 6.210485999999946,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r050",
+ "ms": 5.677227000000016,
+ "agent": "tester",
+ "confidence": 0.43,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r051",
+ "ms": 6.083387000000016,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r052",
+ "ms": 4.955638000000022,
+ "agent": "tester",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r053",
+ "ms": 6.133625999999936,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r054",
+ "ms": 3.587218000000007,
+ "agent": "tester",
+ "confidence": 0.67,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r055",
+ "ms": 6.393257000000062,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r056",
+ "ms": 6.1659969999999475,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r057",
+ "ms": 5.630175999999892,
+ "agent": "architect",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r058",
+ "ms": 7.0834370000000035,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r059",
+ "ms": 3.9812480000000505,
+ "agent": "swarm-specialist",
+ "confidence": 0.47,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r060",
+ "ms": 5.821956,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r061",
+ "ms": 7.385346000000027,
+ "agent": "performance-engineer",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe choice \"performance-engineer\" (confidence 0.11, lift 1.21, abstain 0.13, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r062",
+ "ms": 5.49386800000002,
+ "agent": "tester",
+ "confidence": 0.6,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r063",
+ "ms": 6.600755999999819,
+ "agent": "coder",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r064",
+ "ms": 4.2856279999998605,
+ "agent": "architect",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.04 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r065",
+ "ms": 6.302116999999953,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r066",
+ "ms": 7.1125959999999395,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r067",
+ "ms": 6.025355999999874,
+ "agent": "tester",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "architect",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r068",
+ "ms": 5.989237000000003,
+ "agent": "tester",
+ "confidence": 0.4,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r069",
+ "ms": 7.343625999999858,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r070",
+ "ms": 7.0737360000000535,
+ "agent": "architect",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r071",
+ "ms": 7.304817000000185,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r072",
+ "ms": 8.46296499999994,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r073",
+ "ms": 4.576477000000068,
+ "agent": "tester",
+ "confidence": 0.57,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r074",
+ "ms": 5.888447000000042,
+ "agent": "reviewer",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe choice \"reviewer\" (confidence 0.11, lift 1.24, abstain 0.14, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r075",
+ "ms": 9.41539499999999,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r076",
+ "ms": 7.252967000000126,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r077",
+ "ms": 6.406545999999935,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r078",
+ "ms": 5.118386999999984,
+ "agent": "tester",
+ "confidence": 0.54,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r079",
+ "ms": 6.082007000000203,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r080",
+ "ms": 7.613286000000016,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r081",
+ "ms": 3.448378000000048,
+ "agent": "coder",
+ "confidence": 0.56,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r082",
+ "ms": 6.549297000000024,
+ "agent": "tester",
+ "confidence": 0.43,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r083",
+ "ms": 4.335017000000107,
+ "agent": "tester",
+ "confidence": 0.75,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r084",
+ "ms": 6.480127000000039,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r085",
+ "ms": 5.122626999999966,
+ "agent": "tester",
+ "confidence": 0.54,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r086",
+ "ms": 6.8501269999999295,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r087",
+ "ms": 8.347665000000006,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r088",
+ "ms": 4.112217999999984,
+ "agent": "tester",
+ "confidence": 0.68,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r089",
+ "ms": 6.311796999999842,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r090",
+ "ms": 2.778088000000025,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.03 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r091",
+ "ms": 5.390506999999843,
+ "agent": "tester",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r092",
+ "ms": 5.788297000000057,
+ "agent": "tester",
+ "confidence": 0.62,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r093",
+ "ms": 7.283595999999989,
+ "agent": "swarm-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.23, abstain 0.12, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r094",
+ "ms": 7.009215999999924,
+ "agent": "performance-engineer",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r095",
+ "ms": 5.647676999999931,
+ "agent": "memory-specialist",
+ "confidence": 0.43,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r096",
+ "ms": 5.9246669999999995,
+ "agent": "tester",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r097",
+ "ms": 3.026438999999982,
+ "agent": "memory-specialist",
+ "confidence": 0.65,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r098",
+ "ms": 4.429276999999956,
+ "agent": "architect",
+ "confidence": 0.62,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r099",
+ "ms": 5.645426999999927,
+ "agent": "tester",
+ "confidence": 0.49,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r100",
+ "ms": 5.836987000000136,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r101",
+ "ms": 6.541795999999977,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r102",
+ "ms": 7.222107000000051,
+ "agent": "security-architect",
+ "confidence": 0.92,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r103",
+ "ms": 5.862517000000025,
+ "agent": "tester",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r104",
+ "ms": 4.199446999999964,
+ "agent": "tester",
+ "confidence": 0.61,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r105",
+ "ms": 3.4350379999998495,
+ "agent": "architect",
+ "confidence": 0.75,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r106",
+ "ms": 2.7094889999998486,
+ "agent": "devops",
+ "confidence": 0.51,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r107",
+ "ms": 8.454934999999978,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.19 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r108",
+ "ms": 4.913187999999991,
+ "agent": "performance-engineer",
+ "confidence": 0.42,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r109",
+ "ms": 6.556205999999975,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r110",
+ "ms": 4.737817999999834,
+ "agent": "tester",
+ "confidence": 0.67,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r111",
+ "ms": 6.772435999999971,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r112",
+ "ms": 7.206455999999889,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r113",
+ "ms": 9.83678500000019,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r114",
+ "ms": 6.603885999999875,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.04 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r115",
+ "ms": 6.386226999999963,
+ "agent": "performance-engineer",
+ "confidence": 0.41,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r116",
+ "ms": 2.899548999999979,
+ "agent": "security-architect",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.03 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r117",
+ "ms": 7.245886000000155,
+ "agent": "architect",
+ "confidence": 0.9,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r118",
+ "ms": 5.5369969999999284,
+ "agent": "architect",
+ "confidence": 0.46,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r119",
+ "ms": 7.3438260000000355,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r120",
+ "ms": 8.364295000000084,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r121",
+ "ms": 6.585527000000184,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r122",
+ "ms": 6.06540700000005,
+ "agent": "tester",
+ "confidence": 0.47,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r123",
+ "ms": 7.354736000000003,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r124",
+ "ms": 6.149785999999949,
+ "agent": "tester",
+ "confidence": 0.53,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r125",
+ "ms": 5.242158000000018,
+ "agent": "devops",
+ "confidence": 0.54,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r126",
+ "ms": 8.344994999999926,
+ "agent": "performance-engineer",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe choice \"performance-engineer\" (confidence 0.11, lift 1.22, abstain 0.13, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r127",
+ "ms": 6.014847000000145,
+ "agent": "architect",
+ "confidence": 0.45,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r128",
+ "ms": 5.68466699999999,
+ "agent": "devops",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.19 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r129",
+ "ms": 6.8815759999999955,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r130",
+ "ms": 3.466568000000052,
+ "agent": "performance-engineer",
+ "confidence": 0.1,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe choice \"performance-engineer\" (confidence 0.10, lift 1.21, abstain 0.13, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r131",
+ "ms": 7.774255999999923,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r132",
+ "ms": 6.018326999999999,
+ "agent": "swarm-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.24, abstain 0.12, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r133",
+ "ms": 6.236196999999947,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r134",
+ "ms": 6.421205999999984,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r135",
+ "ms": 5.934407000000192,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r136",
+ "ms": 6.184917000000041,
+ "agent": "devops",
+ "confidence": 0.42,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r137",
+ "ms": 6.462146000000075,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r138",
+ "ms": 5.651927000000114,
+ "agent": "swarm-specialist",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.19 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r139",
+ "ms": 4.940247999999883,
+ "agent": "tester",
+ "confidence": 0.65,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r140",
+ "ms": 7.294225999999981,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r141",
+ "ms": 5.843875999999909,
+ "agent": "tester",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r142",
+ "ms": 6.983197000000018,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r143",
+ "ms": 4.129478000000063,
+ "agent": "architect",
+ "confidence": 0.64,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r144",
+ "ms": 5.622386000000006,
+ "agent": "tester",
+ "confidence": 0.55,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r145",
+ "ms": 4.950728000000026,
+ "agent": "architect",
+ "confidence": 0.43,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r146",
+ "ms": 6.295747000000119,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r147",
+ "ms": 6.224605999999994,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r148",
+ "ms": 2.6061090000000604,
+ "agent": "devops",
+ "confidence": 0.6,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r149",
+ "ms": 5.934477000000015,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r150",
+ "ms": 7.685555999999906,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r151",
+ "ms": 6.848195999999916,
+ "agent": "tester",
+ "confidence": 0.4,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r152",
+ "ms": 5.977187000000185,
+ "agent": "tester",
+ "confidence": 0.48,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r153",
+ "ms": 6.50947599999995,
+ "agent": "swarm-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.20, abstain 0.11, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r154",
+ "ms": 5.789916999999832,
+ "agent": "architect",
+ "confidence": 0.41,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.17 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r155",
+ "ms": 6.55345699999998,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r156",
+ "ms": 8.374455000000125,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r157",
+ "ms": 9.950925000000097,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r158",
+ "ms": 7.04041600000005,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r159",
+ "ms": 8.033665999999812,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r160",
+ "ms": 5.2252770000000055,
+ "agent": "swarm-specialist",
+ "confidence": 0.45,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r161",
+ "ms": 6.1733070000000225,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r162",
+ "ms": 6.148975999999948,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r163",
+ "ms": 3.3668190000000777,
+ "agent": "tester",
+ "confidence": 0.77,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r164",
+ "ms": 6.06908599999997,
+ "agent": "performance-engineer",
+ "confidence": 0.47,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.08 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r165",
+ "ms": 5.017358000000058,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r166",
+ "ms": 5.860226999999895,
+ "agent": "swarm-specialist",
+ "confidence": 0.9,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r167",
+ "ms": 5.78173599999991,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.07 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r168",
+ "ms": 4.936807999999928,
+ "agent": "tester",
+ "confidence": 0.52,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r169",
+ "ms": 4.650176999999985,
+ "agent": "tester",
+ "confidence": 0.62,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.11,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r170",
+ "ms": 5.164177999999993,
+ "agent": "tester",
+ "confidence": 0.61,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r171",
+ "ms": 4.569786999999906,
+ "agent": "architect",
+ "confidence": 0.65,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r172",
+ "ms": 6.253367000000026,
+ "agent": "tester",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r173",
+ "ms": 7.1146259999998165,
+ "agent": "devops",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.13 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r174",
+ "ms": 6.306606999999985,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r175",
+ "ms": 8.70054499999992,
+ "agent": "coder",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r176",
+ "ms": 5.005916999999954,
+ "agent": "memory-specialist",
+ "confidence": 0.54,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r177",
+ "ms": 5.658337000000074,
+ "agent": "devops",
+ "confidence": 0.44,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r178",
+ "ms": 5.706226999999899,
+ "agent": "memory-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe choice \"memory-specialist\" (confidence 0.11, lift 1.21, abstain 0.12, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r179",
+ "ms": 7.0876160000000255,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.16 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r180",
+ "ms": 5.418577000000141,
+ "agent": "memory-specialist",
+ "confidence": 0.5,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r181",
+ "ms": 7.45031599999993,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "security-architect",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r182",
+ "ms": 4.161928000000216,
+ "agent": "tester",
+ "confidence": 0.65,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "performance-engineer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.05 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r183",
+ "ms": 6.0329770000000735,
+ "agent": "devops",
+ "confidence": 0.85,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r184",
+ "ms": 6.228517000000011,
+ "agent": "swarm-specialist",
+ "confidence": 0.11,
+ "routedBy": "typesafe",
+ "tsUsed": true,
+ "tsRaw": "swarm-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe choice \"swarm-specialist\" (confidence 0.11, lift 1.24, abstain 0.12, UNCALIBRATED onnx embedder)"
+ },
+ {
+ "id": "r185",
+ "ms": 6.4125360000000455,
+ "agent": "security-architect",
+ "confidence": 0.4,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "devops",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r186",
+ "ms": 7.1195759999998245,
+ "agent": "tester",
+ "confidence": 0.95,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r187",
+ "ms": 5.655626999999868,
+ "agent": "architect",
+ "confidence": 0.41,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.12 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r188",
+ "ms": 4.3254779999999755,
+ "agent": "memory-specialist",
+ "confidence": 0.55,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.14 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r189",
+ "ms": 5.599047000000155,
+ "agent": "performance-engineer",
+ "confidence": 0.41,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.14,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r190",
+ "ms": 6.21515700000009,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.19 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r191",
+ "ms": 6.528366000000005,
+ "agent": "tester",
+ "confidence": 0.45,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.11 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r192",
+ "ms": 5.6939870000001065,
+ "agent": "architect",
+ "confidence": 0.42,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "coder",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.15 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r193",
+ "ms": 2.7621990000000096,
+ "agent": "devops",
+ "confidence": 0.56,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "researcher",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.03 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r194",
+ "ms": 4.839997000000039,
+ "agent": "tester",
+ "confidence": 0.59,
+ "routedBy": "semantic-native",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.10 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r195",
+ "ms": 7.125735999999961,
+ "agent": "memory-specialist",
+ "confidence": 0.88,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "memory-specialist",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.18 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r196",
+ "ms": 6.921207000000095,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "tester",
+ "tsAbstain": 0.13,
+ "tsReason": "typesafe lift 1.09 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ },
+ {
+ "id": "r197",
+ "ms": 6.566915999999992,
+ "agent": "coder",
+ "confidence": 0.7,
+ "routedBy": "keyword",
+ "tsUsed": false,
+ "tsRaw": "reviewer",
+ "tsAbstain": 0.12,
+ "tsReason": "typesafe lift 1.06 (top-1 Γ— 10 options) < min 1.20; kept existing router"
+ }
+ ],
+ "rawTypesafeTest": {
+ "n": 113,
+ "accuracy": 0.4425,
+ "macroF1": 0.4105,
+ "wrongHighConfRate": 0,
+ "trapAccuracy": 0.3226
+ },
+ "typesafeUsedRate": 0.0558
+ }
+ }
+}
diff --git a/v3/@claude-flow/cli/benchmarks/router/run-bench.mjs b/v3/@claude-flow/cli/benchmarks/router/run-bench.mjs
new file mode 100644
index 0000000000..b87a552108
--- /dev/null
+++ b/v3/@claude-flow/cli/benchmarks/router/run-bench.mjs
@@ -0,0 +1,168 @@
+#!/usr/bin/env node
+/**
+ * ADR-391 router benchmark.
+ *
+ * node benchmarks/router/run-bench.mjs # all candidates, writes results/
+ * node benchmarks/router/run-bench.mjs --candidate A # one candidate (child mode)
+ *
+ * Candidates (ADR-391 Β§Context):
+ * A current routeTaskForBench, hash embedder (default router)
+ * B minilm routeTaskForBench, MiniLM embedder (ADR-390)
+ * C ts-hash hooks_route + CLAUDE_FLOW_ROUTER_TYPESAFE=1, hash embedder
+ * D ts-onnx hooks_route + typesafe, ONNX (bge-small) β€” needs
+ * ROUTER_BENCH_TYPESAFE_MODEL_DIR pointing at a fetched models/ dir
+ *
+ * Each candidate runs in its own process from an empty temp cwd so no engine,
+ * index or stored memory leaks between candidates. Requires a built dist/.
+ * The corpus is read-only and frozen (see README.md for its sha256).
+ */
+import { spawnSync } from 'node:child_process';
+import { createHash } from 'node:crypto';
+import { mkdtempSync, readFileSync, writeFileSync, mkdirSync } from 'node:fs';
+import { tmpdir } from 'node:os';
+import { dirname, join } from 'node:path';
+import { fileURLToPath, pathToFileURL } from 'node:url';
+
+const HERE = dirname(fileURLToPath(import.meta.url));
+const CLI_ROOT = join(HERE, '..', '..');
+const CORPUS = join(HERE, 'corpus.jsonl');
+const HOOKS = pathToFileURL(join(CLI_ROOT, 'dist', 'src', 'mcp-tools', 'hooks-tools.js')).href;
+const CANDIDATES = ['A', 'B', 'C', 'D'];
+const HIGH_CONF = 0.7;
+
+const argv = process.argv.slice(2);
+const arg = (k) => { const i = argv.indexOf(k); return i >= 0 ? argv[i + 1] : undefined; };
+
+function loadCorpus() {
+ const raw = readFileSync(CORPUS);
+ const rows = raw.toString('utf8').split('\n').filter(Boolean).map((l) => JSON.parse(l));
+ return { rows, sha256: createHash('sha256').update(raw).digest('hex') };
+}
+
+const pct = (xs, p) => { const s = [...xs].sort((a, b) => a - b); return s.length ? s[Math.min(s.length - 1, Math.floor(p * s.length))] : 0; };
+
+async function runChild(cand) {
+ const { rows } = loadCorpus();
+ const hooks = await import(HOOKS);
+ const out = [];
+ let cold = null;
+ const route = async (prompt) => {
+ if (cand === 'A' || cand === 'B') {
+ const r = await hooks.routeTaskForBench(prompt, { embedder: cand === 'A' ? 'hash' : 'minilm' });
+ return { agent: r.primaryAgent, confidence: r.confidence, embedder: r.embedder, method: r.method };
+ }
+ const r = await hooks.hooksRoute.handler({ task: prompt });
+ const ts = r.typesafe ?? {};
+ return {
+ agent: r.primaryAgent?.type,
+ confidence: r.primaryAgent?.confidence,
+ routedBy: r.routedBy,
+ tsUsed: !!ts.used,
+ tsRaw: ts.choice ?? ts.answer?.choice ?? null,
+ tsAbstain: ts.abstain ?? ts.answer?.abstain ?? null,
+ tsReason: ts.reason,
+ };
+ };
+ for (const row of rows) {
+ const t0 = performance.now();
+ const r = await route(row.prompt);
+ const ms = performance.now() - t0;
+ if (cold === null) cold = ms;
+ out.push({ id: row.id, ms, ...r });
+ }
+ // The router keeps native handles (VectorDb, model sessions) alive; exit
+ // explicitly once the result is flushed or spawnSync in the parent never returns.
+ process.stdout.write('\n@@RESULT@@' + JSON.stringify({ cand, cold, out }) + '\n', () => process.exit(0));
+}
+
+function score(rows, preds, split) {
+ const byId = new Map(preds.map((p) => [p.id, p]));
+ const set = rows.filter((r) => split === 'all' || r.split === split);
+ const labels = [...new Set(rows.map((r) => r.label))];
+ let correct = 0, wrongHigh = 0, trapN = 0, trapOk = 0;
+ const tp = {}, fp = {}, fn = {};
+ for (const r of set) {
+ const p = byId.get(r.id);
+ const pred = p?.agent ?? 'none';
+ const ok = pred === r.label;
+ if (ok) correct++;
+ else if ((p?.confidence ?? 0) >= HIGH_CONF) wrongHigh++;
+ if (r.trap) { trapN++; if (ok) trapOk++; }
+ if (ok) tp[r.label] = (tp[r.label] ?? 0) + 1;
+ else { fn[r.label] = (fn[r.label] ?? 0) + 1; fp[pred] = (fp[pred] ?? 0) + 1; }
+ }
+ const f1s = labels.map((l) => {
+ const t = tp[l] ?? 0, P = t + (fp[l] ?? 0), R = t + (fn[l] ?? 0);
+ const prec = P ? t / P : 0, rec = R ? t / R : 0;
+ return prec + rec ? (2 * prec * rec) / (prec + rec) : 0;
+ });
+ return {
+ n: set.length,
+ accuracy: +(correct / set.length).toFixed(4),
+ macroF1: +(f1s.reduce((a, b) => a + b, 0) / f1s.length).toFixed(4),
+ wrongHighConfRate: +(wrongHigh / set.length).toFixed(4),
+ trapAccuracy: trapN ? +(trapOk / trapN).toFixed(4) : null,
+ };
+}
+
+function runParent() {
+ const { rows, sha256 } = loadCorpus();
+ const only = arg('--only') ? arg('--only').split(',') : CANDIDATES;
+ const results = {};
+ for (const cand of only) {
+ const env = { ...process.env };
+ delete env.CLAUDE_FLOW_ROUTER_TYPESAFE; delete env.CLAUDE_FLOW_ROUTER_EMBEDDER;
+ delete env.CLAUDE_FLOW_ROUTER_TYPESAFE_MODEL_DIR; delete env.CLAUDE_FLOW_ROUTER_TYPESAFE_MANIFEST;
+ if (cand === 'C' || cand === 'D') env.CLAUDE_FLOW_ROUTER_TYPESAFE = '1';
+ if (cand === 'D') {
+ const dir = process.env.ROUTER_BENCH_TYPESAFE_MODEL_DIR;
+ if (!dir) { results[cand] = { skipped: 'ROUTER_BENCH_TYPESAFE_MODEL_DIR not set' }; continue; }
+ env.CLAUDE_FLOW_ROUTER_TYPESAFE_MODEL_DIR = dir;
+ env.CLAUDE_FLOW_ROUTER_TYPESAFE_MANIFEST = join(dir, 'manifest.json');
+ }
+ const cwd = mkdtempSync(join(tmpdir(), `router-bench-${cand}-`));
+ const res = spawnSync(process.execPath, [fileURLToPath(import.meta.url), '--candidate', cand], { cwd, env, encoding: 'utf8', maxBuffer: 64 << 20 });
+ const line = (res.stdout || '').split('\n').find((l) => l.startsWith('@@RESULT@@'));
+ if (!line) { results[cand] = { error: (res.stderr || '').slice(-2000) }; continue; }
+ const { cold, out } = JSON.parse(line.slice(10));
+ const warm = out.slice(1).map((o) => o.ms);
+ const r = {
+ dev: score(rows, out, 'dev'),
+ test: score(rows, out, 'test'),
+ latencyMs: { cold: +cold.toFixed(2), p50: +pct(warm, 0.5).toFixed(3), p95: +pct(warm, 0.95).toFixed(3) },
+ predictions: out,
+ };
+ if (cand === 'C' || cand === 'D') {
+ // Raw typesafe pick before the lift/abstain gate, with abstain-gated rows counted as 'none'.
+ const raw = out.map((o) => ({ id: o.id, agent: o.tsUsed ? o.tsRaw : (o.tsRaw && /abstain/.test(o.tsReason ?? '') ? 'none' : o.tsRaw), confidence: 0 }));
+ r.rawTypesafeTest = score(rows, raw, 'test');
+ r.typesafeUsedRate = +(out.filter((o) => o.tsUsed).length / out.length).toFixed(4);
+ }
+ results[cand] = r;
+ console.log(`${cand}: test acc ${r.test.accuracy} macroF1 ${r.test.macroF1} traps ${r.test.trapAccuracy} wrong@β‰₯${HIGH_CONF} ${r.test.wrongHighConfRate} p50 ${r.latencyMs.p50}ms p95 ${r.latencyMs.p95}ms cold ${r.latencyMs.cold}ms` + (r.rawTypesafeTest ? ` | raw typesafe acc ${r.rawTypesafeTest.accuracy}, used ${r.typesafeUsedRate}` : ''));
+ }
+ // ADR-391 promotion gate, each candidate vs A on the TEST split.
+ const A = results.A;
+ const gate = {};
+ for (const c of Object.keys(results)) {
+ if (c === 'A' || !results[c]?.test || !A?.test) continue;
+ const dAcc = +((results[c].test.accuracy - A.test.accuracy) * 100).toFixed(2);
+ const latReg = A.latencyMs.p95 > 0 ? +(((results[c].latencyMs.p95 - A.latencyMs.p95) / A.latencyMs.p95) * 100).toFixed(1) : null;
+ gate[c] = {
+ accuracyDeltaPts: dAcc,
+ p95LatencyRegressionPct: latReg,
+ requiredDependencyAdded: c === 'C' || c === 'D',
+ passesAccuracy: dAcc > 2,
+ passesLatency: latReg !== null && latReg <= 5,
+ passesDependency: !(c === 'C' || c === 'D') ? true : 'optional-peer (allowed only as opt-in)',
+ };
+ }
+ const receipt = { adr: 'ADR-391', ts: new Date().toISOString(), corpusSha256: sha256, node: process.version, host: process.platform + '-' + process.arch, highConfidence: HIGH_CONF, gate, results };
+ const dir = join(HERE, 'results'); mkdirSync(dir, { recursive: true });
+ const file = join(dir, `router-bench-${receipt.ts.slice(0, 10)}.json`);
+ writeFileSync(file, JSON.stringify(receipt, null, 2) + '\n');
+ console.log('\ngate:', JSON.stringify(gate, null, 1), '\nreceipt:', file, '\ncorpus sha256:', sha256);
+}
+
+if (arg('--candidate')) await runChild(arg('--candidate'));
+else runParent();
diff --git a/v3/@claude-flow/cli/benchmarks/router/validate-corpus.mjs b/v3/@claude-flow/cli/benchmarks/router/validate-corpus.mjs
new file mode 100644
index 0000000000..218dab4586
--- /dev/null
+++ b/v3/@claude-flow/cli/benchmarks/router/validate-corpus.mjs
@@ -0,0 +1,91 @@
+#!/usr/bin/env node
+// ADR-391 router corpus validator. No dependencies.
+// Usage: node validate-corpus.mjs [path/to/corpus.jsonl]
+// Exits 1 on any failure; prints per-label x split counts and the sha256.
+import { readFileSync } from 'node:fs';
+import { createHash } from 'node:crypto';
+import { dirname, join } from 'node:path';
+import { fileURLToPath } from 'node:url';
+
+const path = process.argv[2] ?? join(dirname(fileURLToPath(import.meta.url)), 'corpus.jsonl');
+const LABELS = ['coder', 'tester', 'reviewer', 'researcher', 'architect', 'security-architect',
+ 'performance-engineer', 'devops', 'swarm-specialist', 'memory-specialist', 'none'];
+const MIN_PER_LABEL = 8;
+const NONE_RANGE = [15, 20];
+const TOTAL_RANGE = [180, 200];
+const MIN_TRAPS = 30;
+
+const buf = readFileSync(path);
+const sha = createHash('sha256').update(buf).digest('hex');
+const text = buf.toString('utf8');
+const errors = [];
+if (text.includes('\r')) errors.push('file contains CR characters (must be LF only)');
+if (!text.endsWith('\n') || text.endsWith('\n\n')) errors.push('file must end with exactly one trailing newline');
+
+const rows = [];
+text.split('\n').forEach((line, i) => {
+ if (line === '') return;
+ try { rows.push(JSON.parse(line)); } catch (e) { errors.push(`line ${i + 1}: invalid JSON (${e.message})`); }
+});
+
+const ids = new Set();
+for (const r of rows) {
+ const where = r.id ?? '(no id)';
+ if (typeof r.id !== 'string' || !/^r\d{3}$/.test(r.id)) errors.push(`${where}: id must match ^r\\d{3}$`);
+ else if (ids.has(r.id)) errors.push(`${where}: duplicate id`);
+ else ids.add(r.id);
+ if (typeof r.prompt !== 'string' || r.prompt.trim() === '') errors.push(`${where}: empty prompt`);
+ if (!LABELS.includes(r.label)) errors.push(`${where}: unknown label ${JSON.stringify(r.label)}`);
+ if (r.split !== 'dev' && r.split !== 'test') errors.push(`${where}: split must be dev|test`);
+ if (typeof r.trap !== 'boolean') errors.push(`${where}: trap must be boolean`);
+ if (!['issue', 'pr', 'synthetic'].includes(r.source)) errors.push(`${where}: source must be issue|pr|synthetic`);
+ if (typeof r.note !== 'string' || r.note.trim() === '') errors.push(`${where}: note required`);
+}
+
+const prompts = new Set();
+for (const r of rows) {
+ const k = String(r.prompt).trim().toLowerCase();
+ if (prompts.has(k)) errors.push(`${r.id}: duplicate prompt`);
+ prompts.add(k);
+}
+
+// Recompute the documented split rule: within each label, sort by id;
+// 0-indexed position i -> dev iff i % 5 is 0 or 2, else test.
+const byLabel = Object.fromEntries(LABELS.map((l) => [l, []]));
+for (const r of rows) if (byLabel[r.label]) byLabel[r.label].push(r);
+for (const list of Object.values(byLabel)) {
+ [...list].sort((a, b) => a.id.localeCompare(b.id)).forEach((r, i) => {
+ const want = i % 5 === 0 || i % 5 === 2 ? 'dev' : 'test';
+ if (r.split !== want) errors.push(`${r.id}: split is ${r.split}, split rule says ${want}`);
+ });
+}
+
+// Thresholds
+if (rows.length < TOTAL_RANGE[0] || rows.length > TOTAL_RANGE[1]) errors.push(`total ${rows.length} outside ${TOTAL_RANGE.join('-')}`);
+for (const l of LABELS) {
+ const n = byLabel[l].length;
+ if (l === 'none') { if (n < NONE_RANGE[0] || n > NONE_RANGE[1]) errors.push(`none has ${n}, want ${NONE_RANGE.join('-')}`); }
+ else if (n < MIN_PER_LABEL) errors.push(`${l} has ${n}, want >= ${MIN_PER_LABEL}`);
+}
+const traps = rows.filter((r) => r.trap === true).length;
+if (traps < MIN_TRAPS) errors.push(`only ${traps} trap cases, want >= ${MIN_TRAPS}`);
+
+// Report
+const pad = (s, n) => String(s).padEnd(n);
+console.log(pad('label', 22) + pad('dev', 6) + pad('test', 6) + pad('total', 7) + 'traps');
+let dev = 0, test = 0;
+for (const l of LABELS) {
+ const d = byLabel[l].filter((r) => r.split === 'dev').length;
+ const t = byLabel[l].filter((r) => r.split === 'test').length;
+ dev += d; test += t;
+ console.log(pad(l, 22) + pad(d, 6) + pad(t, 6) + pad(d + t, 7) + byLabel[l].filter((r) => r.trap).length);
+}
+console.log(pad('TOTAL', 22) + pad(dev, 6) + pad(test, 6) + pad(rows.length, 7) + traps);
+console.log(`sha256 ${sha} ${path}`);
+
+if (errors.length) {
+ console.error(`\nFAIL (${errors.length}):`);
+ for (const e of errors) console.error(' - ' + e);
+ process.exit(1);
+}
+console.log('OK');
diff --git a/v3/@claude-flow/cli/scripts/sign-helpers.mjs b/v3/@claude-flow/cli/scripts/sign-helpers.mjs
index a416cf321d..88421b9985 100644
--- a/v3/@claude-flow/cli/scripts/sign-helpers.mjs
+++ b/v3/@claude-flow/cli/scripts/sign-helpers.mjs
@@ -31,7 +31,7 @@ const __dirname = dirname(fileURLToPath(import.meta.url));
const PKG_ROOT = join(__dirname, '..');
const HELPERS_DIR = join(PKG_ROOT, '.claude', 'helpers');
// Keep in sync with src/init/helper-refresh.ts:CRITICAL_HELPERS.
-const CRITICAL = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs'];
+const CRITICAL = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs', 'router.js'];
function loadPrivateKey() {
if (process.argv.includes('--stdin-key')) {
diff --git a/v3/@claude-flow/cli/scripts/verify-helpers.mjs b/v3/@claude-flow/cli/scripts/verify-helpers.mjs
index c78cc08dd1..60dbd6d3d4 100644
--- a/v3/@claude-flow/cli/scripts/verify-helpers.mjs
+++ b/v3/@claude-flow/cli/scripts/verify-helpers.mjs
@@ -22,7 +22,7 @@ const __dirname = dirname(fileURLToPath(import.meta.url));
const PKG_ROOT = join(__dirname, '..');
const HELPERS_DIR = resolve(process.argv[2] || join(PKG_ROOT, '.claude', 'helpers'));
// Keep in sync with sign-helpers.mjs:CRITICAL and src/init/helper-refresh.ts:CRITICAL_HELPERS.
-const CRITICAL = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs'];
+const CRITICAL = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs', 'router.js'];
function die(msg) { console.error(`[verify-helpers] ${msg}`); process.exit(1); }
diff --git a/v3/@claude-flow/cli/src/init/executor.ts b/v3/@claude-flow/cli/src/init/executor.ts
index 27cda7f88e..41dc8d8255 100644
--- a/v3/@claude-flow/cli/src/init/executor.ts
+++ b/v3/@claude-flow/cli/src/init/executor.ts
@@ -575,7 +575,7 @@ export async function executeUpgrade(targetDir: string, upgradeSettings = false)
const sourceHelpersForUpgrade = findSourceHelpersDir();
if (sourceHelpersForUpgrade) {
// Keep in sync with helper-refresh.ts:CRITICAL_HELPERS.
- const criticalHelpers = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs'];
+ const criticalHelpers = ['auto-memory-hook.mjs', 'hook-handler.cjs', 'intelligence.cjs', 'statusline.cjs', 'router.js'];
for (const helperName of criticalHelpers) {
const targetPath = path.join(targetDir, '.claude', 'helpers', helperName);
const sourcePath = path.join(sourceHelpersForUpgrade, helperName);
@@ -595,6 +595,7 @@ export async function executeUpgrade(targetDir: string, upgradeSettings = false)
'hook-handler.cjs': generateHookHandler(),
'intelligence.cjs': generateIntelligenceStub(),
'auto-memory-hook.mjs': generateAutoMemoryHook(),
+ 'router.js': generateAgentRouter(), // ADR-389
};
for (const [helperName, content] of Object.entries(generatedCritical)) {
const targetPath = path.join(targetDir, '.claude', 'helpers', helperName);
diff --git a/v3/@claude-flow/cli/src/init/helper-refresh.ts b/v3/@claude-flow/cli/src/init/helper-refresh.ts
index 633440d077..1f00b33aaf 100644
--- a/v3/@claude-flow/cli/src/init/helper-refresh.ts
+++ b/v3/@claude-flow/cli/src/init/helper-refresh.ts
@@ -84,6 +84,10 @@ export const CRITICAL_HELPERS = [
// statusline.cjs is here so the funnel disclosure row (ADR-301) reaches
// existing installs on the next `ruflo` command, not only fresh `ruflo init`.
'statusline.cjs',
+ // router.js is loaded by hook-handler.cjs to label each prompt with an agent.
+ // Without it here, installs kept the pre-#2257 substring router forever
+ // ("latest" -> tester). ADR-389 / #3401.
+ 'router.js',
];
function errorCode(error: unknown): string | undefined {
@@ -301,6 +305,7 @@ async function writeCriticalHelpers(
'hook-handler.cjs': gen.generateHookHandler(),
'intelligence.cjs': gen.generateIntelligenceStub(),
'auto-memory-hook.mjs': gen.generateAutoMemoryHook(),
+ 'router.js': gen.generateAgentRouter(), // ADR-389
// Fallback needs the same generator inputs `ruflo init` uses. We match the
// hardcoded default (maxAgents 15) because the fallback fires when the
// installed package is unresolvable β€” no way to read the user's project
diff --git a/v3/@claude-flow/cli/src/mcp-tools/hooks-tools.ts b/v3/@claude-flow/cli/src/mcp-tools/hooks-tools.ts
index 955b91f215..32cf57dbc4 100644
--- a/v3/@claude-flow/cli/src/mcp-tools/hooks-tools.ts
+++ b/v3/@claude-flow/cli/src/mcp-tools/hooks-tools.ts
@@ -15,6 +15,12 @@ import {
type LearnedRoutingPattern,
} from '../services/learned-routing.js';
import { applyTypesafeRouting, getTypesafeRouter } from '../ruvector/typesafe-router.js';
+import {
+ DEFAULT_ROUTER_EMBEDDER,
+ embedForRouter,
+ resolveRouterEmbedder,
+ type RouterEmbedderKind,
+} from '../ruvector/router-embedder.js';
// Real vector search functions - lazy loaded to avoid circular imports
let searchEntriesFn: ((options: {
@@ -139,54 +145,18 @@ async function getMoERouter() {
// Tries native VectorDb first (16k+ routes/s HNSW), falls back to pure JS (47k routes/s cosine)
let semanticRouter: import('../ruvector/semantic-router.js').SemanticRouter | null = null;
let nativeVectorDb: unknown = null;
-let semanticRouterInitialized = false;
let routerBackend: 'native' | 'pure-js' | 'none' = 'none';
// Pre-computed embeddings for common task patterns (cached)
const TASK_PATTERN_EMBEDDINGS: Map<string, Float32Array> = new Map();
-function generateSimpleEmbedding(text: string, dimension: number = 384): Float32Array {
- // Simple deterministic embedding based on character codes
- // This is for routing purposes where we need consistent, fast embeddings
- const embedding = new Float32Array(dimension);
- const normalized = text.toLowerCase().replace(/[^a-z0-9\s]/g, '');
- const words = normalized.split(/\s+/).filter(w => w.length > 0);
-
- // Combine word-level and character-level features
- for (let i = 0; i < dimension; i++) {
- let value = 0;
-
- // Word-level features
- for (let w = 0; w < words.length; w++) {
- const word = words[w];
- for (let c = 0; c < word.length; c++) {
- const charCode = word.charCodeAt(c);
- value += Math.sin((charCode * (i + 1) + w * 17 + c * 23) * 0.0137);
- }
- }
-
- // Character-level features
- for (let c = 0; c < text.length; c++) {
- value += Math.cos((text.charCodeAt(c) * (i + 1) + c * 7) * 0.0073);
- }
-
- embedding[i] = value / Math.max(1, text.length);
- }
-
- // Normalize
- let norm = 0;
- for (let i = 0; i < dimension; i++) {
- norm += embedding[i] * embedding[i];
- }
- norm = Math.sqrt(norm);
- if (norm > 0) {
- for (let i = 0; i < dimension; i++) {
- embedding[i] /= norm;
- }
- }
-
- return embedding;
-}
+// ADR-390: the router's embedder (MiniLM or the historical hash). Pattern and
+// query vectors always come from the SAME embedder; `routerEmbedder` records the
+// one that actually built the current index (after any degradation to hash).
+let routerEmbedder: RouterEmbedderKind = DEFAULT_ROUTER_EMBEDDER;
+let routerEmbedderReason: string | undefined;
+let routerRequestedEmbedder: RouterEmbedderKind | null = null;
+let routerInitPromise: Promise<SemanticRouterHandle> | null = null;
// ── Runtime routing outcome persistence ──────────────────────────────
// Closes the learning loop: post-task records outcomes β†’ route loads them.
@@ -243,7 +213,8 @@ function saveRoutingOutcomes(outcomes: RoutingOutcome[]): void {
// The prior singleton cache made the learned store inert until restart.
semanticRouter = null;
nativeVectorDb = null;
- semanticRouterInitialized = false;
+ routerInitPromise = null;
+ routerRequestedEmbedder = null;
routerBackend = 'none';
TASK_PATTERN_EMBEDDINGS.clear();
} catch { /* non-critical */ }
@@ -332,15 +303,76 @@ function withTypesafeRouting(legacy: (params: Record<string, unknown>) => Promis
applyTypesafeRouting(params, (await legacy(params)) as Record<string, unknown>, TASK_PATTERNS, getTypesafeRouter());
}
+interface SemanticRouterHandle {
+ router: import('../ruvector/semantic-router.js').SemanticRouter | null;
+ backend: 'native' | 'pure-js' | 'none';
+ native: unknown;
+ /** Embedder that built this index (ADR-390); the query MUST use the same one. */
+ embedder: RouterEmbedderKind;
+ embedderReason?: string;
+}
+
/**
* Get the semantic router with environment detection.
* Tries native VectorDb first (HNSW, 16k routes/s), falls back to pure JS (47k routes/s cosine).
+ *
+ * ADR-390: `requested` (else CLAUDE_FLOW_ROUTER_EMBEDDER, else the default)
+ * picks the embedder. The index is rebuilt when the requested embedder changes.
+ * Concurrent callers share one in-flight build.
*/
-async function getSemanticRouter() {
- if (semanticRouterInitialized) {
- return { router: semanticRouter, backend: routerBackend, native: nativeVectorDb };
+async function getSemanticRouter(requested?: RouterEmbedderKind): Promise<SemanticRouterHandle> {
+ const selection = resolveRouterEmbedder(requested);
+ if (routerInitPromise && routerRequestedEmbedder === selection.kind) {
+ return routerInitPromise;
+ }
+ semanticRouter = null;
+ nativeVectorDb = null;
+ routerBackend = 'none';
+ TASK_PATTERN_EMBEDDINGS.clear();
+ routerRequestedEmbedder = selection.kind;
+ routerInitPromise = buildSemanticRouter(selection.kind, selection.reason);
+ return routerInitPromise;
+}
+
+/** Test hook: drop the cached semantic index so the next route rebuilds it. */
+export function resetSemanticRouterForTests(): void {
+ semanticRouter = null;
+ nativeVectorDb = null;
+ routerBackend = 'none';
+ routerInitPromise = null;
+ routerRequestedEmbedder = null;
+ TASK_PATTERN_EMBEDDINGS.clear();
+}
+
+/** Embed every pattern keyword with ONE embedder (ADR-390: never mix spaces). */
+async function embedPatternKeywords(
+ patterns: Record<string, RoutingPattern>,
+ kind: RouterEmbedderKind,
+): Promise<{ vectors: Map<string, Float32Array[]>; embedder: RouterEmbedderKind; reason?: string }> {
+ const entries = Object.entries(patterns);
+ const flat = entries.flatMap(([, p]) => p.keywords);
+ const res = await embedForRouter(flat, kind);
+ const vectors = new Map<string, Float32Array[]>();
+ let i = 0;
+ for (const [name, p] of entries) {
+ vectors.set(name, res.vectors.slice(i, i + p.keywords.length));
+ i += p.keywords.length;
}
- semanticRouterInitialized = true;
+ return { vectors, embedder: res.embedder, reason: res.reason };
+}
+
+async function buildSemanticRouter(kind: RouterEmbedderKind, selectionReason?: string): Promise<SemanticRouterHandle> {
+ const patterns = getMergedTaskPatterns();
+ const embedded = await embedPatternKeywords(patterns, kind);
+ routerEmbedder = embedded.embedder;
+ routerEmbedderReason = embedded.reason ?? selectionReason;
+ const handle = (): SemanticRouterHandle => ({
+ router: semanticRouter,
+ backend: routerBackend,
+ native: nativeVectorDb,
+ embedder: routerEmbedder,
+ ...(routerEmbedderReason ? { embedderReason: routerEmbedderReason } : {}),
+ });
// STEP 1: Try native VectorDb from @ruvector/router (HNSW-backed)
// Note: Native VectorDb uses a persistent database file which can have lock issues
@@ -364,18 +396,18 @@ async function getSemanticRouter() {
});
// Initialize with static + runtime-learned task patterns
- for (const [patternName, { keywords }] of Object.entries(getMergedTaskPatterns())) {
- for (const keyword of keywords) {
- const embedding = generateSimpleEmbedding(keyword);
- db.insert(`${patternName}:${keyword}`, embedding);
- TASK_PATTERN_EMBEDDINGS.set(`${patternName}:${keyword}`, embedding);
- }
+ for (const [patternName, { keywords }] of Object.entries(patterns)) {
+ const embeddings = embedded.vectors.get(patternName) ?? [];
+ keywords.forEach((keyword, i) => {
+ db.insert(`${patternName}:${keyword}`, embeddings[i]);
+ TASK_PATTERN_EMBEDDINGS.set(`${patternName}:${keyword}`, embeddings[i]);
+ });
}
nativeVectorDb = db;
routerBackend = 'native';
- console.log('[hooks] Semantic router initialized: native VectorDb (HNSW, 16k+ routes/s)');
- return { router: null, backend: routerBackend, native: nativeVectorDb };
+ console.log(`[hooks] Semantic router initialized: native VectorDb (HNSW, 16k+ routes/s), embedder=${routerEmbedder}`);
+ return handle();
}
} catch (err) {
// Native not available or database locked - fall back to pure JS
@@ -388,8 +420,8 @@ async function getSemanticRouter() {
const { SemanticRouter } = await import('../ruvector/semantic-router.js');
semanticRouter = new SemanticRouter({ dimension: 384 });
- for (const [patternName, { keywords, agents, source, support, reliability }] of Object.entries(getMergedTaskPatterns())) {
- const embeddings = keywords.map(kw => generateSimpleEmbedding(kw));
+ for (const [patternName, { keywords, agents, source, support, reliability }] of Object.entries(patterns)) {
+ const embeddings = embedded.vectors.get(patternName) ?? [];
semanticRouter.addIntentWithEmbeddings(patternName, embeddings, {
agents,
keywords,
@@ -405,14 +437,14 @@ async function getSemanticRouter() {
}
routerBackend = 'pure-js';
- console.log('[hooks] Semantic router initialized: pure JS (cosine, 47k routes/s)');
+ console.log(`[hooks] Semantic router initialized: pure JS (cosine, 47k routes/s), embedder=${routerEmbedder}`);
} catch {
semanticRouter = null;
routerBackend = 'none';
console.log('[hooks] Semantic router initialized: none (no backend available)');
}
- return { router: semanticRouter, backend: routerBackend, native: nativeVectorDb };
+ return handle();
}
/**
@@ -1183,10 +1215,30 @@ export const hooksRoute: MCPTool = {
}
}
+ return routeTaskLocal(task, context, useSemanticRouter);
+ }),
+};
+
+/**
+ * hooks_route's local routing (semantic index + keyword fallback), run after the
+ * AgentDB pre-route. Shared with {@link routeTaskForBench} so the benchmark
+ * measures exactly the path hooks_route takes. (Body kept at its original
+ * indentation to keep this refactor's diff small.)
+ */
+async function routeTaskLocal(
+ task: string,
+ context: string | undefined,
+ useSemanticRouter: boolean,
+ embedderOverride?: RouterEmbedderKind,
+): Promise<LocalRouteResult> {
// Get router (tries native VectorDb first, falls back to pure JS)
- const { router, backend, native } = useSemanticRouter
- ? await getSemanticRouter()
- : { router: null, backend: 'none' as const, native: null };
+ let handle: SemanticRouterHandle = useSemanticRouter
+ ? await getSemanticRouter(embedderOverride)
+ : {
+ router: null, backend: 'none', native: null,
+ embedder: resolveRouterEmbedder(embedderOverride).kind,
+ embedderReason: 'semantic router disabled (useSemanticRouter=false)',
+ };
let semanticResult: { intent: string; score: number; metadata: Record<string, unknown> }[] = [];
let routingMethod = 'keyword';
@@ -1194,10 +1246,22 @@ export const hooksRoute: MCPTool = {
let backendInfo = '';
const queryText = context ? `${task} ${context}` : task;
- const queryEmbedding = generateSimpleEmbedding(queryText);
+ // ADR-390: the query is embedded with the embedder that built the index.
+ let queryEmbedding: Float32Array | null = null;
+ if (handle.router || handle.native) {
+ const q = await embedForRouter([queryText], handle.embedder);
+ if (q.embedder !== handle.embedder) {
+ // MiniLM failed on the query after building a MiniLM index: rebuild the
+ // index with the hash so patterns and query share one space again.
+ routerInitPromise = buildSemanticRouter('hash', q.reason);
+ handle = await routerInitPromise;
+ }
+ queryEmbedding = q.vectors[0];
+ }
+ const { router, backend, native } = handle;
// Try native VectorDb (HNSW-backed)
- if (native && backend === 'native') {
+ if (native && backend === 'native' && queryEmbedding) {
const routeStart = performance.now();
try {
// eslint-disable-next-line @typescript-eslint/no-explicit-any
@@ -1228,7 +1292,7 @@ export const hooksRoute: MCPTool = {
}
// Try pure JS SemanticRouter fallback
- if (router && backend === 'pure-js' && semanticResult.length === 0) {
+ if (router && backend === 'pure-js' && queryEmbedding && semanticResult.length === 0) {
const routeStart = performance.now();
semanticResult = router.routeWithEmbedding(queryEmbedding, 3);
routingLatencyMs = performance.now() - routeStart;
@@ -1313,10 +1377,59 @@ export const hooksRoute: MCPTool = {
agents,
coordination: 'queen-led',
} : null,
+ // ADR-390: which embedder the semantic index + query used ('hash' when degraded).
+ embedder: handle.embedder,
+ ...(handle.embedderReason ? { embedderReason: handle.embedderReason } : {}),
};
- }),
+}
+
+type LocalRouteResult = Record<string, unknown> & {
+ primaryAgent: { type: string; confidence: number; reason: string };
+ matchedPattern: string;
+ embedder: RouterEmbedderKind;
+ embedderReason?: string;
};
+/** Result of {@link routeTaskForBench}. */
+export interface BenchRouteResult {
+ primaryAgent: string;
+ confidence: number;
+ /** Matched pattern name, or 'keyword-fallback'. */
+ pattern: string;
+ /** Embedder actually used ('hash' if MiniLM was requested but unavailable). */
+ embedder: RouterEmbedderKind;
+ embedderReason?: string;
+ /** routing.method of the underlying route ('semantic-native' | 'semantic-pure-js' | 'keyword'). */
+ method: string;
+}
+
+/**
+ * INTERNAL / BENCH-ONLY (ADR-391). Not a public API; may change without notice.
+ *
+ * Routes `task` through the same local path `hooks_route` uses (semantic index +
+ * keyword fallback) with an explicit embedder, without the MCP layer. It skips
+ * the two steps that are neither ADR-391 candidate A nor B: the AgentDB
+ * pre-route (`bridgeRouteTask`, which answers first when its confidence > 0.5)
+ * and the opt-in typesafe wrapper (CLAUDE_FLOW_ROUTER_TYPESAFE). With those
+ * inactive, `primaryAgent` equals `hooks_route`'s `primaryAgent.type`.
+ *
+ * Switching `embedder` between calls rebuilds the index; benchmark in blocks.
+ */
+export async function routeTaskForBench(
+ task: string,
+ opts: { embedder: RouterEmbedderKind; context?: string },
+): Promise<BenchRouteResult> {
+ const r = await routeTaskLocal(task, opts.context, true, opts.embedder);
+ return {
+ primaryAgent: r.primaryAgent.type,
+ confidence: r.primaryAgent.confidence,
+ pattern: r.matchedPattern,
+ embedder: r.embedder,
+ ...(r.embedderReason ? { embedderReason: r.embedderReason } : {}),
+ method: String((r.routing as { method?: unknown } | undefined)?.method ?? ''),
+ };
+}
+
export const hooksMetrics: MCPTool = {
name: 'hooks_metrics',
description: 'View learning metrics dashboard Use when native Bash hooks (via Claude Code\'s settings.json) are wrong because you need Ruflo-side state β€” pattern persistence, neural training signals, model-routing learning, cost tracking, audit chain. For one-off shell commands, plain Bash hooks are fine.',
diff --git a/v3/@claude-flow/cli/src/ruvector/router-embedder.ts b/v3/@claude-flow/cli/src/ruvector/router-embedder.ts
new file mode 100644
index 0000000000..4832d92f45
--- /dev/null
+++ b/v3/@claude-flow/cli/src/ruvector/router-embedder.ts
@@ -0,0 +1,166 @@
+/**
+ * Router embedder (ADR-390).
+ *
+ * `hooks_route` compares a task with each agent pattern's keywords in a 384-d
+ * vector index. Historically both sides came from a character hash
+ * (`generateSimpleEmbedding`), which measures spelling, not meaning. This
+ * module lets the router use the local sentence model (all-MiniLM-L6-v2, 384-d)
+ * instead, with the hash as the fallback.
+ *
+ * Rules (ADR-390 Β§Decision):
+ * - The MiniLM path uses `generateLocalEmbedding` ONLY. Never the bridge-first
+ * `generateEmbedding` β€” that recursed without bound in #2312.
+ * - One embedder per index: if ANY text cannot be embedded by the real model
+ * (throw, backend !== 'onnx', or a non-384 vector), EVERY text in the call
+ * is embedded with the hash, and the result says so.
+ * - The default stays `hash` until ADR-391's benchmark says otherwise.
+ *
+ * Selection: `CLAUDE_FLOW_ROUTER_EMBEDDER=minilm|hash`. The router index is
+ * process-lifetime state, so the env var is read when the index is (re)built,
+ * not per CLI invocation.
+ */
+// memory-initializer is imported lazily (as hooks-tools does elsewhere): it is
+// heavy, and the default `hash` path must not load it at all.
+
+export type RouterEmbedderKind = 'minilm' | 'hash';
+
+/** Default embedder. ADR-391 decides whether this flips to 'minilm'. */
+export const DEFAULT_ROUTER_EMBEDDER: RouterEmbedderKind = 'hash';
+
+/** Dimension of the router index (VectorDb + SemanticRouter are built at 384). */
+export const ROUTER_EMBEDDING_DIM = 384;
+
+export const ROUTER_EMBEDDER_ENV = 'CLAUDE_FLOW_ROUTER_EMBEDDER';
+
+export interface RouterEmbedderSelection {
+ kind: RouterEmbedderKind;
+ /** Set when the requested value was invalid and the default was used. */
+ reason?: string;
+}
+
+export interface RouterEmbeddingResult {
+ vectors: Float32Array[];
+ /** The embedder that actually produced `vectors` (after any degradation). */
+ embedder: RouterEmbedderKind;
+ /** Why the result is `hash` when `minilm` was requested. */
+ reason?: string;
+}
+
+/**
+ * Resolve which embedder the router should use.
+ * Precedence: explicit override > CLAUDE_FLOW_ROUTER_EMBEDDER > DEFAULT_ROUTER_EMBEDDER.
+ */
+export function resolveRouterEmbedder(
+ override?: RouterEmbedderKind,
+ env: NodeJS.ProcessEnv = process.env,
+): RouterEmbedderSelection {
+ if (override) return { kind: override };
+ // Env-only by design (registered in scripts/audit-env-var-precedence.mjs):
+ // the router index is process-lifetime MCP state, not owned by one CLI call.
+ const raw = env.CLAUDE_FLOW_ROUTER_EMBEDDER?.trim().toLowerCase();
+ if (!raw) return { kind: DEFAULT_ROUTER_EMBEDDER };
+ if (raw === 'minilm' || raw === 'hash') return { kind: raw };
+ return {
+ kind: DEFAULT_ROUTER_EMBEDDER,
+ reason: `${ROUTER_EMBEDDER_ENV}=${JSON.stringify(raw)} is not 'minilm' or 'hash'; using '${DEFAULT_ROUTER_EMBEDDER}'`,
+ };
+}
+
+/**
+ * Deterministic character-hash embedding (the router's historical embedder).
+ * Moved verbatim from hooks-tools.ts; do not change the math β€” existing routes
+ * and thresholds were calibrated against it.
+ */
+export function generateSimpleEmbedding(text: string, dimension: number = ROUTER_EMBEDDING_DIM): Float32Array {
+ const embedding = new Float32Array(dimension);
+ const normalized = text.toLowerCase().replace(/[^a-z0-9\s]/g, '');
+ const words = normalized.split(/\s+/).filter(w => w.length > 0);
+
+ for (let i = 0; i < dimension; i++) {
+ let value = 0;
+ // Word-level features
+ for (let w = 0; w < words.length; w++) {
+ const word = words[w];
+ for (let c = 0; c < word.length; c++) {
+ const charCode = word.charCodeAt(c);
+ value += Math.sin((charCode * (i + 1) + w * 17 + c * 23) * 0.0137);
+ }
+ }
+ // Character-level features
+ for (let c = 0; c < text.length; c++) {
+ value += Math.cos((text.charCodeAt(c) * (i + 1) + c * 7) * 0.0073);
+ }
+ embedding[i] = value / Math.max(1, text.length);
+ }
+
+ return l2Normalize(embedding);
+}
+
+function l2Normalize(v: Float32Array): Float32Array {
+ let norm = 0;
+ for (let i = 0; i < v.length; i++) norm += v[i] * v[i];
+ norm = Math.sqrt(norm);
+ if (norm > 0) for (let i = 0; i < v.length; i++) v[i] /= norm;
+ return v;
+}
+
+// Per-(embedder, text) memo. Keyword vectors don't change when the pattern set
+// changes, so this survives router rebuilds (e.g. after saveRoutingOutcomes).
+const MINILM_CACHE = new Map<string, Float32Array>();
+const MINILM_CACHE_MAX = 2048;
+
+async function embedOneMiniLM(text: string): Promise<Float32Array> {
+ const cached = MINILM_CACHE.get(text);
+ if (cached) return cached;
+ const { generateLocalEmbedding } = await import('../memory/memory-initializer.js');
+ const out = await generateLocalEmbedding(text);
+ if (out.backend !== 'onnx') {
+ throw new RouterEmbedderDegraded(`local embedder backend is '${out.backend}' (model '${out.model}'), not onnx`);
+ }
+ if (!out.embedding || out.embedding.length !== ROUTER_EMBEDDING_DIM) {
+ throw new RouterEmbedderDegraded(
+ `local embedder returned ${out.embedding?.length ?? 0}-d vectors; router index is ${ROUTER_EMBEDDING_DIM}-d`,
+ );
+ }
+ const vec = l2Normalize(Float32Array.from(out.embedding));
+ if (MINILM_CACHE.size >= MINILM_CACHE_MAX) {
+ const oldest = MINILM_CACHE.keys().next().value;
+ if (oldest !== undefined) MINILM_CACHE.delete(oldest);
+ }
+ MINILM_CACHE.set(text, vec);
+ return vec;
+}
+
+class RouterEmbedderDegraded extends Error {}
+
+/**
+ * Embed texts for the router. All vectors in one result come from ONE embedder.
+ * `hash` never touches the model (no load cost for default users).
+ */
+export async function embedForRouter(
+ texts: readonly string[],
+ kind: RouterEmbedderKind = resolveRouterEmbedder().kind,
+): Promise<RouterEmbeddingResult> {
+ if (kind === 'hash') {
+ return { vectors: texts.map(t => generateSimpleEmbedding(t)), embedder: 'hash' };
+ }
+ try {
+ const vectors: Float32Array[] = [];
+ for (const t of texts) vectors.push(await embedOneMiniLM(t));
+ return { vectors, embedder: 'minilm' };
+ } catch (err) {
+ const why = err instanceof RouterEmbedderDegraded
+ ? err.message
+ : `local embedder threw: ${err instanceof Error ? err.message : String(err)}`;
+ return {
+ vectors: texts.map(t => generateSimpleEmbedding(t)),
+ embedder: 'hash',
+ reason: `minilm unavailable (${why}); using hash for patterns and query`,
+ };
+ }
+}
+
+/** Test hook: clear the MiniLM vector memo. */
+export function clearRouterEmbedderCache(): void {
+ MINILM_CACHE.clear();
+}
diff --git a/v3/docs/adr/ADR-389-refresh-the-keyword-router-helper.md b/v3/docs/adr/ADR-389-refresh-the-keyword-router-helper.md
new file mode 100644
index 0000000000..050622920a
--- /dev/null
+++ b/v3/docs/adr/ADR-389-refresh-the-keyword-router-helper.md
@@ -0,0 +1,58 @@
+# ADR-389 β€” Refresh the Keyword Router Helper on Upgrade
+
+**Status**: Implemented (3.44.0)
+**Date**: 2026-09-23
+**Related**: ADR-174 (signed helpers manifest), ADR-390 (semantic router embedder), ADR-391 (router benchmark gate), #2257, #3401, PR #3402
+**Surfaces**: `v3/@claude-flow/cli/src/init/helper-refresh.ts`, `v3/@claude-flow/cli/.claude/helpers/helpers.manifest.json`
+
+## Context
+
+Claude Code's prompt hook runs `~/.claude/helpers/hook-handler.cjs`, which loads
+`router.js` from the same directory (`hook-handler.cjs:235`) to label each prompt
+with a suggested agent. That router matched keywords as **substrings**:
+
+- "sync and review la**test** issues" β†’ `tester` at 0.8
+- "are we **u**s**i**ng…" (typed as "uing") β†’ `frontend-dev` via `ui`
+- "**auth**or" β†’ auth, "pre**fix**" β†’ fix
+
+The generator was fixed in #2257, and the remaining copies in PR #3402 (3.43.0).
+**Installed copies never receive it.** The copy on the maintainer's own machine is
+dated 2026-04-15, still matches substrings, and misrouted prompts throughout the
+3.43.0 release session.
+
+Why no install gets the fix: `helper-refresh.ts` only re-copies the helpers named
+in `CRITICAL_HELPERS` (`auto-memory-hook.mjs`, `hook-handler.cjs`, `intelligence.cjs`,
+`statusline.cjs`). `router.js` isn't on that list, and `init` skips files that
+already exist. So once `router.js` is written, it's frozen.
+
+The refresh already reaches the right place. It has a global pass for
+`~/.claude/helpers/`, which the real CLI entry enables. The only gap is the list.
+
+## Decision
+
+1. Add `router.js` to `CRITICAL_HELPERS`.
+2. Re-sign `helpers.manifest.json` in the same release. The refresh is fail-closed
+ and refuses any helper without a signed hash (ADR-174), so the list change and
+ the re-sign must ship together.
+3. Leave `router.js`'s behaviour unchanged here. This ADR is only about delivery; the
+ word-boundary logic already shipped in 3.43.0.
+
+## Consequences
+
+- Every existing install gets the word-boundary router on its next `ruflo` command,
+ through the same signed, fail-closed path as the other four helpers.
+- A user who hand-edited `router.js` will have it overwritten. The same is already
+ true of `hook-handler.cjs`, and a hand-edited copy fails the hash check anyway.
+- The release checklist gains nothing new. The re-sign already happens every
+ release, because the manifest is pinned to the package version.
+- **Risk:** the concurrent-session helper overwrite described in CLAUDE.md now
+ covers one more file. Mitigation is unchanged: `git diff --stat` the helpers
+ immediately before signing.
+
+## Verification
+
+- A unit test asserts `router.js` is in `CRITICAL_HELPERS` and in the signed manifest.
+- Pack the CLI, install it into a directory that has a stale April `router.js`, run
+ any `ruflo` command, and check that `router.js "sync and review latest issues"`
+ no longer returns `tester`.
+- `scripts/verify-helpers.mjs` reports 5 helpers.
diff --git a/v3/docs/adr/ADR-390-semantic-router-uses-the-real-embedder.md b/v3/docs/adr/ADR-390-semantic-router-uses-the-real-embedder.md
new file mode 100644
index 0000000000..6c99551758
--- /dev/null
+++ b/v3/docs/adr/ADR-390-semantic-router-uses-the-real-embedder.md
@@ -0,0 +1,63 @@
+# ADR-390 β€” The Semantic Router Uses the Real Sentence Embedder
+
+**Status**: Implemented as opt-in (3.44.0); default unchanged β€” did not pass the ADR-391 gate
+**Date**: 2026-09-23
+**Related**: ADR-389 (keyword router refresh), ADR-391 (router benchmark gate), #2312 (embedder recursion), #3375, PR #3407
+**Surfaces**: `v3/@claude-flow/cli/src/mcp-tools/hooks-tools.ts` (`getSemanticRouter`, `hooks_route`)
+
+## Context
+
+`hooks_route` picks an agent by comparing the task with each agent pattern's
+keywords in a vector index (`@ruvector/router` VectorDb, or a pure-JS fallback).
+Both sides of that comparison come from `generateSimpleEmbedding`
+(`hooks-tools.ts:148`): the pattern keywords (`:369`, `:392`) and the incoming
+task (`:1197`). That function is a character-hash, not a language model. It measures
+spelling overlap, not meaning.
+
+Observed on the published 3.43.0: "sync and review latest issues" routes to
+`tester` at **58%** through the semantic path. The word-boundary fix (#3402) doesn't
+help here, because this path never matches words; it compares hash vectors, and
+"latest" shares character patterns with "test".
+
+RuFlo already ships and loads a real sentence model. Memory uses
+`all-MiniLM-L6-v2`, 384-d, the same dimension the router index uses, through
+`generateEmbedding` / `generateLocalEmbedding` in `memory-initializer.ts`. On the
+3.43.0 release check it found a stored entry by meaning at 0.83. The router uses
+none of it.
+
+## Decision
+
+Embed the router's pattern keywords and incoming tasks with the local sentence
+model, keeping the hash embedder as the fallback:
+
+1. At router init, embed each pattern's keywords with `generateLocalEmbedding`.
+ It must be the **local** chain, never the bridge-first `generateEmbedding`,
+ which recursed without bound in #2312. Cache the vectors per pattern set.
+2. Embed the incoming task with the same function, so both sides share one space.
+ Mixing hash and model vectors in one index is forbidden.
+3. If the local model reports `backend !== 'onnx'` (mock or hash), use
+ `generateSimpleEmbedding` for **both** sides, as today, and report
+ `embedder: 'hash'` in the routing result.
+4. Every result gains an `embedder` field (`minilm` | `hash`), so a degraded route
+ is visible, not silent.
+
+Model loading is lazy and happens once per process. `hooks_route` already awaits
+async work.
+
+## Consequences
+
+- Routing should follow meaning, not spelling. This is a hypothesis until ADR-391
+ measures it. The ADR ships behind its gate, not on faith.
+- First-call latency rises by the model load if memory hasn't already loaded it.
+ Per-call cost is one 384-d embedding. ADR-391's latency criterion decides whether
+ that's acceptable.
+- No new dependency. Installs without the model behave exactly as today and say so.
+
+## Verification
+
+- Unit tests (London-school, with the embedder mocked):
+ - when onnx is available, pattern and query vectors come from the same function
+ - mock/hash backend falls back to `generateSimpleEmbedding` on both sides
+ - the `embedder` field is reported
+ - there is no call path to the bridge-first `generateEmbedding`
+- Promotion to default happens only if ADR-391's gate passes.
diff --git a/v3/docs/adr/ADR-391-router-benchmark-gate.md b/v3/docs/adr/ADR-391-router-benchmark-gate.md
new file mode 100644
index 0000000000..aaf33017d1
--- /dev/null
+++ b/v3/docs/adr/ADR-391-router-benchmark-gate.md
@@ -0,0 +1,129 @@
+# ADR-391 β€” Change the Default Router Only on a Measured Win
+
+**Status**: Implemented (3.44.0) β€” first run: no candidate promoted
+**Date**: 2026-09-23
+**Related**: ADR-150 (MetaHarness AND-gate), ADR-389, ADR-390, PR #3406 (opt-in `@ruvector/typesafe` router)
+**Surfaces**: `hooks_route`, `v3/@claude-flow/cli/src/ruvector/router-parallel-recorder.ts`, a new bench under `v3/@claude-flow/cli/benchmarks/`
+
+## Context
+
+There are now four ways RuFlo could pick an agent, and no evidence on which is best:
+
+| Candidate | What it is | Status |
+|---|---|---|
+| **A** current | semantic router over hash embeddings + keyword fallback | default |
+| **B** MiniLM | A, with the real sentence embedder (ADR-390) | proposed |
+| **C** typesafe-hash | `@ruvector/typesafe`, default hash embedder | opt-in since 3.43.0 |
+| **D** typesafe-onnx | `@ruvector/typesafe` with bge-small / MiniLM | untested |
+
+The evidence so far is a handful of hand-picked prompts. Typesafe's own lift
+threshold (1.2Γ—) was set from a **10-task** sample. That isn't enough to justify
+changing what every user gets.
+
+The data source this needs isn't populated yet. `router-parallel-recorder.ts`
+writes `.swarm/router-parallel.jsonl`, but:
+- only when `CLAUDE_FLOW_ROUTER_PARALLEL_LOG=1`
+- task text is excluded unless `CLAUDE_FLOW_ROUTER_PARALLEL_LOG_TASK=1`
+
+On the maintainer's machine the file does not exist. There is no history to mine
+today.
+
+## Decision
+
+1. **Build the corpus first.**
+ - Collect **150–200 real task prompts**. Sources: the parallel log (collected
+ with both env flags on, and scrubbed of anything sensitive), plus
+ prompts from this repo's issues and PR titles.
+ - Label each with the correct agent, blind to any router's output.
+ - Include negatives: prompts that fit no agent, where abstaining is correct.
+ - Freeze the corpus with a hash and split it into **dev** (tuning thresholds) and
+ **test** (the decision). The test split is touched once per candidate.
+2. **Run all four candidates on the same frozen test split.** For each, measure:
+ - top-1 accuracy
+ - macro-F1
+ - wrong-with-high-confidence rate
+ - abstain precision (C and D)
+ - p50/p95 latency, cold and warm
+ - dependency and install cost
+3. **Promotion rule** (the ADR-150 AND-gate, restated for routing). A candidate
+ replaces the default only if, against A:
+ - accuracy is **more than 2 points** better
+ - it adds no required dependency (optional peers and fallbacks are allowed)
+ - p95 latency regresses by **no more than 5%** warm, with cold start reported
+ separately
+4. **Tie-break role for typesafe.** If C or D doesn't win outright but its abstain
+ signal predicts A's errors, it may become a second opinion: consulted only when
+ A's top two scores are within a margin. That needs its own measured win on the
+ same split.
+5. Results, the corpus hash and the per-candidate receipts are committed under
+ `benchmarks/results/`, whatever the outcome. A loss is recorded, not deleted.
+
+## Consequences
+
+- The default router changes only on evidence. B (no new dependency) is the
+ expected winner, but that's a prediction this ADR exists to test.
+- Typesafe stays opt-in unless it earns more. PR #3406's design already allows
+ either outcome.
+- Labelling 150–200 prompts is real work. It's also reusable: the same corpus
+ evaluates any future router change.
+
+## Verification
+
+- The bench script re-runs deterministically from the frozen corpus (fixed seeds,
+ pinned model hashes).
+- A CI job re-runs the bench on changes to `hooks_route` and fails if the default's
+ accuracy on the test split drops below the committed receipt.
+
+## Results β€” first run (2026-09-23)
+
+Corpus: 197 prompts, frozen at sha256 `b0c1923b2813b61907304dff56c53d199b709797bfb9600a7c1f496cf0c0bf04`
+(84 dev / 113 test, 64 trap cases), labelled blind by an agent that never ran or read any router.
+Receipt: `v3/@claude-flow/cli/benchmarks/router/results/router-bench-2026-09-23.json`.
+Re-run: `node benchmarks/router/run-bench.mjs` (D needs `ROUTER_BENCH_TYPESAFE_MODEL_DIR`).
+
+**Test split (n=113):**
+
+| Candidate | Accuracy | Macro-F1 | Trap accuracy | Wrong at β‰₯0.7 confidence | p50 / p95 warm | Cold |
+|---|---|---|---|---|---|---|
+| A current (hash) | **25.7%** | 0.178 | 29.0% | 29.2% | 0.66 / 1.06 ms | 38 ms |
+| B MiniLM (ADR-390) | **36.3%** | 0.334 | 25.8% | 46.9%* | 2.19 / 6.21 ms | 326 ms |
+| C typesafe, hash | 26.5% | 0.199 | 29.0% | 26.6% | 0.77 / 1.20 ms | 90 ms |
+| D typesafe, ONNX (bge-small-en-v1.5) | 29.2% | 0.227 | 32.3% | 26.6% | 6.07 / 8.35 ms | 680 ms |
+
+Raw typesafe pick before its lift/abstain gate: C 30.1%, D **44.3%**. The gate
+let typesafe decide on only 13.2% (C) and 5.6% (D) of prompts.
+
+**Gate verdict: no candidate is promoted.**
+
+- **B** clears accuracy (+10.6 pts) and dependency, but fails latency: p95 +485%
+ (1.06 β†’ 6.21 ms).
+- **C** fails accuracy (+0.9 pts) and latency.
+- **D** clears accuracy (+3.5 pts), but fails latency (+686%) and is an optional
+ peer, so it can only ever be opt-in.
+
+`DEFAULT_ROUTER_EMBEDDER` stays `hash`, and typesafe stays opt-in.
+
+**Findings (recorded, not acted on in this run):**
+
+1. **The router structurally cannot answer 59 of 197 prompts.** No `TASK_PATTERNS`
+ entry returns `researcher`, `reviewer` or `none` as the primary agent, so A and
+ B have a ceiling of about 70% before any embedder question. Adding
+ research/review patterns is likely worth more than any embedder change. First
+ follow-up.
+2. **The latency criterion is mis-specified for this workload.** A relative bound
+ (≀5% p95) on a ~1 ms baseline fails any embedder that does real work, even
+ though B's absolute cost is about 5 ms on a pre-task hook. Proposed revision,
+ for the owner and **not applied here**: an absolute bound (e.g. p95 ≀ 10 ms
+ warm, cold reported), then re-run. Changing the gate in the same commit as the
+ result it would flip is exactly what this ADR forbids.
+3. *B's "wrong at β‰₯0.7" isn't comparable with A's.* The 0.4 score gate and the
+ `1 - distance` confidence were calibrated for hash vectors; MiniLM cosines sit
+ on a different scale. B needs its own threshold, tuned on the dev split, before
+ this metric means anything.
+4. **Typesafe is held back by its gate, not its accuracy.** D's raw pick is the
+ most accurate of anything measured (44.3%), but the lift/abstain thresholds were
+ set from a 10-task hash sample and admit only 5.6% of its decisions. Tune them on
+ the dev split, then re-run on test.
+5. The labeller flagged three debatable rows (two memory-area design prompts, one
+ benchmark-measurement fix, one topology question). They were left as labelled,
+ because relabelling after seeing router output would break the blind protocol.