HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code, Hermes, PI, DSH, and more through one API, with sessions, streaming, files, cancellation, and failure handling. Implements the Unified Harness Protocol (UHP), an open standard. Your keys, your infrastructure.
Python agent-apiagent-frameworkagent-harnessai-agentsai-infrastructurecoding-agentconformance-testingdeepseek-harnessharness-engineeringhermesllmopen-protocolopen-sourceopen-standardpi-coding-agentself-hosteduhpunified-apiunified-harness-protocolunified-interface
Commits on main
Merge pull request #235 from HarnessRouter/benchmark-dimension
d0434d1 richard-epsilla committed 2 months ago
benchmark: a search tool is not the network, outside is everything but the workspace, and the grader's engine gets a profile per call
ac11a02 richard-epsilla committed 2 months ago
responses: a turn that has not started is not an orphan (#234)
5dff51a github-actions[bot] committed 2 months ago
calibration: the credential reads the installed package's files (#233)
ef19f3a github-actions[bot] committed 2 months ago
dual loop: a harness that drives another one, and the handoff on the result (#232)
f1b69ab github-actions[bot] committed 2 months ago
benchmark: opencode's column re-run with its reasoning counted (#216); rule 4 covers output
d50c67c Hao Lu committed 2 months ago
benchmark: the first column, fifty tasks by four harnesses; a task that fails its own grader is left out
860c7e2 Hao Lu committed 2 months ago
benchmark: the provider-failure streak has its own lock; a note on the run goes under the table
f3aa0f1 Hao Lu committed 2 months ago
benchmark: a provider's refusal is re-run, not scored, and three in a row halt the run
bbef56c Hao Lu committed 2 months ago
benchmark: plain-words prompts, a lookup on the machine is a finding, and a time cap per task
2e6d85e Hao Lu committed 2 months ago
benchmark: a session is found by the head of its stored prompt, which the list truncates
3af27a9 Hao Lu committed 2 months ago
benchmark: failed tool calls from the stored trace, and wall time summed per row
ac5f838 Hao Lu committed 2 months ago
benchmark: a dimension beside the matrix, harness x model on public task suites
7ce16e5 Hao Lu committed 2 months ago
gateway: TypeSafe AI as a provider for the System One base (#230)
75c79e5 github-actions[bot] committed 2 months ago
systemone: the mark fills its box like the other base logos (#226)
255f53c github-actions[bot] committed 2 months ago
harness: System One, a decision loop over a typed action space (systemone, fifteenth base) (#225)
690278c github-actions[bot] committed 2 months ago
gateway: an upload is served to its owner only; an unknown file_id is a 404 (#222)
f5f123f github-actions[bot] committed 2 months ago
openhands: a new backend, driven through its maintained agent-server (1.49.2) (#215)
97e247f ZixiaoL committed 2 months ago
aider: the edit and shell strippers take fences of any length (#221)
61d1441 github-actions[bot] committed 2 months ago
aider: one nudge when a reply announces work and does none; the driver's verdict is the verdict (#220)
9cec07c github-actions[bot] committed 2 months ago
aider: a turn that ended on a command says so rather than saying nothing (#219)
9f49a85 github-actions[bot] committed 2 months ago
ci: the conformance job installs the build tools its distribution tests need (#218)
46ebe51 github-actions[bot] committed 2 months ago
conformance: the protocol schema ships inside the package, and the harness is resolved before the first task (#217)
fc520ab Yominma committed 2 months ago
console: the gateway proxy waits as long as it declares, not undici's five minutes (#214)
8031f3c Hao Lu committed 2 months ago
runner: opencode's output is the visible text; add the reasoning it keeps apart (#216)
de145b6 Hao Lu committed 2 months ago
console: the Integrations page sits under Access as Bring Your Own Key (#213)
35c1178 github-actions[bot] committed 2 months ago