Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
Python calibrationclassificationdecision-modelhuggingfacejevmodernbertmultilingualnlppythonpytorchroutingtyped-decisionszero-shot
Commits on main
fix(serve): split an oversized batch across forward passes instead of collating it whole
df3e285 Adeshina Lasisi committed 1 month ago
test(serve): record repeated MPS unload and shared-MCP measurements
bbaec3a Rishit Sharma committed 1 month ago
feat(nix): expose idle checkpoint unloading in the HTTP service
59a2bea Rishit Sharma committed 1 month ago
docs(mcp): make the shared-server setup link work outside GitHub
27e6281 Rishit Sharma committed 1 month ago
feat(mcp): share a local model server through LAYA_BASE_URL
c8ddefa Rishit Sharma committed 1 month ago
feat(serve): unload idle checkpoints on the inference worker
81b3af8 Rishit Sharma committed 1 month ago
fix(router): release Metal cache after checkpoint unload and eviction
6b87cb7 Rishit Sharma committed 1 month ago
fix(calibrate): skip global binning under lang temperature override
c7cde45 Bruce-Yii committed 1 month ago
fix(calibrate): bin runtime confidences at full precision and validate bin values
3214857 Bruce-Yii committed 1 month ago
feat(calibrate): wire histogram binning into answers and the calibration payload
2555c88 Bruce-Yii committed 1 month ago
fix(dotnet): return rendered criterion text in score legends
2d7a307 kevin-gatimu committed 1 month ago
fix(dotnet): report surviving options and actual sequence budget
6c6cca7 kevin-gatimu committed 1 month ago
fix(dotnet): preserve email requests and match current client markers
be14e6b kevin-gatimu committed 1 month ago
fix(dotnet): match Python default and mixed-language route reasons
f3a4fce kevin-gatimu committed 1 month ago
fix(dotnet): match current Python language detection rules
3638a07 kevin-gatimu committed 1 month ago
ci(dotnet): regenerate goldens from Python and run parity tests on every push
8ccaf96 kevin-gatimu committed 1 month ago
feat(dotnet): add embedding shortlist for high-cardinality choice
99e0478 kevin-gatimu committed 1 month ago