Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
Python calibrationclassificationdecision-modelhuggingfacejevmodernbertmultilingualnlppythonpytorchroutingtyped-decisionszero-shot
ci(evals): run the ONNX parity and demo-server suites in the weight lane
thread3d76c257fd2ec6
diff --git a/.github/workflows/evals.yml b/.github/workflows/evals.ymlindex 534d5e94..acebe4a6 100644--- a/.github/workflows/evals.yml+++ b/.github/workflows/evals.yml@@ -47,7 +47,9 @@ jobs:run: |python -m pip install --upgrade pippip install torch --index-url https://download.pytorch.org/whl/cpu- pip install -e . datasets+ # `onnx` for the torch/ONNX parity suite, `serve` + httpx for the demo-server+ # suite. Both download weights, which is why they live in this lane and not in PR CI.+ pip install -e ".[onnx,serve]" datasets httpx pytest- name: Evaluate the English checkpoint on MASSIVE Englishrun: |@@ -60,6 +62,21 @@ jobs:research/results/eval_english_51_languages.json \research/evals/thresholds.json+ # `tests/test_onnx.py` performs a real export and a numerical parity check, and the export+ # downloads `convaiinnovations/laya`; it is skip-guarded on `onnxruntime`, so no workflow+ # running it means torch<->ONNX parity and the dynamic-shape export (#695) have no automated+ # check anywhere while `AGENTS.md` presents the suite as the ONNX check. The weight-free+ # `tests/test_onnx_quantize.py` stays in the PR `onnx-export` job.+ - name: Torch/ONNX numerical parity+ run: python -m pytest tests/test_onnx.py -q++ # The demo server's renderer and escaping, and the `/health`, `/models`, `/presets` and `/gui`+ # wiring, are otherwise unguarded: no workflow referenced this suite, which by its own+ # comments is what caught the `None`-criteria and missing `python-multipart` bugs. It loads+ # the English weights only, which this lane has already downloaded.+ - name: Demo server smoke tests+ run: python tests/test_server_example.py+- name: Upload the reportif: always()uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7.0.1