Skip to content

armgit / laya

Public Imported from GitHub
0

Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.

test(evals): tolerances for the scheduled regression gate

Emiliano Gandini Outedaa7d912acb03a
diff --git a/research/evals/thresholds.json b/research/evals/thresholds.json
new file mode 100644
index 00000000..ee37baef
--- /dev/null
+++ b/research/evals/thresholds.json
@@ -0,0 +1,9 @@
+{
+ "comment": "Absolute drift allowed against research/results/eval_english_51_languages.json in the scheduled gate. Derived from that baseline with headroom for run-to-run noise; tighten only with a measured run.",
+ "languages": ["en"],
+ "tolerance": {
+ "accuracy": 0.02,
+ "ece": 0.03,
+ "mean_confidence": 0.03
+ }
+}