Skip to content

armgit / laya

Public Imported from GitHub
0

Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.

fix(ci): pin tokenizer version for reproducible parity tables

debjyotikmcb78bbf82bf0
diff --git a/laya-dotnet/tools/requirements-regen.txt b/laya-dotnet/tools/requirements-regen.txt
index 28e3a815..ba2b63a5 100644
--- a/laya-dotnet/tools/requirements-regen.txt
+++ b/laya-dotnet/tools/requirements-regen.txt
@@ -7,6 +7,9 @@
# torch is not listed: it needs the CPU-only index, so install it first with
# pip install "torch==2.14.0" --index-url https://download.pytorch.org/whl/cpu
transformers==5.17.0
+# Java's generated pre-tokenizer tables record this version as well as its Unicode classes.
+# Keep the shared regeneration toolchain aligned with that committed reference.
+tokenizers==0.23.2
safetensors==0.8.0
huggingface_hub==1.33.0
numpy==2.5.3