Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
nvfp4_local_pack ple: accept a folder with only the shards that hold the table
Niko1221ade3e6adb55b
diff --git a/tools/nvfp4_local_pack.py b/tools/nvfp4_local_pack.pyindex 5539cd432..a00b1145e 100644--- a/tools/nvfp4_local_pack.py+++ b/tools/nvfp4_local_pack.py@@ -291,7 +291,7 @@ def interleave_rows(codes: np.ndarray, scales: np.ndarray) -> np.ndarray:def cmd_ple(a) -> int:model, out = pathlib.Path(a.model), pathlib.Path(a.out)- ck = Checkpoint(model)+ ck = Checkpoint(model, partial_ok=True) # the table is in six of the shards; a folder with only those worksshards = {}for name in ck.meta:if ".ngram_embedding.shard_" in name and name.endswith(".weight"):