Skip to content

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

C++

nvfp4_local_pack ple: accept a folder with only the shards that hold the table

Niko1221ade3e6adb55b
diff --git a/tools/nvfp4_local_pack.py b/tools/nvfp4_local_pack.py
index 5539cd432..a00b1145e 100644
--- a/tools/nvfp4_local_pack.py
+++ b/tools/nvfp4_local_pack.py
@@ -291,7 +291,7 @@ def interleave_rows(codes: np.ndarray, scales: np.ndarray) -> np.ndarray:
def cmd_ple(a) -> int:
model, out = pathlib.Path(a.model), pathlib.Path(a.out)
- ck = Checkpoint(model)
+ ck = Checkpoint(model, partial_ok=True) # the table is in six of the shards; a folder with only those works
shards = {}
for name in ck.meta:
if ".ngram_embedding.shard_" in name and name.endswith(".weight"):