Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
dsv41: tq_convert.py (re-encode a pack's MXFP4 experts with the trellis encoder into the engine's file layout) and pack_gguf --tq-experts
7df8276 Niko1221 committed 1 month ago
docs: reorder the placement section (threads that are not pinned, then the numbers)
c5eb2dd Niko1221 committed 1 month ago
Merge f-022-pascaltq: Gyro trellis kernels about 30% faster on Pascal (sm_60), other cards unchanged
8894299 Niko1221 committed 1 month ago
tq_pascal_bench: other expert geometries (a longer hidden row, shorter experts) against the per-column kernels
9b5b758 Niko1221 committed 1 month ago
Merge f-022-dlintegrity: every ranged answer is checked (206, Content-Range, length, ETag), full writes, safe resume, and a SHA mismatch repairs only the differing parts instead of deleting the file
29c8112 Niko1221 committed 1 month ago
Gyro decode (CUDA): trellis codebook in shared memory, 8-lane rows for the 160-dot gate/up and the 40-dot down
5f81c5d Niko1221 committed 1 month ago
Test: Gyro-S and Gyro-M are in the Mac model list now (Mac Gyro support)
cbf7f1d Niko1221 committed 1 month ago
Merge f-dsv41-enc (trellis encoder, K4/K5 computed-code types 224/225, table versions 226/227) into f-dsv41-port; conflicting trellis files taken from f-dsv41-enc
d6a6c1c Niko1221 committed 1 month ago
Merge f-022-fitauto: a model just short of fitting gets a smaller context / reserve / prompt chunk automatically (Gyro-M on 8 GB Arc)
4e83ef0 Niko1221 committed 1 month ago
Fit rule for cards that are just short: lower context, reserve and prompt chunk until the start fits (Gyro-M on the 8 GB Arc A750)
34d7b2a Niko1221 committed 1 month ago
Merge f-022-macgyro: Gyro-S and Gyro-M on Apple Silicon (Metal trellis kernels, Gyro dense tiles)
31fa54f Niko1221 committed 1 month ago
Docs: Gyro-S on the Mac against the CUDA engine (KL at the CUDA noise level)
bc3f293 Niko1221 committed 1 month ago
Merge f-022-int into f-022-macgyro: Gyro is listed as supported on Intel Arc and on the Mac (docs, seven READMEs, release notes keep both bullets)
21b0fdb Niko1221 committed 1 month ago
Merge f-022-arcgyro: Gyro-S and Gyro-M on Intel Arc (SYCL trellis kernels, Hadamard, XMX prompt path)
564d0ab Niko1221 committed 1 month ago
--pool-cores: a list of more than 4096 processors is refused by the parser (with a message; the pool then keeps its default placement)
c4f1e05 Niko1221 committed 1 month ago
dsv41: picture test (mkimg.py) and serve_prompts GENI / text output
e380257 Niko1221 committed 1 month ago
CPU pool: read the logical-processor layout when the pool is built
e2b4464 Niko1221 committed 1 month ago
start-up: no 'workers by default' line when --pool-cores gave the list (its own line says where they run)
10edc50 Niko1221 committed 1 month ago
docs: Gyro on Intel Arc (GYRO.md, INTEL.md, release notes 0.2.2)
f353087 Niko1221 committed 1 month ago
Gyro on Intel Arc: README and MODELS say so, ctest cases for the trellis kernels, setup's Gyro memory warning reads the real RAM on the Intel path
79946b9 Niko1221 committed 1 month ago
dsv41: gfx12 WMMA trellis GEMV (ds4_tqw.cuh, from the CUDA lab's recipe) with a parity + bench test: all K4-K7, widths 1/3/5, table and computed codes within 8e-8 of the double reference on the R9700; ~1.07 Tw/s
3d8d107 Niko1221 committed 1 month ago
docs: the CPU picture encoder stays where the OS puts it (pinning it one per core was 7 to 19 times slower on a 16-core Windows PC)
4cb96ac Niko1221 committed 1 month ago
trellis: computed codebook on the GPU encoder, README for the K5/K4 versions
2713121 Niko1221 committed 1 month ago
Docs: Gyro on the Mac (MAC.md, GYRO.md, MODELS.md, README, 0.2.2 release notes)
ca40c88 Niko1221 committed 1 month ago