Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
Merge f-027-gh-eng-d again (9d85432b8: QFUSE one-token self-commit)
1c2efd7 Niko1221 committed 24 days ago
Merge f-027-gh-eng-lm up to 0c7de9868 (#3976 layer-major split prefill, opt-in: STRATA_PREFILL_LAYER_MAJOR=1)
0d4b2cd Niko1221 committed 24 days ago
STRATA_QFUSE=1: a one-token window did not self-commit, but commit() skipped the commit graph as if it had (#3948)
789d839 Niko1221 committed 24 days ago
Merge f-027-gh-eng-d (#3602 #3948 #3638 #3702 #3797 #2409 #3844: audits, fixes and tests)
9c624c7 Niko1221 committed 24 days ago
PLE table: STRATA_PLE_CHECK=1 names the first row that decodes to an implausible value and says whether the delivered bytes are the file's (#3602)
8dd297d Niko1221 committed 24 days ago
QFUSE: the fused q8_1 producers divide the way the separate quantiser does; they gave a different code at about one element in a million (#3948)
7d1016f Niko1221 committed 24 days ago
Presets: a value outside the range the tuner tries is kept with a warning, not dropped (#3844)
e0d4703 Niko1221 committed 24 days ago
Conversation cache: skip a restore only when a card would have to create its copy stream and has no room for it (#2409)
8c03014 Niko1221 committed 24 days ago
Later-card VRAM: audit fixes for failed allocations, the reserve arithmetic as a tested helper, a per-card out-of-memory report (#3638 #3702 #3797)
2a9a67c Niko1221 committed 24 days ago
tests: STRATA_QFUSE parity for a window of two groups and for the GDN q8_1 destination (#3948)
11b0490 Niko1221 committed 24 days ago
PLE reader: a failed read no longer leaves the next ticket waiting for ever; stress test for the direct table reader (#3602)
ebe3383 Niko1221 committed 24 days ago
Merge f-027-gh-eng-a (#3622 ARM64 / DGX Spark port, #3806 Gyro-L TQP5/6/7)
ba8b2bc Niko1221 committed 24 days ago
Gyro-L: read the pair-trellis types TQP5/TQP6/TQP7 (ggml 147-149) on the CPU, CUDA and the MMQ prompt path (#3806)
38b0631 Kevin Read committed 24 days ago
Merge f-027-gh-eng-m (#3416 gated MTP: opt-in proposal law, window-invariant CPU dispatch, draft policy)
1e57a92 Niko1221 committed 24 days ago
spec: a gated request's lookup policy learns from committed rounds only, DraftPolicy choose() unchanged otherwise (#3416)
ca17d0f Keyan Hu committed 24 days ago
native experts: window-invariant CPU arithmetic for STRATA_SPEC_PROB decode, Default dispatch unchanged (#3416)
499e963 Keyan Hu committed 24 days ago
spec: STRATA_SPEC_PROB=1 keeps the confidence gate in the proposal law, opt-in (#3416)
f4612b1 Keyan Hu committed 24 days ago
docs: release notes - split serving (#4000) filled from docs/SPLIT_SERVE.md: opt-in, exact, slower than the layer split on two A6000, credit to MarcoTool
9ac278e Niko1221 committed 24 days ago
Merge f-027-split: split serving (#4000), opt-in, first version
ccf18ea Niko1221 committed 24 days ago
Split serving: docs with the measured results, check tool no longer hashes the state in speed runs
3480bf2 Niko1221 committed 24 days ago
docs: the KVA opt-in is split 36, final (the split 24 variant is a 0.2.8 study); release notes marker closed
597df5e Niko1221 committed 24 days ago
docs: the 1.5 route prior check - all five tasks the grader failed were read: three were grader flags, two were the long-winded answers
1b89043 Niko1221 committed 24 days ago
docs: release notes 0.2.7 draft, audit fixes of the engine review and the decision markers brought up to date
1297394 Niko1221 committed 24 days ago
docs: the route prior stays at 1.5 after the 61-task check on the RTX 3060 (DETAILS.md and the 0.2.7 release notes)
8191cb9 Niko1221 committed 24 days ago
docs: release notes 0.2.7 draft (every merged item and the owner decisions of 26-27 October, measured numbers per box, markers for what is still pending)
fb8f7d9 Niko1221 committed 24 days ago
Docker docs, compose defaults, scripts and the file test name the 0.2.7 image tags (0.2.7-cuda13 and the other flavors)
df20d77 Niko1221 committed 24 days ago
layer-major prefill: declines on STRATA_EXPERT_NIBBLE builds (#3976)
9e20319 Niko1221 committed 24 days ago
Merge f-027-gh-eng into f-027-gh-eng-pm (#4121 on top of the #4010 pipelined adaptive rounds)
bd8a254 Niko1221 committed 24 days ago
Build the engine for ARM64 (DGX Spark / GB10) without changing the x86 build (#3622)
a4c41a9 ferstar committed 24 days ago