Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
Engine for the DGX Spark: the arm64 CUDA build on top of #3622
f262b81 Niko1221 committed 23 days ago
DeepSeek Metal port: keep the CUDA/HIP paths as in 0.2.7 (chunk-path hc mix through cuBLAS, async embedding upload, no extra h16 rows, no diagnostics on hot paths, type_on_chunk true off Metal)
56ab127 Niko1221 committed 23 days ago
launch header: exl3.cu includes it for every backend; exl3_cpu kGemmK only off x86
5ed8ae0 Niko1221 committed 23 days ago
DeepSeek on Metal: compile fixes on the 0.2.7 tree (huge pages, wmma include, DeviceProp.integrated, iq256x stubs)
7563803 Niko1221 committed 23 days ago
metal: the host sources no longer list iq256_portable.cpp (portable.cpp answers for non-x86 hosts)
314a6ec Niko1221 committed 23 days ago
Release notes 0.2.7: update, tray and speed lines confirmed on the release packages; Strix Halo guide names the prompt used for the 4K row
5e8a4cc Niko1221 committed 23 days ago
Version 0.2.7: Terminal and app 0.2.7, engine and Control 0.1.52 (every Qwen and DeepSeek package, Metal included; both engines changed since 0.2.6)
a42cc3d Niko1221 committed 24 days ago
docs: release notes 0.2.7 - two-card pipelined default (owner choice a), DeepSeek pictures by default, the shard 1 setup fix
5a843fd Niko1221 committed 23 days ago
Merge f-027-dsvis: DeepSeek reads pictures by default (owner yes), and setup accepts ISTA's re-published shard 1
e6d5d76 Niko1221 committed 23 days ago
Merge two-card batch default (owner choice a): two NVIDIA cards pipeline by default
2526f2f Niko1221 committed 23 days ago
setup: accept the DeepSeek shard 1 with ISTA's 2026-10-26 chat template from files already here
94d7aab Niko1221 committed 23 days ago
launch: the model state's DeepSeek check tolerates a catalog without the strata table (test_model_folder_case)
1bd17d5 Niko1221 committed 23 days ago
DeepSeek pictures: the Terminal's pictures step knows the tower is part of the engine (no reader lookup, no GPU/CPU reader choice), and a DeepSeek start without pictures answers a picture request with its own 400 wording
c451698 Niko1221 committed 23 days ago
generate: the gated-proposal check reads use_df2 only where the DFlash2 drafter is built (the Metal build has none; #3416 broke its compile)
4c7bce3 Niko1221 committed 23 days ago
docs: release notes - the two-card batch default marker uses the owner's labels (a) pipelined by default, (b) pipelined only when every expert fits, (c) leave serial; the serial against pipelined numbers are batch scheduling without drafting
8dce24a Niko1221 committed 23 days ago
docs: release notes 0.2.7 - the engine items from f-027-gh-eng filled in (layer-major prefill on by default for a two-card CUDA split, pipelined drafts opt-in, sm_80 and sm_89 defaults, audit fixes, opt-in switches), markers closed except the owner's two-card batch choice
12d0f0a Niko1221 committed 23 days ago
Merge release-notes update: route prior 1.5 wording with the agent-loop caveat
ac19fec Niko1221 committed 23 days ago
docs: route prior 1.5, final verdict of the 80-task check on the RTX 3060 (no copy or code errors; agent loops may finish slightly less often, within the run-to-run spread), speed and the off switch
c41bd44 Niko1221 committed 23 days ago
native experts: the window-invariant reference rows are used only where they match the linked ggml dot (#3416)
447460e Niko1221 committed 23 days ago
batch groups: two NVIDIA cards pipeline by default; the serial group is opt-in (STRATA_BATCH_GROUPS_NV_SERIAL=1, STRATA_DEFAULTS=026)
ec8e405 Niko1221 committed 23 days ago
release notes 0.2.7: layer-major prefill (on by default on a CUDA layer split) and pipelined drafts filled in
5ac66e5 Niko1221 committed 23 days ago
Merge f-027-gh-eng-pm (#4121 MTP drafts in pipelined slots, opt-in STRATA_PIPED_MTP)
5cfa395 Niko1221 committed 23 days ago
docs: STRATA_PIPED_MTP on 2x RTX A4000 (Q2_0): =1 is the setting to use; =2 is slower than no drafts at 4 streams there (#4121)
f656a72 Niko1221 committed 23 days ago