Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
tuner: the GPU cache's 'resident experts' wording is not the low-RAM resident mode
aab3810 Niko1221 committed 1 month ago
app: Tune model dialog (real tuner, saved tunings, undo) reusing the Auto-tune look; its strings in separate catalogs
bd773bb Niko1221 committed 1 month ago
host: autotune and recheck operations, saved-tuning routes (Strata Control's tuner and presets, run on the config a load would use)
35cfd18 Niko1221 committed 1 month ago
docs/GYRO.md: setup is the install path, our measurements, credit and licenses; docs/MODELS.md lists Gyro-S and Gyro-M; tools/gyro_setup.sh (rc2's script) is replaced by setup
eaf8745 Niko1221 committed 1 month ago
tuner: waiting for the box lock does not count against the time budget; session tests
e6b3af5 Niko1221 committed 1 month ago
tuner: a queued kernel flock for the box lock, so other streams' waiters are served in order
3312093 Niko1221 committed 1 month ago
tuner: memory and quiet checks run inside the box lock right before each start
bb33349 Niko1221 committed 1 month ago
auto-tuner: single-knob candidates from the measured spec, interleaved rounds with noise and drift guards, memory guards, saved presets (one store for CLI and app), re-check, strata tune auto / strata presets
f23eda8 Niko1221 committed 1 month ago
serve: Anthropic thinking.budget_tokens is a thinking budget too; docs for the answer room and the budget; test
194c268 Niko1221 committed 1 month ago
serve: max_tokens counts the thinking - without a budget, thinking is closed early enough to leave a quarter of the cap for the answer (cap 8192 cut the thinking off with no answer); config answer_room:false opts out; tests
d0e990b Niko1221 committed 1 month ago
tasks run as the agent in their own session under a per-task mode, with a plain result and a notification; task editor and toast strings in all eight languages
158a42d Niko1221 committed 1 month ago
agent: output budget for a local model is the window (was 8192), the Reasoning menu reaches the request, fit_max_tokens for app-loaded models, plain outcome for silent commands
be1a871 Niko1221 committed 1 month ago
Gyro: the MCP recommendation asks 4 GB of room beside the memory figure; tests for the Gyro catalog
5e33c4e Niko1221 committed 1 month ago
stage-harness: flatten pnpm's links into one real folder per package (the installer copies files)
b74d6ad Niko1221 committed 1 month ago
setup: a tip for Gyro installs on the ready-made engine (the fork's prompt kernels need a source build)
375f76f Niko1221 committed 1 month ago
Gyro: the Hadamard row kernels go up in slices of 65535 rows (gridDim.y limit): the FP16 prompt path rotates T*K rows, which a 16K-token chunk takes past it (invalid configuration argument on a build without the fork's MMQ)
02bbf51 Niko1221 committed 1 month ago
web: the page sends no sampling until the user changes it, so the server's model-card defaults apply (stored 0.6 counts as not set); test (#2685)
e863486 Niko1221 committed 1 month ago
desktop: ship the staged Harness as resources/harness (built by stage-harness.mjs)
9459716 Niko1221 committed 1 month ago
Metal: stubs for the Gyro Hadamard entry points (the engine does not run trellis experts; native_expert_supported refuses them at load)
365c60e Niko1221 committed 1 month ago
Gyro: the CPU trellis rows build for arm64 (scalar kernel; the AVX units are x86-only) and the Metal build lists hadamard.cpp and tq_cpu.cpp
34204c4 Niko1221 committed 1 month ago
pin budget: CUDA-on-Windows default only (the HIP build keeps its pinning), docs/DETAILS.md
805a308 Niko1221 committed 1 month ago
serve: a request with no sampling gets the model card's (thinking 1.0/0.95/20; not thinking 0.7/0.8/20 + presence 1.5; Qwen3.6 too); greedy only when asked (#2685)
a8091f4 Niko1221 committed 1 month ago
packaging: recipe and table row for the gfx1103 (Radeon 780M) Linux HIP engine package
ff14364 Niko1221 committed 1 month ago
host: one automatic safer second try when the engine dies while loading (smaller pin / RAM budget), said in plain words and not saved; Leave 20% also sets the engine's own RAM headroom
4e67f1f Niko1221 committed 1 month ago
Gyro: native_fmt knows the trellis types' geometry itself, so a ggml built from upstream (no such types; its type table is indexed by the id) is never asked about them
e1d11fe Niko1221 committed 1 month ago