Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
docs: build from git on Linux (clone, setup, rebuild, trying a pull request, engine env, the monitor from a checkout, plain cmake) (#3191)
Niko12219cc2a9b6aac7
diff --git a/docs/DETAILS.md b/docs/DETAILS.mdindex cd997377d..86859cbc4 100644--- a/docs/DETAILS.md+++ b/docs/DETAILS.md@@ -676,6 +676,7 @@ The same questions, the same automatic install (it uses `sudo apt` for Python anfor the build tools), and the same start: `http://127.0.0.1:8080`. Later runs of `./setup.sh` (or `./run-<model>.sh`)start the model directly. Options as on Windows (`./setup.sh --setup`, `--model Q2_0 --yes`, `--gguf-dir /data/Q2_0`).Terminal chat: `.venv/bin/python chat.py`.+Building from git, trying a pull request, the monitor from a checkout: [INSTALL.md](INSTALL.md#build-from-git-on-linux-to-try-a-pull-request-or-change-the-code).- **Updating:** `git pull`, then `./setup.sh`: it compiles the engine again when its source changed (a minute ortwo for the changed files). If that compile fails, it says so and starts the engine you had.diff --git a/docs/INSTALL.md b/docs/INSTALL.mdindex 6b3426ed0..b0edc59e7 100644--- a/docs/INSTALL.md+++ b/docs/INSTALL.md@@ -12,7 +12,7 @@ There are three ways to install it. Take the first one unless you have a reasonfetches the engine itself.> **On this page:** [What you need](#what-you-need) · [The app](#the-app) · [The Terminal](#the-terminal) ·-> [From source: Windows](#from-source-windows) · [Linux](#from-source-linux) · [Mac](#from-source-mac) ·+> [From source: Windows](#from-source-windows) · [Linux](#from-source-linux) ([build from git](#build-from-git-on-linux-to-try-a-pull-request-or-change-the-code)) · [Mac](#from-source-mac) ·> [AMD cards](#amd-cards) · [Several cards](#two-or-three-cards) · [Docker](#docker-linux) ·> [Older CPUs](#older-cpus-experimental) · [Updating](#updating) · [Where things are stored](#where-things-are-stored) ·> [Setup's questions](#setups-questions) · [Tuning](#tuning-for-your-pc) · [All options](#options-without-questions)@@ -150,6 +150,41 @@ On Nix/NixOS, you can use the flake:nix develop -c ./setup.sh```+### Build from git on Linux (to try a pull request or change the code)++You do not need the app or the AppImage for this: the source install builds the engine on your PC and keeps+everything in the checkout, so you can edit, rebuild and test.++```bash+git clone https://github.com/Niko1221/Strata.git && cd Strata+./setup.sh # first run: .venv, the engine build (build/, or build-hip/ on a Radeon), the model, then it serves+```++- **What it needs:** `git`, a C++ compiler and `cmake` (setup installs the build tools through `sudo apt` on+ Debian and Ubuntu; elsewhere install them first), and the CUDA Toolkit for NVIDIA or ROCm with the HIP compiler for+ a Radeon card ([AMD_HIP.md](AMD_HIP.md)). Python goes into `.venv` of the checkout.+- **After you change the code:** run `./setup.sh` again. It compiles only what changed and starts the model. To+ update without starting: `git pull`, then `./update.sh`. By hand, the build folder is an ordinary CMake build:+ `cmake --build build --target strata -j8` (`build-hip` for a Radeon card; the options are in+ [AMD_HIP.md](AMD_HIP.md)).+- **To try a pull request:** `git fetch origin pull/<number>/head:pr-<number> && git checkout pr-<number>`, then+ `./setup.sh`. `git checkout main` goes back; the next `./setup.sh` rebuilds.+- **Settings for the engine** (for example `STRATA_HIPBLASLT_TUNING=/path/to/table.txt`) go into the `"env"` object of+ `strata-<model>.json`, which `./setup.sh` writes next to the checkout. `./run-<model>.sh` starts the model with it.+- **The Terminal monitor from a checkout:** the monitor needs one extra package, which the source install does not+ put into `.venv`:++ ```bash+ .venv/bin/pip install -r requirements-monitor.txt+ STRATA_PYTHON="$PWD/.venv/bin/python3" bin/strata monitor --url http://127.0.0.1:8080+ ```++ (`bin/strata` is the same `strata` command as the Terminal's: `bin/strata --help` lists the rest.)+- **Only compile, without the installer:** the engine is a normal CMake project. For NVIDIA:+ `cmake -S . -B build -DCMAKE_BUILD_TYPE=Release -DSTRATA_ENABLE_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES=native &&+ cmake --build build --target strata -j8`. The options, and the flags setup passes, are in `setup.py` (search for+ `-DSTRATA_`).+## From source: MacOn an Apple Silicon Mac with macOS 15 or newer, install Apple's Command Line Tools once (`xcode-select --install`),