A high-performance inference engine for AI models
Mirai
Desktop chat app for local LLMs on the uzu engine. Tauri v2, React, Rust.
Requirements
- macOS 26.4 or newer, Apple silicon
- Xcode 26 with the Metal toolchain (
xcodebuild -downloadComponent MetalToolchain) - rustup; the first
cargorun installs the nightly toolchain pinned byrust-toolchain.tomlat the repository root - Node.js 26 or newer and pnpm (
corepack enablepicks the version frompackage.json)
Run
pnpm install
pnpm dev # desktop app; the first build also compiles the engine and its Metal shaders, later builds are incremental
pnpm build # .app and .dmg in ../../target/aarch64-apple-darwin/release/bundle/, ad-hoc signed
pnpm web:dev # frontend in a browser without the engine: no models, no chats
pnpm check runs typecheck, ESLint, client tests, clippy and Rust tests;
pnpm format runs Prettier.
Preview a fresh start
Quit Mirai, the CLI, and other apps using the shared model cache. From the repository root, move the current state into a new backup directory:
python3 scripts/mirai-data.py backup ~/mirai-preview-backup
This moves chats, settings, logs, the model cache, and Mirai's WebView data
aside. Add --keep-cache to leave ~/.cache/mirai available, for testing a
fresh app with existing models. Moves require the backup and data to be on
the same filesystem; model files are not copied.
After testing, quit the app and restore:
python3 scripts/mirai-data.py restore-overwrite ~/mirai-preview-backup
Restore replaces the test state and consumes the backup. If the backup used
--keep-cache, restore leaves the current cache untouched, including models
downloaded during testing. No live data is changed if the backup is incomplete.
Signed builds without a release
In GitHub Actions, open Build / release mirai-gui, choose Run workflow, and select the branch to build. GitHub requires repository write access to run it manually; the workflow must be on the default branch for the button to appear.
Download the mirai-macos-… artifact from the completed run. It contains the
Apple-signed app in a notarized DMG, plus the app archive and updater signature, and
is retained for 14 days. The app and bundled CLI are built from the selected
commit using its existing version. Manual runs do not create a release or tag,
change versions, or publish an updater manifest.
These builds use the normal Mirai app identity, local data, and release update feed; installing one replaces the regular app. Published engine releases still use this workflow to build and publish the app automatically.
Layout
client/src/ React app, shared by desktop and web
components/ app shell, icons and generic UI primitives (components/ui)
features/ chat, chat-history, local-models, settings, runtime; each owns its page
routes/ thin TanStack route glue
platform/ platform contract + tauri/web adapters, the only way to the backend
stores/ zustand stores
styles/ theme.css: the palette, light values in @theme, dark ones in .dark
desktop/src/ Rust backend: engine, chat, downloads, storage
Inter and Geist Mono are bundled under the SIL Open Font License; license texts
are in client/public/fonts/.