Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
Swift apple-silicongemmagemma4gemma4-26b-a4bgpgpullmllm-inferencelocal-aimacosmetalon-device-aion-device-llmswift
Commits on main
Add code-block copying and chat fixes for 0.9.4 (#195)
d994a65 Andrey Mikhaylov committed 24 days ago
Protect decode-service writes during teardown and bump version to 0.9.3 (#192)
2e9ea50 Andrey Mikhaylov committed 1 month ago
Add selectable model locations and a self-built Mac app bundle (#191)
4d54604 Andrey Mikhaylov committed 1 month ago
Fix SwiftUI macro compatibility for Command Line Tools builds (#186)
77e8f9c Andrey Mikhaylov committed 1 month ago
Support longer contexts and speed up full attention (#182)
37fd33f Andrey Mikhaylov committed 1 month ago
Add Mac text-size settings and open an empty chat on launch (#179)
cdaa282 Andrey Mikhaylov committed 2 months ago
Add Mac conversation history and bump version to 0.8.0 (#174)
4c6db1e Andrey Mikhaylov committed 2 months ago
Refuse unknown request fields, accept auto as the prefill cap (#171)
6c04401 Andrey Mikhaylov committed 2 months ago
Render server flag rejections from the lists the guards test (#165)
614a8f6 Andrey Mikhaylov committed 2 months ago
Build on the Swift 6.2 toolchains the README promises (#162)
d50bf4f Andrey Mikhaylov committed 2 months ago
Add retained-KV multi-turn chat to the Mac app (#160)
19730f8 Andrey Mikhaylov committed 2 months ago
Size the server listen backlog to the connection cap (#153)
1206ff2 Andrey Mikhaylov committed 2 months ago
Render the transcript natively: tables, code, HTML-lite, math, progressive streaming (#148)
d20d0df Andrey Mikhaylov committed 2 months ago
Give every adapted object tool-schema node an explicit properties mapping (#142)
972226a Andrey Mikhaylov committed 3 months ago
Add M2 Pro MacBook Pro benchmark report and bump the app version to 0.4.5 (#141)
c136f27 Andrey Mikhaylov committed 3 months ago
Kickstart the decode service after launchd bootstrap (#126)
9df7b67 Andrey Mikhaylov committed 3 months ago
Allow one release of lag in the app version check (#130)
3e87d92 Andrey Mikhaylov committed 3 months ago
Skip directory entries that vanish during a scan (#129)
92c278f Andrey Mikhaylov committed 3 months ago
Add About panel and Finder reveal, server runtime flags, and SwiftNIO 2.101.3 (#124)
903c7bf Andrey Mikhaylov committed 3 months ago
Expose CLI runtime controls and harden Metal failures (#100)
417f389 Andrey Mikhaylov committed 3 months ago
Share and harden the .gturbo v1 format contract (#87)
d56c808 Andrey Mikhaylov committed 3 months ago