Skip to content

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Commits on main

Add code-block copying and chat fixes for 0.9.4 (#195)
Andrey Mikhaylov committed 24 days ago
d994a65
77e8f9c
Support longer contexts and speed up full attention (#182)
Andrey Mikhaylov committed 1 month ago
37fd33f
cdaa282
4c6db1e
6c04401
614a8f6
Build on the Swift 6.2 toolchains the README promises (#162)
Andrey Mikhaylov committed 2 months ago
d50bf4f
Add retained-KV multi-turn chat to the Mac app (#160)
Andrey Mikhaylov committed 2 months ago
19730f8
Speed up prefill on pre-Apple10 Macs (#159)
Andrey Mikhaylov committed 2 months ago
ec8ad21
Size the server listen backlog to the connection cap (#153)
Andrey Mikhaylov committed 2 months ago
1206ff2
Add M5 Max MacBook Pro benchmark report (#154)
Andrey Mikhaylov committed 2 months ago
3ffc90f
Add optional Gemma 4 image support (#144)
Andrey Mikhaylov committed 2 months ago
fd3c0b8
Kickstart the decode service after launchd bootstrap (#126)
Andrey Mikhaylov committed 3 months ago
9df7b67
Add M2 Mac mini benchmark report (#135)
Andrey Mikhaylov committed 3 months ago
27a8b89
Allow one release of lag in the app version check (#130)
Andrey Mikhaylov committed 3 months ago
3e87d92
Skip directory entries that vanish during a scan (#129)
Andrey Mikhaylov committed 3 months ago
92c278f
Bump the app version to 0.4.3 (#127)
Andrey Mikhaylov committed 3 months ago
7dc8b59
Decode tokens incrementally and losslessly (#118)
Andrey Mikhaylov committed 3 months ago
acefaf1
Add M1 Air, M4 Pro, and M5 benchmark reports (#117)
Andrey Mikhaylov committed 3 months ago
524cdbe
Expose CLI runtime controls and harden Metal failures (#100)
Andrey Mikhaylov committed 3 months ago
417f389
Add M1 and M4 Mac mini benchmark reports (#96)
Andrey Mikhaylov committed 3 months ago
b6eaf02
Diagnose malformed server tool generations (#90)
Andrey Mikhaylov committed 3 months ago
3249be4
Share and harden the .gturbo v1 format contract (#87)
Andrey Mikhaylov committed 3 months ago
d56c808