Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
Swift apple-silicongemmagemma4gemma4-26b-a4bgpgpullmllm-inferencelocal-aimacosmetalon-device-aion-device-llmswift
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| PrefillChunkScratch.swift 6.7 KB | ||
| PrefillRuntimeConfig.swift 11.8 KB | ||
| PrefillSpanIteration.swift 1.2 KB | ||