The 80B Qwen3-Coder-Next on a 16 GB Mac, about 13 tok/s, fully offline. A mixture-of-experts inference engine for Apple silicon.
Rust
Releases 0
There are no releases yet
Releases package a version of the project with notes and downloadable files.