The 80B Qwen3-Coder-Next on a 16 GB Mac, about 13 tok/s, fully offline. A mixture-of-experts inference engine for Apple silicon.
Rust
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| load_models.sh 1.1 KB | ||
| same_answers.sh 1.3 KB | ||
The 80B Qwen3-Coder-Next on a 16 GB Mac, about 13 tok/s, fully offline. A mixture-of-experts inference engine for Apple silicon.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| load_models.sh 1.1 KB | ||
| same_answers.sh 1.3 KB | ||