Skip to content

The 80B Qwen3-Coder-Next on a 16 GB Mac, about 13 tok/s, fully offline. A mixture-of-experts inference engine for Apple silicon.

Rust

tests-mac: scripts are executable in git, so a fresh clone can run them

1picassoaia0aaa86b9079
diff --git a/tests-mac/load_models.sh b/tests-mac/load_models.sh
old mode 100644
new mode 100755
diff --git a/tests-mac/same_answers.sh b/tests-mac/same_answers.sh
old mode 100644
new mode 100755