Skip to content

The 80B Qwen3-Coder-Next on a 16 GB Mac, about 13 tok/s, fully offline. A mixture-of-experts inference engine for Apple silicon.

Rust

Commits on main

Cargo.lock: the three workspace crates
1picassoai committed 1 month ago
764a032
README: state the 16K conversation limit
1picassoai committed 1 month ago
ee0055d
README: ask people to report how it ran
1picassoai committed 1 month ago
a484f29
README: questions and ideas go to issues
1picassoai committed 1 month ago
62ac7ac
Coachwhip v0.2.0: an OpenAI-compatible door
1picassoai committed 1 month ago
bd69a85