Skip to content

The 80B Qwen3-Coder-Next on a 16 GB Mac, about 13 tok/s, fully offline. A mixture-of-experts inference engine for Apple silicon.

Rust
108 B
Raw Blame
//! Coachwhip's doors: the chat page and the OpenAI-compatible API, served on loopback only.

pub mod chat;