Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

Add qpack inspection utility
Léon Avic Simmons committed 2 months ago
2c8c629
Add strict qpack expert reader
Léon Avic Simmons committed 2 months ago
843b8ad
Add packed affine Metal GEMV path
Léon Avic Simmons committed 2 months ago
f118f54
Add MLX affine quantization reference contract
Léon Avic Simmons committed 2 months ago
3233311
Fix duplicate entries in deepseek-v4 documentation
Muhammad Jamshaid Iqbal committed 1 month ago
75acdbe
api: refuse unsupported OpenAI result shaping
Benito Mallamaci committed 1 month ago
5ceed4b
Merge pull request #1780 from JustVugg/feat/qwen-image
Vincenzo Fornaro committed 1 month ago
6ef7c85
9f86874
9fd6d15
a13dd0e
fix(olmoe): use portable RAM probe in hwinfo
Cometbuster4969 committed 1 month ago
e170d97