Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
docs: reword malloc_trim comment
iiEliJasc84812329077
diff --git a/c/colibri.c b/c/colibri.cindex 811dceb5..cc3253b8 100644--- a/c/colibri.c+++ b/c/colibri.c@@ -8455,7 +8455,7 @@ static void rss_guard(Model *m){if(dropped)fprintf(stderr,"[RAM-GUARD] RSS %.1f GB over the %.1f GB budget (#403): ""dropped %d cached experts, cap -> %d\n", rss, lim, dropped, m->ecap);-/* musl lacks malloc_trim, but free() returns large slabs to the OS directly */+/* musl: no malloc_trim, but free() munmaps large expert slabs anyway */#ifdef __GLIBC__malloc_trim(1024);#endif