Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

docs: reword malloc_trim comment

iiEliJasc84812329077
diff --git a/c/colibri.c b/c/colibri.c
index 811dceb5..cc3253b8 100644
--- a/c/colibri.c
+++ b/c/colibri.c
@@ -8455,7 +8455,7 @@ static void rss_guard(Model *m){
if(dropped)
fprintf(stderr,"[RAM-GUARD] RSS %.1f GB over the %.1f GB budget (#403): "
"dropped %d cached experts, cap -> %d\n", rss, lim, dropped, m->ecap);
-/* musl lacks malloc_trim, but free() returns large slabs to the OS directly */
+/* musl: no malloc_trim, but free() munmaps large expert slabs anyway */
#ifdef __GLIBC__
malloc_trim(1024);
#endif