Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

coli: consume the engine's TIERS line at startup so it doesn't leak into the first answer

Skeldoorb79610852bc1
diff --git a/c/coli b/c/coli
index 8c89caf9..933f6355 100755
--- a/c/coli
+++ b/c/coli
@@ -438,6 +438,8 @@ def cmd_chat(a):
try: errlog.write(p.stderr.read().decode("utf-8","replace"))
except (OSError, ValueError): pass
errlog.seek(0); print(errlog.read()[-1500:]); sys.exit("the engine exited while loading")
+ p.stdout.readline() # TIERS line (web-dashboard protocol): emitted once right after STAT;
+ # left unread it leaks into the first answer's text
# READY received. Drain the child's stderr into errlog without blocking:
# the engine is still alive (blocked on stdin), so a plain read() would
# hang forever waiting for EOF. A short bounded drain grabs the ~400 bytes