Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
feat(xdna): add optional helper runtime binding
cef87a9 Kenneth-Javier Ortigoza committed 3 months ago
feat(glm53): Segment and Edge adapters, so the family clears the release gate
03f4c15 JustVugg committed 2 months ago
Merge remote-tracking branch 'origin/dev' into feat/glm53-flash
beade01 JustVugg committed 2 months ago
feat(glm53): tool calling in the gateway, pinned to the official template
59d76dd JustVugg committed 2 months ago
feat(glm53): real tokenizer in the fixtures, and KV slots that reuse the prefix
11a44fa JustVugg committed 2 months ago
feat(glm53): register the family, so coli run, chat, serve and web reach it
b887c50 JustVugg committed 2 months ago
perf(glm53): absorb kv_b_proj so the cache holds latents, not expanded keys
316fb13 JustVugg committed 2 months ago
feat(glm53): decode one token at a time, and speak the serve protocol
9a4e15e JustVugg committed 2 months ago
fix(glm53): the int4 container is flat, and the engine now says so
caf3103 JustVugg committed 2 months ago
feat(glm53): int4-gs64 container and GLM53_BITS for the resident weights
c512a78 JustVugg committed 2 months ago
feat(glm53): wire the vision tower into the engine, validated end to end
d85799d JustVugg committed 2 months ago
feat(glm53): complete CPU text engine, token-exact on the tiny oracle
69fc89e JustVugg committed 2 months ago
feat(glm53): KDA and k-pool sparse attention, validated against transformers
998701e JustVugg committed 2 months ago
Merge pull request #1245 from JustVugg/feat/universal-edge-runtime
692af87 Vincenzo Fornaro committed 2 months ago
Merge pull request #1251 from JustVugg/refactor/shared-mhc
b18cf38 Vincenzo Fornaro committed 2 months ago
Merge pull request #1252 from JustVugg/fix/windows-check-timeout
88e275f Vincenzo Fornaro committed 2 months ago
feat(glm53): vision tower, validated against a transformers oracle
e884da1 JustVugg committed 2 months ago