Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C
249 B
Raw Blame
{
  "prompt_ids": [
    510,
    5347,
    273,
    6181,
    310
  ],
  "full_ids": [
    510,
    5347,
    273,
    6181,
    310,
    7785,
    15,
    187,
    187,
    510,
    3565,
    3448,
    273,
    6181,
    310,
    5112,
    15
  ]
}