Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C
381 B
Raw Blame
{
  "prompt": "The capital of France is",
  "prompt_ids": [
    510,
    5347,
    273,
    6181,
    310
  ],
  "full_ids": [
    510,
    5347,
    273,
    6181,
    310,
    7785,
    15,
    187,
    187,
    510,
    3565,
    3448,
    273,
    6181,
    310,
    5112,
    15
  ],
  "text": "The capital of France is Paris.\n\nThe official language of France is French."
}