Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C
308 B
Raw Blame
{
  "prompt_ids": [
    1,
    2,
    3,
    4,
    5
  ],
  "full_ids": [
    1,
    2,
    3,
    4,
    5,
    32,
    146,
    258,
    130,
    236,
    174,
    293,
    264,
    180,
    28,
    107,
    257,
    72,
    61,
    138,
    169
  ],
  "mode": "attention_only",
  "model": "qwen36_tiny"
}