A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
C avx2c99cpu-inferencedeep-learningfrom-scratchinference-enginekimi-k3linear-attentionllmllm-inferencemachine-learningmemory-efficientmixture-of-expertsmoemxfp4quantizationsimdsystems-programmingtransformerzero-dependencies
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| k3_load.c 5.9 KB | ||
| k3_load.h 3.6 KB | ||
| k3_portable_io.h 13.9 KB | ||
| k3_st.c 35.9 KB | ||
| k3_st.h 7.1 KB | ||
| k3_trunk.c 46.5 KB | ||
| k3_trunk.h 9.8 KB | ||