Skip to content

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

Commits on main

docs(readme): move the contributor wall to the top
Fareed Khan committed 1 month ago
81bb6c2
fd8bf52
release: v1.1.0
Fareed Khan committed 1 month ago
1025d9e
0838cb4
916c0e7
feat(chat): add --top-k to the existing sampler
Fareed Khan committed 1 month ago
a213bae
fix(json): refuse truncated and malformed documents
Fareed Khan committed 1 month ago
6680ec7
feat: add the K3 XTML chat template and REPL
Fareed Khan committed 1 month ago
ce88102