FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| bf16.cpp 6.6 KB | ||
| ds_fp4.cpp 11.7 KB | ||
| fp8_block.cpp 9.5 KB | ||
| gguf.cpp 5.3 KB | ||
| mxfp4.cpp 11.4 KB | ||
| nvfp4.cpp 23.0 KB | ||