FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| ggml-alloc.h 3.6 KB | ||
| ggml-backend.h 26.9 KB | ||
| ggml-cpu.h 7.6 KB | ||
| ggml-cuda.h 1.5 KB | ||
| ggml.h 114 KB | ||
| gguf.h 11.1 KB | ||