FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| arch | ||
| arch-fallback.h 22.6 KB | ||
| ggml-cpu-impl.h 13.4 KB | ||
| quants.c 44.1 KB | ||
| quants.h 10.6 KB | ||
| simd-mappings.h 55.7 KB | ||
| vec.cpp 24.8 KB | ||
| vec.h 66.9 KB | ||