FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| freetoken | ||
| ggml-cpu | ||
| ggml-cuda | ||
| include | ||
| src | ||
| freetoken.patch 65.5 KB | ||
| LICENSE 1.1 KB | ||
| VERSION 2.1 KB | ||