FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| pynccl.cu 6.3 KB | ||
| radix.cpp 1.6 KB | ||
| tensor.cpp 843 B | ||
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| pynccl.cu 6.3 KB | ||
| radix.cpp 1.6 KB | ||
| tensor.cpp 843 B | ||