FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| batch_memcpy.cuh 2.9 KB | ||
| fast_index_copy.cuh 21.9 KB | ||
| index.cu 6.9 KB | ||
| store.cu 4.5 KB | ||
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| batch_memcpy.cuh 2.9 KB | ||
| fast_index_copy.cuh 21.9 KB | ||
| index.cu 6.9 KB | ||
| store.cu 4.5 KB | ||