FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| bench_decode_moe.py 17.4 KB | ||
| bench_load_weight_generic.py 15.2 KB | ||
| bench_offload_cache_copy.py 9.7 KB | ||
| README.md 1.2 KB | ||