FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 653 B | ||
| indexer.py 9.7 KB | ||
| pack.py 7.8 KB | ||
| row_format.py 3.5 KB | ||
| sparse_attn.py 13.7 KB | ||
| topk.py 14.3 KB | ||