FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 113 B | ||
| cache.py 39.6 KB | ||
| config.py 1.0 KB | ||
| decode.py 1.4 KB | ||
| io.py 5.1 KB | ||
| mm.py 4.1 KB | ||
| prefill.py 17.5 KB | ||
| scheduler.py 50.9 KB | ||
| status.py 5.4 KB | ||
| table.py 1.1 KB | ||
| utils.py 764 B | ||