FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| linear_attn | ||
| quantization | ||
| __init__.py 1.4 KB | ||
| activation.py 3.3 KB | ||
| base.py 3.8 KB | ||
| embedding.py 6.0 KB | ||
| linear.py 5.7 KB | ||
| mhc.py 10.2 KB | ||
| moe.py 19.1 KB | ||
| norm.py 7.4 KB | ||
| rotary.py 14.1 KB | ||