FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 1.4 KB | ||
| base.py 5.6 KB | ||
| compressed_tensors.py 3.5 KB | ||
| fp8.py 4.0 KB | ||
| gguf.py 4.1 KB | ||
| modelopt.py 4.1 KB | ||
| mxfp4.py 1.1 KB | ||