FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 657 B | ||
| base.py 2.0 KB | ||
| fp8_block.py 2.8 KB | ||
| fp8_tensor.py 3.2 KB | ||
| gguf.py 2.6 KB | ||
| mxfp8.py 1.7 KB | ||
| nvfp4.py 13.8 KB | ||
| unquantized.py 997 B | ||