FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 2.0 KB | ||
| attention.py 10.7 KB | ||
| config.py 10.2 KB | ||
| gguf.py 14.5 KB | ||
| hc.py 7.7 KB | ||
| model.py 10.4 KB | ||
| moe.py 1.1 KB | ||
| ple_disk.py 17.1 KB | ||
| ple.py 31.5 KB | ||
| weight.py 23.4 KB | ||