FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 94 B | ||
| constants.py 242 KB | ||
| freetoken.patch 631 B | ||
| gguf_reader.py 15.9 KB | ||
| lazy.py 11.7 KB | ||
| LICENSE 1.0 KB | ||
| quants.py 63.4 KB | ||
| VERSION 795 B | ||