FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| configs | ||
| embedding | ||
| linear | ||
| moe | ||
| __init__.py 2.1 KB | ||
| ggml_types.py 4.5 KB | ||
| method.py 2.4 KB | ||
| names.py 4.1 KB | ||
| quant_backend.py 2.8 KB | ||
| registry.py 1.6 KB | ||
| scheme.py 4.4 KB | ||