FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 189 B | ||
| cache_budget.py 6.2 KB | ||
| config.py 10.0 KB | ||
| engine.py 110 KB | ||
| graph.py 11.8 KB | ||
| sample.py 5.0 KB | ||