FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| cuda.h 741 B | ||
| hip.h 12.7 KB | ||
| musa.h 7.1 KB | ||
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| cuda.h 741 B | ||
| hip.h 12.7 KB | ||
| musa.h 7.1 KB | ||