Skip to content

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

Commits on main

chore(release): 0.2.1 (#824)
Xiaoze Fan committed 24 days ago
ba31db2
756108f
feat(flint): add nvfp4 modelopt and gguf support (#797)
Jesús Jódar Piernas committed 26 days ago
2d93085
32056cf
507a8bf
20d1bfb
perf(moe): skip inactive block-fp8 decode routes (#665)
cherry77-cloud committed 27 days ago
7974c9c
docs: set admission rules for new tests (#796)
Xiaoze Fan committed 28 days ago
c63fc13