FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Merge branch 'main' of github.com:FlashML-org/FreeToken
jasonfan97eb4e25b55f
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.