Skip to content

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

206 B
Raw Blame
"""The DeepSeek-V4.1 reference implementation (MIT, vendored from the HF repo's ``inference/``) with its
tilelang kernels transcribed to torch -- the numerical oracle FreeToken's port is tested against."""