Skip to content

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

290 B
Raw Blame
"""Radix prefix-cache test harness: one op vocabulary + invariant battery over the three sibling
caches (``adapters``), one page-keyed reference model (``model``), the ``Session`` that drives both
at once (``driver``), fixtures in ``conftest``.  Test modules import from those directly."""