Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

Merge pull request #1112 from JustVugg/release/v1.7.0
Vincenzo Fornaro committed 3 months ago
940ea50
909f2b4
e0e3cc4
Merge pull request #1123 from ZacharyZcR/fix/1032-warnings
Vincenzo Fornaro committed 3 months ago
0419d23
Merge pull request #1122 from ZacharyZcR/fix/1039-usage-save
Vincenzo Fornaro committed 3 months ago
aabf942
863bf1e
849f960
a4b3748
Merge pull request #829 from aaristov/fix/metal-i4-gpu-path
Vincenzo Fornaro committed 3 months ago
692e61e
fix(telemetry): honour USAGE_SAVE=0 in every engine
ZacharyZcR committed 3 months ago
269440d
b00688b
Merge pull request #1114 from JustVugg/fix/cuda-fmt8-rebased
Vincenzo Fornaro committed 3 months ago
9b6e949
merge dev into release branch
JustVugg committed 3 months ago
eae3d5c
refactor(serve): share framing with Inkling
Mario Gutierrez committed 3 months ago
c379f47
test(inkling): freeze serve wire framing
Mario Gutierrez committed 3 months ago
bc46e96
a541e77