Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

ebd85a7
e48513c
Merge pull request #409 from attilaolah/nix
Vincenzo Fornaro committed 4 months ago
93cde63
Merge pull request #446 from cdhdt/perf/io-direct-pilot
Vincenzo Fornaro committed 4 months ago
c98b451
04ed004
Merge pull request #429 from ZacharyZcR/fix/numa-vma-419
Vincenzo Fornaro committed 4 months ago
73badea
Merge pull request #447 from monotophic/metal/rtop8-parallel
Vincenzo Fornaro committed 4 months ago
aa825d3
0696172
e78fcfc
78a773e
1aacfcf
Merge pull request #270 from ebootheee/pr-pipe-batch-sync
Vincenzo Fornaro committed 4 months ago
e809171
d34461c
Merge pull request #462 from JustVugg/site-to-main
Vincenzo Fornaro committed 4 months ago
a9eb839
Merge pull request #424 from ZacharyZcR/feat/website
Vincenzo Fornaro committed 4 months ago
d336230
Merge pull request #330 from nbeerbower/tok-o200k
Vincenzo Fornaro committed 4 months ago
ff38be0
48d4af6
Merge pull request #461 from JustVugg/docs-to-main
Vincenzo Fornaro committed 4 months ago
ff93ae2
b347092
Merge pull request #460 from JustVugg/docs-windows-exe
Vincenzo Fornaro committed 4 months ago
85e7dff
Merge pull request #440 from okuvshynov/test_macpro_2019
Vincenzo Fornaro committed 4 months ago
505a0f6
Merge pull request #427 from DavidePapero/main
Vincenzo Fornaro committed 4 months ago
86766bf
0337697
Merge pull request #360 from woolcoxm/test/efficiency-suite
Vincenzo Fornaro committed 4 months ago
af23f31
1765ed8