Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
gateway: DMel audio input for Inkling over the OpenAI API
779ce88 Kyle Kelley committed 3 months ago
tools: keep audio tensors through conversion + multimodal tiny oracle
9ad5764 Kyle Kelley committed 3 months ago
Merge pull request #746 from JustVugg/fix/release-verify-encoding
06f31b2 Vincenzo Fornaro committed 3 months ago
fix(release): read the packaged tokenizer as UTF-8, not the Windows ANSI page
72cf894 JustVugg committed 3 months ago
Merge pull request #744 from JustVugg/chore/bump-1.4.0
029989a Vincenzo Fornaro committed 3 months ago
Merge pull request #743 from JustVugg/fix/fp8-e2e-test-openmp-linux
c946780 Vincenzo Fornaro committed 3 months ago
Merge pull request #742 from terrizoaguimor/feat/inkling-route-trace
9d240ab Vincenzo Fornaro committed 3 months ago
Merge pull request #741 from JustVugg/fix/cuda-tier-staging-rss
f6ae858 Vincenzo Fornaro committed 3 months ago
inkling: adopt route_trace.h, keeping the IKU1 history readable
42835b6 Mario Gutierrez committed 3 months ago
fix(cuda): stage the VRAM tier in rounds so host RSS is bounded (#730)
e542108 JustVugg committed 3 months ago
Merge pull request #740 from JustVugg/docs/site-four-families
926705d Vincenzo Fornaro committed 3 months ago
Merge pull request #739 from JustVugg/fix/coli-cuda-value-not-presence
d2b565e Vincenzo Fornaro committed 3 months ago
site: four model families, not one — and two cards that were plainly wrong
3cf82f6 JustVugg committed 3 months ago
fix(omp): COLI_CUDA/COLI_METAL are state, not kill-switches — test the value
207d354 JustVugg committed 3 months ago
Merge pull request #738 from JustVugg/feat/omp-thread-sizing
2dcd5e1 Vincenzo Fornaro committed 3 months ago
feat(omp): size the OpenMP team by physical cores on kimi_k3 and olmoe
fd8fae9 JustVugg committed 3 months ago
Merge pull request #737 from JustVugg/feat/release-ship-all-engines
f8e31f6 Vincenzo Fornaro committed 3 months ago
feat(release): ship every engine in the archives, not just GLM
9080a37 JustVugg committed 3 months ago
Merge pull request #736 from JustVugg/fix/windows-serve-stdin
233fae6 Vincenzo Fornaro committed 3 months ago
fix: place the select include correctly and drop the STDIN_FILENO dependency
fbd4534 JustVugg committed 3 months ago
fix(win): inkling and kimi_k3 now build on Windows; CI covers every engine
f882303 JustVugg committed 3 months ago