Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

b0e4cd7
Merge pull request #1257 from JustVugg/feat/edge-logits-v2
Vincenzo Fornaro committed 2 months ago
62909b2
test(xdna): skip the allocator-refusal cases under ASan
Kenneth-Javier Ortigoza committed 2 months ago
49c0619
fix(xdna): keep the loader-dependent tests off non-Windows CI
Kenneth-Javier Ortigoza committed 2 months ago
5af84d9
docs(xdna): describe the lane that exists, not the one being built
Kenneth-Javier Ortigoza committed 2 months ago
3748d2a
tools: add GLM-5.3 oracle contracts
ZacharyZcR committed 2 months ago
9798fbc
fix(telemetry): report Vulkan expert residency
ZacharyZcR committed 2 months ago
a1e0afb
test(loader): account for pinned CUDA group API
ZacharyZcR committed 2 months ago
9f4a8d1
fix(cuda): pin speculative expert kernel family
ZacharyZcR committed 2 months ago
6af05c0
test: isolate tool E2E API key environment
ZacharyZcR committed 2 months ago
349e633
fix(qwen36): escape quotes in OpenAI JSON
ZacharyZcR committed 2 months ago
710e93e
fix(qwen38): bound serve cache and validate tokens
themorlock committed 2 months ago
8563799
0975a40
build(release): make XDNA release inputs reproducible
Kenneth-Javier Ortigoza committed 2 months ago
7f06a20
test(xdna): let the physical probe qualify either M bucket
Kenneth-Javier Ortigoza committed 2 months ago
41b1949
build(xdna): define optional sidecar release process
Kenneth-Javier Ortigoza committed 2 months ago
528e1f5
perf(xdna): accelerate prepared weight conversion
Kenneth-Javier Ortigoza committed 2 months ago
29a0a25
build(windows): include XDNA capability in release host
Kenneth-Javier Ortigoza committed 3 months ago
1038ad6
feat(xdna): add explicit packaged XDNA mode
Kenneth-Javier Ortigoza committed 3 months ago
ea2ecb6
feat(xdna): add qualified M256 bucket selection
Kenneth-Javier Ortigoza committed 3 months ago
05cc697
docs(xdna): record the pair-layout constraint
Kenneth-Javier Ortigoza committed 3 months ago
3243d77
fix(xdna): decline the K1 planar int4 layout
Kenneth-Javier Ortigoza committed 3 months ago
e9cfdb0
feat(xdna): make the native lane fail closed
Kenneth-Javier Ortigoza committed 3 months ago
2e7578b
feat(xdna): add native GLM shared execution lane
Kenneth-Javier Ortigoza committed 3 months ago
f8d618c
feat(xdna): add fmt4 weight preparation
Kenneth-Javier Ortigoza committed 3 months ago
d5e23fe