Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
tools: deprecate convert_olmoe.py — its split gate/up/down layout no longer loads in olmoe.c
d616f39 Zixin Zhou committed 3 months ago
Merge pull request #647 from JustVugg/site/new-website
93b4c60 Vincenzo Fornaro committed 3 months ago
Merge pull request #645 from JustVugg/site/anthropic-style-landing
b3fafb1 Vincenzo Fornaro committed 3 months ago
Merge pull request #644 from JustVugg/fix/642-readme-main
7db1833 Vincenzo Fornaro committed 3 months ago
docs: also point quickstart's model link to the gs64 container (#642)
be18b17 JustVugg committed 3 months ago
Merge pull request #643 from JustVugg/fix/642-readme-hf-link
f6ecf5f Vincenzo Fornaro committed 3 months ago
Merge pull request #641 from ZacharyZcR/fix/ship-web-dashboard
847b1fd Vincenzo Fornaro committed 3 months ago
release: ship the web dashboard, so the Expert Atlas reaches users
259f3cb ZacharyZcR committed 3 months ago
Merge pull request #639 from JustVugg/fix/kv-slot-conversation-affinity
d78f6e9 Vincenzo Fornaro committed 3 months ago
Merge pull request #638 from JustVugg/fix/web-reasoning-truncation
0e7b2c1 Vincenzo Fornaro committed 3 months ago
fix(serve): pin each conversation to a stable KV slot (#634)
e8580e7 JustVugg committed 3 months ago
fix(web): stop truncating reasoning at 512 tokens by default
adf6d68 JustVugg committed 3 months ago
Merge pull request #635 from duringcoffee/fix/serve-keep-stops
874e8cf Vincenzo Fornaro committed 3 months ago
Merge pull request #630 from dawnfield-institute/docs/cuda-glibc241-build
39a3804 Vincenzo Fornaro committed 3 months ago
Merge pull request #636 from duringcoffee/docs/arm64-build
43e4de3 Vincenzo Fornaro committed 3 months ago
Merge pull request #632 from ZacharyZcR/fix/async-packed-int4-parity
f5fe934 Vincenzo Fornaro committed 3 months ago
Merge pull request #633 from ZacharyZcR/fix/381-chat-stop-set
cfd6dfa Vincenzo Fornaro committed 3 months ago
docs: tell ARM64 users the prebuilt Linux archive will not run
72d2b70 duringcoffee committed 3 months ago