Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported
Python
Commits on main
fix(server): complete tool-call message round trips
185bd9d Demetrios Agourakis committed 1 month ago
feat(server): OpenAI-compatible tool/function calling
ef8dc2c Demetrios Agourakis committed 1 month ago
docs(streaming): distinguish paging from file-backed eviction
538b669 Demetrios Agourakis committed 1 month ago
docs(streaming): correct load_hot_layer's "page cache" backing claim
58014c4 Demetrios Agourakis committed 1 month ago
test(scripts): cover shard totals and optional metadata
772bdcf Demetrios Agourakis committed 1 month ago
fix(scripts): recompute metadata.total_size after stripping vision weights
2cc1247 Demetrios Agourakis committed 1 month ago
test(streaming): cover layer discovery without tensor calculations
a6ad384 Demetrios Agourakis committed 1 month ago
fix(moe): isolate layer-index errors from other numeric segments in discovery
85678c3 Demetrios Agourakis committed 1 month ago
fix(streaming): stop layer discovery on IndexError too
c646c40 Demetrios Agourakis committed 2 months ago
Merge upstream main and refresh README upload regression tests
8dbfe63 Demetrios Agourakis committed 1 month ago
fix(server): decode streamed SSE text from the cumulative id list
690724a ahrazzle committed 2 months ago
docs: refresh warm_willneed guidance against current main
e4a1eeb Demetrios Agourakis committed 1 month ago
Merge pull request #126 from Edge0-AI/fix/mlx-converter-missing-repack-core
feafe31 linyubupa committed 1 month ago
windows/tools: ship repack_mlx_to_gguf.py, the import-only core of the MLX->GGUF converter
592912e Alex Zhou committed 1 month ago
Merge pull request #124 from Edge0-AI/docs/drop-prefill-ondemand-news
af5cd15 linyubupa committed 1 month ago
docs(readme): drop the 2026-09-20 prefill-ondemand news line in all languages
4a9aa57 linyubupa committed 1 month ago
Merge pull request #123 from Edge0-AI/refactor/multi-platform-layout
88f121d linyubupa committed 1 month ago
windows: ship app/src/models/cards.tsx (gitignore models/ pattern was un-anchored)
88c7141 Alex Zhou committed 1 month ago
docs(readme): fold the Q4 2026 model & algorithm roadmap into Roadmap
27866bd Bin committed 1 month ago
fix(cli,models): unify serving port to 8000; repair convert-adapters and demo.py
b4d43c1 Bin committed 1 month ago