Skip to content

armgit / Edge0

Public Imported from GitHub
0

Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported

Python
104 B
Raw Blame
#![cfg_attr(not(debug_assertions), windows_subsystem = "windows")]

fn main() {
    edge0_app::run();
}