Skip to content

armgit / Edge0

Public Imported from GitHub
0

Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported

Python

Commits on main

fix(server): complete tool-call message round trips
Demetrios Agourakis committed 1 month ago
185bd9d
feat(server): OpenAI-compatible tool/function calling
Demetrios Agourakis committed 1 month ago
ef8dc2c
docs(streaming): distinguish paging from file-backed eviction
Demetrios Agourakis committed 1 month ago
538b669
58014c4
test(scripts): cover shard totals and optional metadata
Demetrios Agourakis committed 1 month ago
772bdcf
a6ad384
fix(streaming): stop layer discovery on IndexError too
Demetrios Agourakis committed 2 months ago
c646c40
Merge upstream main and refresh README upload regression tests
Demetrios Agourakis committed 1 month ago
8dbfe63
docs: refresh warm_willneed guidance against current main
Demetrios Agourakis committed 1 month ago
e4a1eeb
add 5 language readmes
Bin committed 1 month ago
d85bae8
add notice and so on
Bin committed 1 month ago
ea37f25
add windows and android version
Bin committed 1 month ago
f41da5d
add macos version
Bin committed 1 month ago
5562581
add ios version
Bin committed 1 month ago
f93251a
adjust readme
Bin committed 1 month ago
aa81008
clean up convert_adapters command
Bin committed 1 month ago
d464ceb
cad29a1