Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
uzu
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
A high-performance inference engine for AI models
Rust
ai
high-performance
inference
llm
metal
rust
tts
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
main
121 branches · 42 tags
Go to file
t
Code
Commits on
main
more heuristics and tiling decisions
Eugene Bokhan committed 10 months ago
4b40264
Copy SHA
remove unsued model_metadata
Aleksei Savin committed 10 months ago
743f0a1
Copy SHA
vectorized loading
Eugene Bokhan committed 10 months ago
bffdec9
Copy SHA
gemv updates
Eugene Bokhan committed 10 months ago
a709db1
Copy SHA
update gemv
Eugene Bokhan committed 10 months ago
74f2c5d
Copy SHA
Unify processed_tokens_per_second calculations
Aleksei Savin committed 10 months ago
5c6ee90
Copy SHA
format
Eugene Bokhan committed 10 months ago
e22049d
Copy SHA
use bindgen
Eugene Bokhan committed 10 months ago
a9981d8
Copy SHA
update split k
Eugene Bokhan committed 10 months ago
e25addb
Copy SHA
use active_suffix_length
Eugene Bokhan committed 10 months ago
7613309
Copy SHA
fixed shader expectations, it expected unswizzled tile counts
LuckyIYI committed 10 months ago
90b61fe
Copy SHA
add correctness test
eugene committed 10 months ago
91dd1eb
Copy SHA
speed up gemv
eugene committed 10 months ago
42f3903
Copy SHA
wip
eugene committed 10 months ago
1429d53
Copy SHA
remove old trie (#73)
uuuvn committed 10 months ago
9cb3eba
Copy SHA
Merge pull request #71 from trymirai/shared-encoder
Aleksei Savin committed 10 months ago
ca13d42
Copy SHA
fmt + made encoder al layer
LuckyIYI committed 10 months ago
20b7475
Copy SHA
removed debug logs
LuckyIYI committed 10 months ago
3ace681
Copy SHA
Merge branch 'dev' into shared-encoder
LuckyIYI committed 10 months ago
531c21f
Copy SHA
update coms
eugene committed 10 months ago
f17016d
Copy SHA
wip
eugene committed 10 months ago
010e14e
Copy SHA
fix after merge
eugene committed 10 months ago
75a81be
Copy SHA
fix trace validator
eugene committed 11 months ago
bc48cd8
Copy SHA
update tile loader
eugene committed 11 months ago
49ad23a
Copy SHA
update gitignore
eugene committed 11 months ago
ee50bdc
Copy SHA
wip
eugene committed 11 months ago
307754f
Copy SHA
remove mpsgraph
eugene committed 11 months ago
8aa9ea6
Copy SHA
fix warnings
eugene committed 11 months ago
2723cf3
Copy SHA
remove qlora
eugene committed 11 months ago
1bf7f04
Copy SHA
update gitignore
eugene committed 11 months ago
f430ece
Copy SHA
Newer
Older