Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

more heuristics and tiling decisions
Eugene Bokhan committed 10 months ago
4b40264
remove unsued model_metadata
Aleksei Savin committed 10 months ago
743f0a1
vectorized loading
Eugene Bokhan committed 10 months ago
bffdec9
gemv updates
Eugene Bokhan committed 10 months ago
a709db1
update gemv
Eugene Bokhan committed 10 months ago
74f2c5d
Unify processed_tokens_per_second calculations
Aleksei Savin committed 10 months ago
5c6ee90
format
Eugene Bokhan committed 10 months ago
e22049d
use bindgen
Eugene Bokhan committed 10 months ago
a9981d8
update split k
Eugene Bokhan committed 10 months ago
e25addb
use active_suffix_length
Eugene Bokhan committed 10 months ago
7613309
add correctness test
eugene committed 10 months ago
91dd1eb
speed up gemv
eugene committed 10 months ago
42f3903
wip
eugene committed 10 months ago
1429d53
remove old trie (#73)
uuuvn committed 10 months ago
9cb3eba
Merge pull request #71 from trymirai/shared-encoder
Aleksei Savin committed 10 months ago
ca13d42
fmt + made encoder al layer
LuckyIYI committed 10 months ago
20b7475
removed debug logs
LuckyIYI committed 10 months ago
3ace681
Merge branch 'dev' into shared-encoder
LuckyIYI committed 10 months ago
531c21f
update coms
eugene committed 10 months ago
f17016d
wip
eugene committed 10 months ago
010e14e
fix after merge
eugene committed 10 months ago
75a81be
fix trace validator
eugene committed 11 months ago
bc48cd8
update tile loader
eugene committed 11 months ago
49ad23a
update gitignore
eugene committed 11 months ago
ee50bdc
wip
eugene committed 11 months ago
307754f
remove mpsgraph
eugene committed 11 months ago
8aa9ea6
fix warnings
eugene committed 11 months ago
2723cf3
remove qlora
eugene committed 11 months ago
1bf7f04
update gitignore
eugene committed 11 months ago
f430ece