Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

move test
Eugene Bokhan committed 10 months ago
c929f31
update bench
Eugene Bokhan committed 10 months ago
e66a79c
update test
Eugene Bokhan committed 10 months ago
e7fa09e
wip
Eugene Bokhan committed 10 months ago
560b31d
remove log
Aleksei Savin committed 10 months ago
1f67598
benchmark task greedy parameter
Aleksei Savin committed 10 months ago
205fde3
using minimal context length in bench
Aleksei Savin committed 10 months ago
69b9903
actual fix of race condition for reduction ops
LuckyIYI committed 10 months ago
1fa975d
fix topK for m3+ machines
LuckyIYI committed 10 months ago
7cadd61
more cases
Eugene Bokhan committed 10 months ago
17df66d
naming
Eugene Bokhan committed 10 months ago
1741435
update matmul tests
Eugene Bokhan committed 10 months ago
b3314e3
put back empty feature
Eugene Bokhan committed 10 months ago
aeea9c7
add debug matmul
Eugene Bokhan committed 10 months ago
5e5cbdd
change default prefill step size
Aleksei Savin committed 10 months ago
eba9b8b
removed padding
LuckyIYI committed 10 months ago
2d347b0
reset seed for generator reset
LuckyIYI committed 10 months ago
488d7ee
gemm attention fixes
LuckyIYI committed 10 months ago
2115730
cli bench sleep
Aleksei Savin committed 10 months ago
0078da9
fix
Aleksei Savin committed 10 months ago
911e6e8
add matmul benchmark
Eugene Bokhan committed 10 months ago
10c656a
fix test compilation
Eugene Bokhan committed 10 months ago
d6acc9f
update os check
Eugene Bokhan committed 10 months ago
3f1f77d
remove warning
Eugene Bokhan committed 10 months ago
30af466
speed-up-attention
Eugene Bokhan committed 10 months ago
d6cba68
update gitignore
Eugene Bokhan committed 10 months ago
28ef62f
fix warnings
Eugene Bokhan committed 10 months ago
d3bd711
reorganize code
Eugene Bokhan committed 10 months ago
666f1be
fix compilation, remove unused
Eugene Bokhan committed 10 months ago
007103b
format
Eugene Bokhan committed 10 months ago
ea3ef57