Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

fmt (#157)
uuuvn committed 9 months ago
e604781
update rust version (#156)
eugene committed 9 months ago
ab8bfd8
Merge dev into main (#154)
uuuvn committed 9 months ago
548d144
update deps (#146)
eugene committed 9 months ago
c3bfb47
Fix attention bias fill
LuckyIYI committed 9 months ago
23f0856
Migrate to sovereign metal (#97)
eugene committed 9 months ago
42a6bf8
Add CODEOWNERS
Aleksei Savin committed 10 months ago
2f7e136
Quantized gemm perfomance improved (#95)
Aleksei Savin committed 10 months ago
b29d47f
Change prefill_step_size limit
Aleksei Savin committed 10 months ago
1ffb17e
Expose prefill_step_size for benchmarks
Aleksei Savin committed 10 months ago
f183797
SSM detection criteria changed
Aleksei Savin committed 10 months ago
edcc2fb
ea165b7
remove matmul-benchmark crate
Aleksei Savin committed 10 months ago
13a9c50
steel_gemm load_safe fix
Aleksei Savin committed 10 months ago
d1dd976
Merge branch 'dev' Release 0.1.7
Aleksei Savin committed 10 months ago
cc8f124
update README.md
Aleksei Savin committed 10 months ago
f80881e
restore test data
Aleksei Savin committed 10 months ago
40aef5c
fix condition
Aleksei Savin committed 10 months ago
229c5a1
using of skip_attention_bias_fill
Aleksei Savin committed 10 months ago
31cc57b
formatting (#89)
uuuvn committed 10 months ago
7a65abb
use mask only when it's needed, better kv update
LuckyIYI committed 10 months ago
7dee120
sampling tests fix (#87)
uuuvn committed 10 months ago
a842826
quant_matmul fix
Aleksei Savin committed 10 months ago
21391ac
add precompile
Eugene Bokhan committed 10 months ago
d6c7474
Merge branch 'dev' of github.com:trymirai/uzu into dev
Eugene Bokhan committed 10 months ago
0b0ac5c
update table
Eugene Bokhan committed 10 months ago
09f6309
Remove timeout
Aleksei Savin committed 10 months ago
3363987
wip
Eugene Bokhan committed 10 months ago
69d9d98
Merge branch 'dev' of github.com:trymirai/uzu into dev
Eugene Bokhan committed 10 months ago
190b811