Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

add vulkan compute pipelines
eugene committed 5 days ago
c57039d
add vulkan buffers
eugene committed 6 days ago
1429c21
add vulkan device selection
eugene committed 6 days ago
b49c861
mirai-gui: new ui (#1074)
alex-at-mirai committed 6 days ago
aa1596f
Support Trellis model (#899)
CCYeh committed 6 days ago
1581621
0f6405c
handle grammars with triggers (#1110)
odilf committed 6 days ago
417e109
update the yanked async-executor (#1112)
eugene committed 6 days ago
fabdfb2
f52ac1d
Support lalamo 0.19 config (#1092)
odilf committed 6 days ago
7568c26
resolve the bench model path on windows
eugene committed 7 days ago
42016c2
build foundation
eugene committed 7 days ago
b314322
simplify the cpu kernel binding generator
eugene committed 7 days ago
06093f2
cleanup metal dead code
eugene committed 7 days ago
4ebc5b8
f271cdf
interleaved rows w4 layout
CCYeh committed 8 days ago
48d8469
3297e6e
Wasm bindings (#1073)
Aleksandr Golokoz committed 9 days ago
d48439c
share GPU correctness tests
eugene committed 10 days ago
12d28a8
build the workspace on windows and linux
eugene committed 10 days ago
be16201
Simplify decode loop (#1078)
odilf committed 10 days ago
4a386eb
pre M5 2bit for dash (#1090)
CCYeh committed 10 days ago
c2afb5b
2bit gemv mxutiled (#1089)
CCYeh committed 10 days ago
3909d5b
Conf Head (#1042)
eugene committed 12 days ago
9297d12
Add changing sampling seed (#1087)
Aleksandr Golokoz committed 13 days ago
628c12b
Expose backend error to high level crates (#1085)
Aleksandr Golokoz committed 13 days ago
c6595ac