Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
uzu
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
A high-performance inference engine for AI models
Rust
ai
high-performance
inference
llm
metal
rust
tts
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
main
121 branches · 42 tags
Go to file
t
Code
Commits on
main
add vulkan compute pipelines
eugene committed 5 days ago
c57039d
Copy SHA
add vulkan buffers
eugene committed 6 days ago
1429c21
Copy SHA
add vulkan device selection
eugene committed 6 days ago
b49c861
Copy SHA
mirai-gui: remove the welcome screen link from Settings (#1153)
alex-at-mirai committed 6 days ago
2871409
Copy SHA
mirai-gui: new ui (#1074)
alex-at-mirai committed 6 days ago
aa1596f
Copy SHA
Support Trellis model (#899)
CCYeh committed 6 days ago
1581621
Copy SHA
Fix U2 group size and decouple block_k and group_size (#1137)
CCYeh committed 6 days ago
1b0eff2
Copy SHA
Support draft vocabulary prefixes (#1008)
CCYeh committed 6 days ago
0f6405c
Copy SHA
handle grammars with triggers (#1110)
odilf committed 6 days ago
417e109
Copy SHA
update the yanked async-executor (#1112)
eugene committed 6 days ago
fabdfb2
Copy SHA
Fix overflow in matmul benchmark throughput (#1111)
GreatHato committed 6 days ago
f52ac1d
Copy SHA
Support lalamo 0.19 config (#1092)
odilf committed 6 days ago
7568c26
Copy SHA
resolve the bench model path on windows
eugene committed 7 days ago
42016c2
Copy SHA
build foundation
eugene committed 7 days ago
b314322
Copy SHA
simplify the cpu kernel binding generator
eugene committed 7 days ago
06093f2
Copy SHA
cleanup metal dead code
eugene committed 7 days ago
4ebc5b8
Copy SHA
Radix top-k: aligned loads for unaligned rows (#1106)
CCYeh committed 7 days ago
0f56efe
Copy SHA
Radix top-k: single-dispatch exact select (#1102)
CCYeh committed 8 days ago
f271cdf
Copy SHA
interleaved rows w4 layout
CCYeh committed 8 days ago
48d8469
Copy SHA
Don't fallback to older toolchain version (#1101)
uuuvn committed 9 days ago
3297e6e
Copy SHA
Wasm bindings (#1073)
Aleksandr Golokoz committed 9 days ago
d48439c
Copy SHA
Poll Metal feedback to reduce decode latency (#1098)
CCYeh committed 9 days ago
63d10a6
Copy SHA
share GPU correctness tests
eugene committed 10 days ago
12d28a8
Copy SHA
build the workspace on windows and linux
eugene committed 10 days ago
be16201
Copy SHA
Simplify decode loop (#1078)
odilf committed 10 days ago
4a386eb
Copy SHA
pre M5 2bit for dash (#1090)
CCYeh committed 10 days ago
c2afb5b
Copy SHA
2bit gemv mxutiled (#1089)
CCYeh committed 10 days ago
3909d5b
Copy SHA
Conf Head (#1042)
eugene committed 12 days ago
9297d12
Copy SHA
Add changing sampling seed (#1087)
Aleksandr Golokoz committed 13 days ago
628c12b
Copy SHA
Expose backend error to high level crates (#1085)
Aleksandr Golokoz committed 13 days ago
c6595ac
Copy SHA
Older