Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

Small cleanup part 5 (#956)
uuuvn committed 1 month ago
16443db
Small cleanup part 4 (#955)
uuuvn committed 1 month ago
e7e8e1e
Small cleanup part 3 (#953)
uuuvn committed 1 month ago
85dc4df
Small cleanup part 2 (#952)
uuuvn committed 1 month ago
bc03509
Remove useless comment (#950)
uuuvn committed 1 month ago
ed84e7d
Small cleanups (part 1) (#949)
uuuvn committed 1 month ago
b73162d
Expose structured benchmark replies on request (#948)
Artur Mullakhmetov committed 1 month ago
e61e355
Add checking for omitted reasoning (#947)
Aleksandr Golokoz committed 1 month ago
3c3b4dd
Remove f32 attention (#946)
CCYeh committed 1 month ago
432da1b
Honor reasoning effort in benchmark tasks (#945)
Artur Mullakhmetov committed 1 month ago
d40a482
Add checking for empty content (#939)
Aleksandr Golokoz committed 1 month ago
a1f0768
speedup prefill
eugene committed 1 month ago
ce6298c
1f515b9
6d021ae
update xgrammar
eugene committed 1 month ago
39531bd
8b5aed4
e632c2c
Add tuned weaver qmv routing (#927)
CCYeh committed 1 month ago
bd374af
Remove gpu fill zeros command (#926)
CCYeh committed 1 month ago
14163e0
Fuse sigmoid gate into Attention (#930)
CCYeh committed 1 month ago
f9d7477
New capture (#929)
uuuvn committed 1 month ago
55dc41d
Release 0.6.3
github-actions[bot] committed 1 month ago
d76d468
23f365f
b5ceffe
Mac app fixes and improvements (#918)
uuuvn committed 1 month ago
03825dc
drop 8-bit scale+bias matmul kernels (#909)
eugene committed 1 month ago
fbf74e1
faster suffix=16 A8W4 (#911)
CCYeh committed 1 month ago
3c06bed
Revert "gpu timestamps recording" (#912)
uuuvn committed 1 month ago
4e7004b