Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

Quant matmul cpu kernels (#316)
Aleksandr Golokoz committed 7 months ago
6f6ddaa
c6d1c82
Infrastructure for kernel benchmarks (#324)
uuuvn committed 7 months ago
23f80fa
device peak memory api (#322)
uuuvn committed 7 months ago
18af4e4
Fused tensoraddswap+rmsnorm (#320)
uuuvn committed 7 months ago
57f1cde
d810952
Fused tensorcopy+rmsnorm (#319)
uuuvn committed 7 months ago
e6f9e3c
Ssm cpu kernels (#308)
Aleksandr Golokoz committed 7 months ago
971cd98
GQA-aware two-pass attention (#317)
CCYeh committed 7 months ago
6a537c5
use raw_msg_send
eugene committed 7 months ago
0575151
qm(v/m) refactor (#313)
uuuvn committed 7 months ago
ede84c7
fix(ci): avoid runner temp parse error (#314)
Artur Mullakhmetov committed 7 months ago
f6d2e60
2ef4619
unbrick ci (#312)
uuuvn committed 7 months ago
f03e43c
Metal common cleanup (#310)
uuuvn committed 7 months ago
08cbb23
002dc5f
Qwen3.5 (#299)
CCYeh committed 7 months ago
98304cc
MoE cpu kernels (#300)
Aleksandr Golokoz committed 7 months ago
59446ea
86b635c
add model_compare tool (#303)
uuuvn committed 7 months ago
ab1747f
Short conv cpu kernels (#302)
Aleksandr Golokoz committed 7 months ago
4686862
Small tests movement (#301)
Aleksandr Golokoz committed 7 months ago
9bd9bbd
cpu command buffer refactor (#295)
uuuvn committed 7 months ago
4a3cdec
QLoRA (#297)
uuuvn committed 7 months ago
3a39be8
remove attention mask (#284)
uuuvn committed 7 months ago
4f1a4a7
Expose classifier types in prelude
Aleksei Savin committed 7 months ago
1e0a09e
028fb04
Support for loading non language models in tools (#298)
Aleksei Savin committed 7 months ago
5415fea
cargo-deny (#293)
uuuvn committed 7 months ago
6e92583