Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

709eb93
optimize chat session stats collection
Nikolai Ovchinnikov committed 5 months ago
26dbd7d
update xgrammar
eugene committed 5 months ago
a757c4d
Extend MoE kernels for `Gemma4` (#542)
CCYeh committed 5 months ago
d3cce50
Update XGrammar (#535)
eugene committed 5 months ago
23619e5
Clean lib.rs (#540)
Aleksandr Golokoz committed 5 months ago
b310f53
json parsing fix
eugene committed 5 months ago
e3c9a3c
Benches with test harness (#536)
Aleksandr Golokoz committed 5 months ago
7aded80
Custom test harness (#533)
Aleksandr Golokoz committed 5 months ago
643faf7
d769c95
Add dflash configs (#530)
CCYeh committed 5 months ago
ff01478
remove cli settings hardcode
eugene committed 5 months ago
49bdc9d
e934f73
Tiny cleanup after #501 (#525)
uuuvn committed 5 months ago
adf4149
Tests files structure refactoring (#501)
Aleksandr Golokoz committed 5 months ago
7e3b3fe
move env vars to common place (#524)
CCYeh committed 5 months ago
806c275
Support benchmark gpu capture (#522)
CCYeh committed 5 months ago
a7f31d2
Release 0.5.12
github-actions[bot] committed 5 months ago
0ebcf22
warmup session instead of kernel preheat
eugene committed 5 months ago
f0c3f4d
Release 0.5.10
github-actions[bot] committed 5 months ago
b4c188e
prepare for lloyd-max (#516)
CCYeh committed 5 months ago
44d8451
Unified sampling (#517)
uuuvn committed 5 months ago
a67ed67
cli fixes
eugene committed 5 months ago
f7fb55c
Release 0.5.9
github-actions[bot] committed 5 months ago
abefe6c
cli model settings
eugene committed 5 months ago
3ba03a0
Update autogen for longer line (#514)
uuuvn committed 5 months ago
9d30d48
f2fe36d