Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

format
eugene committed 11 months ago
aac41e1
Update README.md
Aleksei Savin committed 11 months ago
cf88165
Fix unsafe NSHomeDirectory Update READE.md
Aleksei Savin committed 11 months ago
fe3f6ef
xgrammar policy
uuuvn committed 11 months ago
e79ac76
add session run autoreleaspool
eugene committed 11 months ago
d0d7032
fcfdfa2
fix tests (#54)
uuuvn committed 11 months ago
60057cd
Explicit AsyncBatchSize parameter
Aleksei Savin committed 11 months ago
e2d91be
Async decoding (#52)
Aleksei Savin committed 11 months ago
0930977
Restore test model
Aleksei Savin committed 11 months ago
1934b99
manual unrolling + deleted unused code
LuckyIYI committed 11 months ago
05b66ff
Disale speculation for SSM models
Aleksei Savin committed 12 months ago
0ebdda0
fix attention config test (#49)
uuuvn committed 12 months ago
453468e
metal validation fixes (#48)
uuuvn committed 12 months ago
4e15264
Fix sampling
Aleksei Savin committed 12 months ago
445ec96
SSM (#47)
LuckyIYI committed 12 months ago
8b4704c
b4752bf
12a8da9
e623aa1
policy/sampling separation (#41)
uuuvn committed 1 year ago
1601f2d
CLI: prefill step size
Aleksei Savin committed 1 year ago
01acdb7
Session reset added
Aleksei Savin committed 1 year ago
5121d90
Context cache mode api (#40)
LuckyIYI committed 1 year ago
1315ad8
Update README.md
Aleksei Savin committed 1 year ago
08e218b
Update README.md
Aleksei Savin committed 1 year ago
d1bd479
Update README.md
Aleksei Savin committed 1 year ago
579b443
kv cache clear fix
LuckyIYI committed 1 year ago
91e1ef9
Sliding window refactoring (#38)
LuckyIYI committed 1 year ago
dfb71dc
Check available memory
Aleksei Savin committed 1 year ago
f7c0a18