Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

add mlx quantized untied
eugene committed 11 months ago
eb3eafb
update mlp
eugene committed 11 months ago
21fa8fe
decouple linear into a mod
eugene committed 11 months ago
d13297a
full precision lookup
eugene committed 11 months ago
ec6f03e
update embedding
eugene committed 11 months ago
240f418
wip
eugene committed 11 months ago
fef0ad5
introduce gemm
eugene committed 11 months ago
a11f4d3
fixed race
LuckyIYI committed 11 months ago
a36bec3
Update xgrammar-rs
Aleksei Savin committed 10 months ago
173ef21
brought back encodable with encoder
LuckyIYI committed 10 months ago
4781cec
quantized untied support
eugene committed 10 months ago
49101b1
min_p (#69)
uuuvn committed 10 months ago
15aa6f4
Remove stop_on_grammar_complete
Aleksei Savin committed 10 months ago
c1ba1e0
Update README.md
Aleksei Savin committed 10 months ago
cc0f365
Fix sampling tests
Aleksei Savin committed 10 months ago
4dae7d5
remove clamp
eugene committed 11 months ago
37c4a74
update gitignore
eugene committed 11 months ago
2ecf076
avoid overflow
eugene committed 11 months ago
4e4eb68
use active_suffix_length
eugene committed 11 months ago
dd81937
use input scale
eugene committed 11 months ago
e0236af
grammar speculator fix
uuuvn committed 11 months ago
a099964
short conv update
LuckyIYI committed 11 months ago
a63f7cc
Benchmarks
Aleksei Savin committed 11 months ago
3d4a66b
fix for async on short prompts
LuckyIYI committed 11 months ago
2991720
Async decoding for transformers
LuckyIYI committed 11 months ago
9f1f07e
xgrammar fix
eugene committed 11 months ago
af5febd
add short conv
eugene committed 11 months ago
d773d60
classificators & new lalamo config
eugene committed 11 months ago
85e6de7
Moe improvements
LuckyIYI committed 11 months ago
eab58be
use the latest toolchain
eugene committed 11 months ago
a3597cd