Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

92f8a25
0d6b4c4
943d55d
Unified Quantized Gemm (#432)
eugene committed 5 months ago
7ade24d
Fix Linux CPU-only download-manager build (#437)
Stan SKY committed 6 months ago
a235835
fix: make flake.nix work on Linux (#440)
thenhnn committed 6 months ago
2a4a31f
Remove tracing_visible_mod (#439)
Aleksandr Golokoz committed 6 months ago
f9b3306
571d767
KV cache sparse buffers (#434)
Aleksandr Golokoz committed 6 months ago
28fed45
Unify Gemm (#411)
eugene committed 6 months ago
5c3dc00
Remove event (#431)
Aleksandr Golokoz committed 6 months ago
26d23f9
Cross-layer KV cache sharing (#428)
CCYeh committed 6 months ago
153837f
Stricter tts configs (#425)
uuuvn committed 6 months ago
44366b1
Support normalize values (#420)
CCYeh committed 6 months ago
8deb311
Support post_layer_scalar (#419)
CCYeh committed 6 months ago
a78f652
Stricter #[uzu_config] (#424)
uuuvn committed 6 months ago
b83a39a
Move trace_validator.rs to tests (#423)
Aleksandr Golokoz committed 6 months ago
4ae4c93
#[uzu_config] for stricter serde (#422)
uuuvn committed 6 months ago
95c7172
Release 0.4.9
github-actions[bot] committed 6 months ago
aea4664
Temporary allocator optimization (#417)
uuuvn committed 6 months ago
eb93dfc
Migrate RoPE config to per layer (#405)
CCYeh committed 6 months ago
95b9ffe
dsl buffer args (#409)
Aleksandr Golokoz committed 6 months ago
35295ee
Remove dead set_label (#414)
uuuvn committed 6 months ago
da55d14
Remove dead create_buffer_with_data (#413)
uuuvn committed 6 months ago
f77c72a
Support Attention head_dim=512 (#412)
CCYeh committed 6 months ago
5ff6f3a
Simplify MoE (#410)
uuuvn committed 6 months ago
9664a13
Allocations clean up (#403)
LuckyIYI committed 6 months ago
4b1eab1