Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
uzu
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
A high-performance inference engine for AI models
Rust
ai
high-performance
inference
llm
metal
rust
tts
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
main
121 branches · 42 tags
Go to file
t
Code
Commits on
main
format
eugene committed 11 months ago
aac41e1
Copy SHA
Update README.md
Aleksei Savin committed 11 months ago
cf88165
Copy SHA
Fix unsafe NSHomeDirectory Update READE.md
Aleksei Savin committed 11 months ago
fe3f6ef
Copy SHA
xgrammar policy
uuuvn committed 11 months ago
e79ac76
Copy SHA
add session run autoreleaspool
eugene committed 11 months ago
d0d7032
Copy SHA
trie rewrite and guuumbel speculative decoding (#50)
uuuvn committed 11 months ago
fcfdfa2
Copy SHA
fix tests (#54)
uuuvn committed 11 months ago
60057cd
Copy SHA
Explicit AsyncBatchSize parameter
Aleksei Savin committed 11 months ago
e2d91be
Copy SHA
Async decoding (#52)
Aleksei Savin committed 11 months ago
0930977
Copy SHA
Restore test model
Aleksei Savin committed 11 months ago
1934b99
Copy SHA
manual unrolling + deleted unused code
LuckyIYI committed 11 months ago
05b66ff
Copy SHA
Disale speculation for SSM models
Aleksei Savin committed 12 months ago
0ebdda0
Copy SHA
fix attention config test (#49)
uuuvn committed 12 months ago
453468e
Copy SHA
metal validation fixes (#48)
uuuvn committed 12 months ago
4e15264
Copy SHA
Fix sampling
Aleksei Savin committed 12 months ago
445ec96
Copy SHA
SSM (#47)
LuckyIYI committed 12 months ago
8b4704c
Copy SHA
Small perf improvements to sampling kernels (#46)
uuuvn committed 12 months ago
b4752bf
Copy SHA
get next seed in root node instead of current (#45)
uuuvn committed 12 months ago
12a8da9
Copy SHA
from_sequences is used by external code (#44)
uuuvn committed 1 year ago
e623aa1
Copy SHA
policy/sampling separation (#41)
uuuvn committed 1 year ago
1601f2d
Copy SHA
CLI: prefill step size
Aleksei Savin committed 1 year ago
01acdb7
Copy SHA
Session reset added
Aleksei Savin committed 1 year ago
5121d90
Copy SHA
Context cache mode api (#40)
LuckyIYI committed 1 year ago
1315ad8
Copy SHA
Update README.md
Aleksei Savin committed 1 year ago
08e218b
Copy SHA
Update README.md
Aleksei Savin committed 1 year ago
d1bd479
Copy SHA
Update README.md
Aleksei Savin committed 1 year ago
579b443
Copy SHA
kv cache clear fix
LuckyIYI committed 1 year ago
91e1ef9
Copy SHA
using computed suffix start for prefill update in full layer (#39)
LuckyIYI committed 1 year ago
520ca65
Copy SHA
Sliding window refactoring (#38)
LuckyIYI committed 1 year ago
dfb71dc
Copy SHA
Check available memory
Aleksei Savin committed 1 year ago
f7c0a18
Copy SHA
Newer
Older