Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
uzu
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
A high-performance inference engine for AI models
Rust
ai
high-performance
inference
llm
metal
rust
tts
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
main
121 branches · 42 tags
Go to file
t
Code
Commits on
main
MoE (#37)
LuckyIYI committed 1 year ago
85f732e
Copy SHA
new speculator api (#36)
uuuvn committed 1 year ago
269ecf1
Copy SHA
parameter's value resolving fix
Aleksei Savin committed 1 year ago
d9c2560
Copy SHA
fix regex syntax differenceis fix traces loading
Aleksei Savin committed 1 year ago
98d562d
Copy SHA
Chain of thought parsing (#34)
Aleksei Savin committed 1 year ago
a8f4b11
Copy SHA
export Session directly
Aleksei Savin committed 1 year ago
e84b338
Copy SHA
Improve API (#33)
Aleksei Savin committed 1 year ago
43fb2e9
Copy SHA
added kv_cache update to prefill and implemented proper syncronization (#32)
LuckyIYI committed 1 year ago
bc686d3
Copy SHA
test_generation_scenario added
Aleksei Savin committed 1 year ago
4ee516a
Copy SHA
add version to storage path
eugene committed 1 year ago
336b701
Copy SHA
bos_token in SessionInputProcessor (#31)
Aleksei Savin committed 1 year ago
35d8dc6
Copy SHA
Update README.md
Aleksei Savin committed 1 year ago
059c685
Copy SHA
Model spec update (#30)
Aleksei Savin committed 1 year ago
d5254d7
Copy SHA
Quantized matmul fixes (#29)
Aleksei Savin committed 1 year ago
8e82326
Copy SHA
Fix Unprocessable Entity (#28)
Aleksei Savin committed 1 year ago
5d5e7b8
Copy SHA
update uzu version
eugene committed 1 year ago
526472b
Copy SHA
update readme
eugene committed 1 year ago
bc411e0
Copy SHA
Quantized Matmul Kernles (#25)
LuckyIYI committed 1 year ago
12e103b
Copy SHA
replace panic with error
eugene committed 1 year ago
2818c63
Copy SHA
fix ios compilation
eugene committed 1 year ago
f961d36
Copy SHA
migrate to published mpsgraph
eugene committed 1 year ago
a96ba57
Copy SHA
Update MPSGraph (#19)
eugene committed 1 year ago
f92428a
Copy SHA
expose engine version
eugene committed 1 year ago
3b88cd9
Copy SHA
low memory device model restriction
eugene committed 1 year ago
71bc4f8
Copy SHA
Session context
LuckyIYI committed 1 year ago
a9931c8
Copy SHA
low memory device model restriction
eugene committed 1 year ago
a45f7c1
Copy SHA
update macos root dir
eugene committed 1 year ago
b3d7a5e
Copy SHA
Update README.md
Aleksei Savin committed 1 year ago
e1e4fdd
Copy SHA
Update README.md
Aleksei Savin committed 1 year ago
7e12e4b
Copy SHA
tokenizer_config.json parsing fix
Aleksei Savin committed 1 year ago
a6abe04
Copy SHA
Newer
Older