Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

fix matmul perf
eugene committed 8 months ago
fff0a55
internal metal kernels (#256)
uuuvn committed 8 months ago
260351d
Generalize and parallelize matmul kernel (#253)
Aleksandr Golokoz committed 8 months ago
9e6fe06
Better testing (#254)
uuuvn committed 8 months ago
6b1f81b
remove warmup (#252)
uuuvn committed 8 months ago
4dfd4df
Cpu matmul (#251)
Aleksandr Golokoz committed 8 months ago
02311b4
Cpu argmax (#248)
Aleksandr Golokoz committed 8 months ago
41d90c4
Remove EncodableBlock trait (#247)
uuuvn committed 8 months ago
cc90343
More cpu kernels (#246)
Aleksandr Golokoz committed 8 months ago
fb6f862
Fix kernel execution time (#245)
eugene committed 8 months ago
4f233f7
Speculation rate metric (#244)
Alexander Verbitsky committed 8 months ago
3ec7bb7
ngram speculator (#243)
uuuvn committed 8 months ago
dc4b5d1
CPU attention (#242)
Aleksandr Golokoz committed 8 months ago
5b13e45
Add rope.rs (#240)
Aleksandr Golokoz committed 8 months ago
62a812f
new encoder (#236)
uuuvn committed 8 months ago
5cfcf87
CPU RMS Norm (#238)
Aleksandr Golokoz committed 8 months ago
0a60c50
CPU token_* and tensor_* kernels (#234)
Aleksandr Golokoz committed 8 months ago
92a57d8
mut buf refs (#233)
uuuvn committed 8 months ago
11b6dd8
metal debug skill
eugene committed 8 months ago
122d904
Add cpu kernel (#231)
Aleksandr Golokoz committed 8 months ago
9e1762d
owned commandbuffer (#230)
uuuvn committed 8 months ago
f06b0a6
more muts (#229)
uuuvn committed 8 months ago
98fd54b
beginnings of the cpu backend (#226)
uuuvn committed 8 months ago
cd183c2
Dynamic dispatch backends (#222)
uuuvn committed 8 months ago
874dc65
Backend structs mutability (#228)
Aleksandr Golokoz committed 8 months ago
c00ed10
argmax shared struct (#225)
uuuvn committed 8 months ago
b50da5e
555dae3
Add chat streaming (#219)
Alexander Verbitsky committed 8 months ago
b20e0b3