Skip to content

armgit / uzu

Public Imported from GitHub
0

A high-performance inference engine for AI models

Commits on main

wasm downloader part 3: add example app (#595)
Aleksandr Golokoz committed 4 months ago
1977162
wasm downloader part 2: use kiban (#594)
Aleksandr Golokoz committed 4 months ago
f202a29
wasm downloader part 1: kiban (#593)
Aleksandr Golokoz committed 4 months ago
50b1169
5e16f90
weights free models
eugene committed 4 months ago
43a5058
Stream metrics (#596)
uuuvn committed 4 months ago
5832c96
update keisoku
eugene committed 4 months ago
7046359
Support DFlash Model (#588)
CCYeh committed 4 months ago
179307c
dbaa326
b38f8b6
Generalize attention Q/KV modes (#582)
CCYeh committed 4 months ago
adb9764
Support hidden capture (#581)
CCYeh committed 4 months ago
6af43c3
mirai gpui app
eugene committed 4 months ago
29081e2
Support `TreeUpdateSolve` kernel (#576)
CCYeh committed 4 months ago
3519024
Big refactor (#545)
uuuvn committed 4 months ago
71f14a4
Support `BuildTreeOut` kernel (#572)
CCYeh committed 4 months ago
b01d638
power sampling stats
eugene committed 4 months ago
8830c1a
Support BuildTreeGram Kernel (#569)
CCYeh committed 4 months ago
5f01024
clear c_fragment (#561)
eugene committed 4 months ago
746700e
Refactor fragment (#558)
CCYeh committed 4 months ago
45bfe58
Use euler tour (#557)
CCYeh committed 5 months ago
711687d
Support `BuildPrefixBeta` (#555)
CCYeh committed 5 months ago
1edbd33
introduce power sampling
eugene committed 5 months ago
5cc511a
support BuildPathMatrix kernels (#554)
CCYeh committed 5 months ago
61e1128
offline registry
eugene committed 5 months ago
85a033e
openai chat completions response format
Stan SKY committed 5 months ago
4c9a81c
reincarnate registry caching
eugene committed 5 months ago
fd3aea7