Skip to content

AirLLM 2.8T LLM inference with single 4GB GPU

Commits on main

fix ut
Yu Li committed 2 years ago
5cdf48b
fix ut
Yu Li committed 2 years ago
3f14529
fix ut
Yu Li committed 2 years ago
7ac3aed
fix ut
Yu Li committed 2 years ago
e4d50e0
fix ut
Yu Li committed 2 years ago
cccb70b
fix ut
Yu Li committed 2 years ago
4be0158
fix ut
Yu Li committed 2 years ago
bedc395
fix ut
Yu Li committed 2 years ago
e1c1aa6
profiling and compression
Yu Li committed 2 years ago
c2d13c1
update bar code
Yu Li committed 2 years ago
aa25914
add acknowlegement
Yu Li committed 2 years ago
a1325e7
Update README.md, increase max_new_tokens
Gavin Li committed 2 years ago
04da4fc
update 2d bar code
Yu Li committed 2 years ago
456e4f0
version
Yu Li committed 3 years ago
35536c8
233bed9
update readme
Yu Li committed 3 years ago
2f95f82
update readme
Yu Li committed 3 years ago
4e8ed06
update readme
Yu Li committed 3 years ago
b32d3a9
update readme
Yu Li committed 3 years ago
a3ebf3b
update readme
Yu Li committed 3 years ago
6eb999f
add FAQ
Yu Li committed 3 years ago
7fd1249
update readme
Yu Li committed 3 years ago
4d2c2b8
update readme
Yu Li committed 3 years ago
a6e5661
update readme
Yu Li committed 3 years ago
0d86017
update readme
Yu Li committed 3 years ago
ddc1b40
update readme
Yu Li committed 3 years ago
e2cf73d
update readme
Yu Li committed 3 years ago
167f3ea
add airllm
Yu Li committed 3 years ago
662d1d6
update group bar code
Yu Li committed 3 years ago
6770bdc