Skip to content

AirLLM 2.8T LLM inference with single 4GB GPU

Commits on main

Update README.md
Gavin Li committed 2 years ago
81adf17
Update README.md
Gavin Li committed 2 years ago
cab7ee6
update
Yu Li committed 2 years ago
1bc546d
Update README.md
Gavin Li committed 2 years ago
015fe1a
wx
Yu Li committed 2 years ago
1363a5c
update readme
Yu Li committed 2 years ago
a20c407
wx group bar code
Yu Li committed 2 years ago
6601dd3
Merge pull request #97 from Naozumi520/patch-1
Gavin Li committed 2 years ago
55ba2b0
update 2d bar code
Yu Li committed 2 years ago
a218054
Fix TYPO
Naozumi committed 2 years ago
a2a04b5
support delete_original model files
Yu Li committed 2 years ago
c8a87f9
update 2d bar code
Yu Li committed 2 years ago
87b139f
refine readme
Yu Li committed 2 years ago
7055b92
refine readme
Yu Li committed 2 years ago
aba11e3
update readme
Yu Li committed 2 years ago
6e3eaab
fix table of contents
Yu Li committed 2 years ago
15332bf
fix automodel on macos
Yu Li committed 2 years ago
fcef20e
fix tqdm
Yu Li committed 2 years ago
2a22a6a
add macos support
Yu Li committed 2 years ago
44ef329
update test mixtral ipynb
Yu Li committed 2 years ago
b4229e4
add Mixtral
Yu Li committed 2 years ago
d2182a1
support hf_token in auto model
Yu Li committed 2 years ago
eeba6b0
test sealllm
Gavin Li committed 2 years ago
abfb9c0
fix compresession
Yu Li committed 2 years ago
ed58786
3d59aad
update readme about examples
Yu Li committed 2 years ago
7948044