Skip to content

AirLLM 2.8T LLM inference with single 4GB GPU

update install

Yu Lif5c68cb0b606
diff --git a/anima_100k/README.md b/anima_100k/README.md
index ede21f0..eea0477 100644
--- a/anima_100k/README.md
+++ b/anima_100k/README.md
@@ -158,6 +158,8 @@ pip install ninja
pip install flash-attn --no-build-isolation
pip install git+https://github.com/HazyResearch/flash-attention.git#subdirectory=csrc/rotary
pip install git+https://github.com/HazyResearch/flash-attention.git#subdirectory=csrc/xentropy
+pip install accelerate
+pip install bitsandbytes
```
#### 推理