AirLLM 2.8T LLM inference with single 4GB GPU
Python chinese-llmchinese-nlpfinetunegenerative-aiinstruct-gptinstruction-setllamallmloraopen-modelsopen-sourceopen-source-modelsqlora
update install
Yu Lif5c68cb0b606
diff --git a/anima_100k/README.md b/anima_100k/README.mdindex ede21f0..eea0477 100644--- a/anima_100k/README.md+++ b/anima_100k/README.md@@ -158,6 +158,8 @@ pip install ninjapip install flash-attn --no-build-isolationpip install git+https://github.com/HazyResearch/flash-attention.git#subdirectory=csrc/rotarypip install git+https://github.com/HazyResearch/flash-attention.git#subdirectory=csrc/xentropy+pip install accelerate+pip install bitsandbytes```#### 推理