Skip to content

AirLLM 2.8T LLM inference with single 4GB GPU

update readme

Yu Li16e0942e2e3a
diff --git a/air_llm/README.md b/air_llm/README.md
index bdbf903..f2fa689 100644
--- a/air_llm/README.md
+++ b/air_llm/README.md
@@ -93,7 +93,7 @@ We just added model compression based on block-wise quantization based model com
```python
model = AirLLMLlama2("garage-bAInd/Platypus2-70B-instruct",
- compression='4bit' # specify '8bit' for 8-bit block-wise quantization
+ compression='4bit' # specify '8bit' for 8-bit block-wise quantization
)
```