AirLLM 2.8T LLM inference with single 4GB GPU
Python chinese-llmchinese-nlpfinetunegenerative-aiinstruct-gptinstruction-setllamallmloraopen-modelsopen-sourceopen-source-modelsqlora
Update README.md
Gavin Lid42d465ca0a8
diff --git a/air_llm/README.md b/air_llm/README.mdindex d401ed5..b6ae68f 100644--- a/air_llm/README.md+++ b/air_llm/README.md@@ -10,6 +10,19 @@AirLLM优化inference内存,4GB单卡GPU可以运行70B大语言模型推理。不需要任何损失模型性能的量化和蒸馏,剪枝等模型压缩。+<a href="https://github.com/lyogavin/Anima/stargazers"></a>+[](https://pepy.tech/project/airllm)++[](https://github.com/LianjiaTech/BELLE/blob/main/LICENSE)+[](https://static.aicompose.cn/static/wecom_barcode.png?t=1671918938)+[](https://discord.gg/2xffU5sn)+[+](https://pypi.org/project/airllm/)+[](https://medium.com/@lyo.gavin)+[](https://patreon.com/gavinli)+[](https://github.com/sponsors/lyogavin)+## Updates