AirLLM 2.8T LLM inference with single 4GB GPU
Python chinese-llmchinese-nlpfinetunegenerative-aiinstruct-gptinstruction-setllamallmloraopen-modelsopen-sourceopen-source-modelsqlora
Commits on main
adding compression test to make sure prefetching doesn't break compression
21c01a3 Gavin Li committed 2 years ago