AirLLM 2.8T LLM inference with single 4GB GPU
Python chinese-llmchinese-nlpfinetunegenerative-aiinstruct-gptinstruction-setllamallmloraopen-modelsopen-sourceopen-source-modelsqlora
Commits on main
add safetensors model support, fix profiling, refactor code, fix typo
2b5d50b Yu Li committed 2 years ago