AirLLM 2.8T LLM inference with single 4GB GPU
Python chinese-llmchinese-nlpfinetunegenerative-aiinstruct-gptinstruction-setllamallmloraopen-modelsopen-sourceopen-source-modelsqlora
dpo loss img
Yu Li2d7dacf32aa6
diff --git a/rlhf/DPO_loss.png b/rlhf/DPO_loss.pngnew file mode 100644index 0000000..abac091Binary files /dev/null and b/rlhf/DPO_loss.png differ