Skip to content

🧠 两小时从 0 训出你的 64M 大模型。Train your own 64M LLM from scratch in 2 hours.

update requirements.txt

gongjy3696d3bf8009
diff --git a/requirements.txt b/requirements.txt
index 5fbaef7..516a4eb 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -23,5 +23,6 @@ tiktoken==0.5.1
torch==2.1.2+cu121
transformers==4.44.0
jinja2==3.1.2
+jsonlines==4.0.0
trl==0.8.6
ujson==5.1.0