Skip to content

🧠 两小时从 0 训出你的 64M 大模型。Train your own 64M LLM from scratch in 2 hours.

Commits on master

[update] fix decoding, drop tests
jingyaogong committed 1 day ago
cc9629e
9f05da1
[update] trim merged pr leftovers
jingyaogong committed 1 day ago
2de2308
[update] trim merged pr leftovers
jingyaogong committed 23 days ago
233d00f
0938214
[fix] keep resume checkpoint weights in fp32
Vincent committed 25 days ago
043b22a
7bde975
86aad50
[fix] residual step order
jingyaogong committed 1 month ago
f659b55