Skip to content

🧠 两小时从 0 训出你的 64M 大模型。Train your own 64M LLM from scratch in 2 hours.

Commits on master

[fix] loss-issues-430
jingyaogong committed 1 year ago
805744e
[fix] restore
jingyaogong committed 1 year ago
4014e62
[fix] issue-431
jingyaogong committed 1 year ago
557bcc0
[fix] sampler-ddp
jingyaogong committed 1 year ago
463044e
[fix] graph-oom & ddp-pos_cis
jingyaogong committed 1 year ago
fa7dff8
[fix] git track
jingyaogong committed 1 year ago
ce693f8
[feat] update readme
jingyaogong committed 1 year ago
d8bf813
[feat] minimind-2510
jingyaogong committed 1 year ago
7d877db
[feat] update eval
jingyaogong committed 1 year ago
3812a16
[feat] update requirements
jingyaogong committed 1 year ago
0682134
[fix] update model
jingyaogong committed 1 year ago
b8adffb
[fix] update model
jingyaogong committed 1 year ago
4e35fb9
update app
jingyaogong committed 1 year ago
36159fb
update torch version
jingyaogong committed 1 year ago
561979c
fix bugs
jingyaogong committed 1 year ago
caae54a
update lora
jingyaogong committed 1 year ago
5ffde04
update convert script
jingyaogong committed 1 year ago
2e118e9
fix bugs
jingyaogong committed 1 year ago
29454c3
update readme
jingyaogong committed 1 year ago
765c79c
update readme
jingyaogong committed 1 year ago
00d145c
250426
jingyaogong committed 1 year ago
274483c
250426
jingyaogong committed 1 year ago
a62faf3
update chat-openai-api
jingyaogong committed 1 year ago
7da201a
update moe note
jingyaogong committed 1 year ago
d9453ed
update eval
jingyaogong committed 1 year ago
d503093
fix top_p float bug
jingyaogong committed 1 year ago
4a75856
update rlaif
jingyaogong committed 1 year ago
4a7c1c4
update generate
jingyaogong committed 1 year ago
9e67798
add hidden state
jingyaogong committed 1 year ago
399d526
update inference
jingyaogong committed 1 year ago
885661f