Skip to content

🧠 两小时从 0 训出你的 64M 大模型。Train your own 64M LLM from scratch in 2 hours.

Commits on master

[update] readme
jingyaogong committed 6 months ago
5020dc9
[fix] inference bug
jingyaogong committed 6 months ago
bdee223
[update] readme
jingyaogong committed 6 months ago
06d882e
[update] readme
jingyaogong committed 6 months ago
da865af
[fix] bugs
jingyaogong committed 6 months ago
773e451
[fix] rollout bugs
jingyaogong committed 6 months ago
6361510
[update] readme
jingyaogong committed 6 months ago
d4c6bc5
[update] readme
jingyaogong committed 7 months ago
24896cd
[update] readme
jingyaogong committed 7 months ago
e2fc397
[update] readme
jingyaogong committed 7 months ago
693fb1c
[fix] bugs
jingyaogong committed 7 months ago
5416a44
[fix] transformers-5.x
jingyaogong committed 7 months ago
1718e9a
[update] tie embedding
jingyaogong committed 7 months ago
5704766
[update] readme
jingyaogong committed 7 months ago
1ea113e
[update] readme
jingyaogong committed 7 months ago
487f787
[fix] lora compile
jingyaogong committed 7 months ago
e796b80
[update] readme
jingyaogong committed 7 months ago
b2488e6
[update] readme
jingyaogong committed 7 months ago
939dc8f
[update] bench
jingyaogong committed 7 months ago
cadacab
[fix] lora moe
jingyaogong committed 7 months ago
5351424
[update] add a comment
jingyaogong committed 7 months ago
aa3e6af
[update] image
jingyaogong committed 7 months ago
25a7edc
[update] readme
jingyaogong committed 7 months ago
cacf1d4
[update] open causal
jingyaogong committed 7 months ago
2ab6455
[update] readme
jingyaogong committed 7 months ago
9348fde
[update] readme
jingyaogong committed 7 months ago
90cd275
[update] default model
jingyaogong committed 7 months ago
b7e0ae2
[update] random seed
jingyaogong committed 7 months ago
b1865f7
[update] fp16 inference
jingyaogong committed 7 months ago
6b0b0c5
[update] image
jingyaogong committed 7 months ago
88e675d