Skip to content

🧠 两小时从 0 训出你的 64M 大模型。Train your own 64M LLM from scratch in 2 hours.

Commits on master

update inference
jingyaogong committed 1 year ago
ed01c5d
update seed set
jingyaogong committed 1 year ago
7fcc46b
update web_demo
jingyaogong committed 1 year ago
08e9a22
update dpo_loss
jingyaogong committed 1 year ago
278ec76
update structure image
jingyaogong committed 1 year ago
4f95e23
update structure image
jingyaogong committed 1 year ago
edc8d26
rmsnorm float convert
jingyaogong committed 1 year ago
bf81fd5
fix chat mask bug
jingyaogong committed 1 year ago
e369b33
delete __pycache__
jingyaogong committed 1 year ago
258507f
update readme
gongjy committed 1 year ago
04b56ea
update tokenizer load
gongjy committed 1 year ago
e34d4e9
update images
gongjy committed 1 year ago
45c0d12
update images
gongjy committed 1 year ago
f475e4e
update structure figure
gongjy committed 1 year ago
ef7dff9
update structure figure
gongjy committed 1 year ago
dcf5fcd
update generate args
gongjy committed 1 year ago
844e791
update generate args
gongjy committed 1 year ago
19b388c
update cis init
gongjy committed 1 year ago
5b65bc7
update web_demo
gongjy committed 1 year ago
c1a77f5
update web_demo
gongjy committed 1 year ago
d519d2a
fix bug
gongjy committed 1 year ago
e7ed058
fix bugs
gongjy committed 1 year ago
b5d10d9
update ckp-path
gongjy committed 1 year ago
416cc90
update lr
gongjy committed 1 year ago
bab4800
update lr
gongjy committed 1 year ago
d2f5ef4
update readme
gongjy committed 1 year ago
fea5b0e
update markdown
gongjy committed 1 year ago
291c19d
update markdown
gongjy committed 1 year ago
6f383e2
update readme
gongjy committed 1 year ago
97886fe
update readme
gongjy committed 1 year ago
be9b434