Skip to content

🧠 两小时从 0 训出你的 64M 大模型。Train your own 64M LLM from scratch in 2 hours.

Commits on master

update readme
gongjy committed 1 year ago
ddb7e66
update readme
gongjy committed 1 year ago
0c51048
update readme
gongjy committed 1 year ago
dd7a7ef
update readme
gongjy committed 1 year ago
fe2f119
update readme
gongjy committed 1 year ago
c2e67c2
update track
gongjy committed 1 year ago
b60fd11
update readme
gongjy committed 1 year ago
4c2b283
update config
gongjy committed 1 year ago
c9ca0f5
update online demo
gongjy committed 1 year ago
30f8614
update scripts file
gongjy committed 1 year ago
29d6cd9
add minimind2
gongjy committed 1 year ago
58e3af0
update readme
gongjy committed 1 year ago
6e9cd28
update lora-sft
gongjy committed 2 years ago
f7127e4
update train_tokenizer
gongjy committed 2 years ago
1240829
update fast_inference
gongjy committed 2 years ago
7c67ba0
update readme
gongjy committed 2 years ago
db39571
update eval-chat
gongjy committed 2 years ago
0bce9e5
update readme
gongjy committed 2 years ago
6d7a988
update process
gongjy committed 2 years ago
0d10efe
update readme
gongjy committed 2 years ago
517e0a4
update readme
gongjy committed 2 years ago
d63c525
update sft-lr
gongjy committed 2 years ago
a9e6596
update data_process
gongjy committed 2 years ago
42bd06e
update data_process
gongjy committed 2 years ago
69bcb8d
update model
gongjy committed 2 years ago
3ff66f7
update num_workers
gongjy committed 2 years ago
00e09ef
update sft
gongjy committed 2 years ago
f16991d
update rlhf
gongjy committed 2 years ago
6861d1a
update rlhf
gongjy committed 2 years ago
c59b8b3
update rlhf
gongjy committed 2 years ago
11d5cad