Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
train-llm-from-scratch
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
A straightforward method for training your LLM, from downloading data to generating text.
Python
gemini
large-language-models
llm
openai
training
transformers
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
Files
main
7 branches · 0 tags
Go to file
t
Code
train-llm-from-scratch
/
images
Name
Last commit message
Last commit date
..
00_pipeline.mmd
1.1 KB
00_pipeline.png
192 KB
01_data.mmd
1.3 KB
01_data.png
745 KB
02_tokenization.mmd
1.1 KB
02_tokenization.png
189 KB
03_mlp.mmd
983 B
03_mlp.png
162 KB
04_attention_head.mmd
1.1 KB
04_attention_head.png
219 KB
05_multi_head_attention.mmd
1.0 KB
05_multi_head_attention.png
229 KB
06_transformer_block.mmd
1000 B
06_transformer_block.png
126 KB
07_transformer.mmd
1.1 KB
07_transformer.png
153 KB
08_training_loop.mmd
1.1 KB
08_training_loop.png
167 KB
09_sft.mmd
1.1 KB
09_sft.png
196 KB
10_reward_model.mmd
1.1 KB
10_reward_model.png
167 KB
11_dpo.mmd
1.0 KB
11_dpo.png
239 KB
12_ppo.mmd
1.1 KB
12_ppo.png
175 KB
13_grpo.mmd
1.0 KB
13_grpo.png
179 KB
14_evaluation.mmd
991 B
14_evaluation.png
187 KB
15_inference.mmd
1.0 KB
15_inference.png
192 KB
loss_curve.png
79.9 KB
PY
make_diagrams.py
7.1 KB
{}
mmdc.json
453 B
PY
plot_artifacts.py
3.2 KB
{}
puppeteer.json
57 B