Skip to content

The best ChatGPT that $100 can buy.

Python

Commits on master

e7ed208
more GPU types from PR 147 thanks @Qubitium
Andrej Karpathy committed 10 months ago
f542524
add detection of device to report more correct mfu for bf16
Andrej Karpathy committed 10 months ago
2955650
Fix WANDB_RUN parameter passing in runcpu.sh (#407)
Yury Kirpichev committed 10 months ago
77a4690
bbc4413
fix condition to perform bpb evaluation (#324)
Nitish Pandey committed 10 months ago
f42ae9e
tweaks to readme a bit
Andrej Karpathy committed 10 months ago
6460dc6
brief update to log
Andrej Karpathy committed 10 months ago
1933e85
allow label for scaling laws script
Andrej Karpathy committed 10 months ago
3b95d4f
alternating design
Andrej Karpathy committed 10 months ago
e85db6b
simply one VE per layer, works best
Andrej Karpathy committed 10 months ago
9a88194
full ve version works very well
Andrej Karpathy committed 10 months ago
0b58d70
ranked version
Andrej Karpathy committed 10 months ago
e3f58b8
also add to log about the FA3 changes
Andrej Karpathy committed 10 months ago
184d4c1
typo in comments: change "GAPO" to "DAPO"
Haoyu Wang committed 10 months ago
50413d2
update log with a bunch of attempts
Andrej Karpathy committed 10 months ago
fbf2bbe
add negative result on olmo3 pretraining mix
Andrej Karpathy committed 10 months ago
747ed44
add zstd lib
Andrej Karpathy committed 10 months ago
7d1700c
Fix args in readme (#438)
Sofie Van Landeghem committed 10 months ago
d4ea28d
oops legacy spurious line now
Andrej Karpathy committed 10 months ago
bdcc030
cleanly separate cpu and gpu sections
Andrej Karpathy committed 10 months ago
255f8b9
minor helpful message
Andrej Karpathy committed 10 months ago
3142ca1