Skip to content

The best ChatGPT that $100 can buy.

Python

Commits on master

docs: fix typos in experiment log (#547)
Dipesh Babu committed 9 months ago
c7ba252
Merge branch 'master' into fix/kernel
svlandeg committed 9 months ago
a54691b
document MoE exploration
Andrej Karpathy committed 9 months ago
2dffdc8
report negative result on fineweb dataset
Andrej Karpathy committed 9 months ago
48804bf
fix comment
Andrej Karpathy committed 9 months ago
bb51378
Merge branch 'Chetter2-patch-1'
Andrej Karpathy committed 9 months ago
4585551
fix minor bug in fp8 application to skip tiny matmuls
Andrej Karpathy committed 9 months ago
bac5a35
Ada is also supported
Sofie Van Landeghem committed 9 months ago
0c4ce36
Add back docstring for clarification
Sofie Van Landeghem committed 9 months ago
345935c
Fix bug in setting precision (#538)
George Shakan committed 9 months ago
ad55575
Fix MockModel's device definition (#535)
Sofie Van Landeghem committed 9 months ago
cac43e8
update dev log with recent
Andrej Karpathy committed 9 months ago
f5fe792
Fix bug in setting precision (#538)
George Shakan committed 9 months ago
0a23f87
Fix MockModel's device definition (#535)
Sofie Van Landeghem committed 9 months ago
4800c62
update dev log with recent
Andrej Karpathy committed 9 months ago
4a6e47b
240a60f
124f49b
clarify that this is bf16 mfu we're talking about
Andrej Karpathy committed 9 months ago
2f09686
at 28 and above we start to need batch size 8
Andrej Karpathy committed 9 months ago
1ec0a34
new optimal ratio for d26 training
Andrej Karpathy committed 9 months ago
685271d