Skip to content

The best ChatGPT that $100 can buy.

Python

Commits on master

add comment
Sofie Van Landeghem committed 7 months ago
a3ca42a
use nn.init and initialize smear gate's weight as well
Sofie Van Landeghem committed 7 months ago
9822cc7
update uv lock
svlandeg committed 7 months ago
12839c1
add setuptools for CPU run
svlandeg committed 7 months ago
8ef90bc
fix: initialize smear and backout lambdas in init_weights
Marcin Bogdanski committed 7 months ago
94b73ad
fix layer comment
svlandeg committed 7 months ago
b4e6763
print CORE score in chat_eval
svlandeg committed 7 months ago
c2082b3
update numbers from 3h to 1.5h
svlandeg committed 7 months ago
da13719
Merge branch 'master' into fix-batch-size-assertion
suraj-self committed 7 months ago
d8bbddb
delete non-essential deps from legacy use
Andrej Karpathy committed 8 months ago
03be953
Merge branch 'master' into fix-batch-size-assertion
suraj-self committed 8 months ago
9f9ef95
7808dc7
7b70f6b
47e983e
use COMPUTE_DTYPE-aware cast in Muon polar express step
Andrej Karpathy committed 8 months ago
c0dbf1f
bump D:N ratio to 12 per recent scaling laws re-run
Andrej Karpathy committed 8 months ago
1cd94d7
fix small bug with params logging and batch size
Andrej Karpathy committed 8 months ago
c16db28
Merge branch 'master' into fix-batch-size-assertion
suraj-self committed 8 months ago
9225067
Merge branch 'master' into fix/typo
svlandeg committed 8 months ago
dfe7d39
5019acc
~1.5h :-)
svlandeg committed 8 months ago
51f42a4
two more typos, from PR 645
svlandeg committed 8 months ago
1f9e42a
fix numbering
svlandeg committed 8 months ago
bd6e9c8
Merge branch 'master' into fix/typo
svlandeg committed 8 months ago
02e865c
Merge branch 'master' into fix-batch-size-assertion
suraj-self committed 8 months ago
daba23c
submit new time to GPT-2 leaderboard entry: 99 minutes
Andrej Karpathy committed 8 months ago
1b1cc3c
a825e63