The best ChatGPT that $100 can buy.
Python
Commits on master
actually let's not brick code on git pull. change error to warning
03cddd9 Andrej Karpathy committed 1 year ago
add personality to nanochat. breaks previous code on git pull and requires download of a new file from s3, but there is a helpful error message so hopefully its ok
fe5aed9 Andrej Karpathy committed 1 year ago
upgrading all other files to be able to use cpu/mps as well as cuda. various minor other changes ,e.g. changing max_iterations to num_iterations in sft script for consistency in naming
2e9669e karpathy committed 1 year ago
fix: remove unnecessary tensor allocation in DistAdamW optimizer
49cd02f Sermet Pekin committed 1 year ago
export NANOCHAT_BASE_DIR so child processes get it too
b1443dc Tancrède Lepoint committed 1 year ago
mention the current d32 chat hosted on nanochat.karpathy.ai, as an example endpoint of the repo
ccfe791 Andrej Karpathy committed 1 year ago
add autodetect of device and related stuff. getting weird warnings/errors still, so wip
786119d karpathy committed 1 year ago
add support for CPU and for MPS. I had to change a few cosmetic things. I also discovered I think a bit of a bug, where I was casting wte to bfloat16 in the wrong place (the model init) instead of in init_weights
306bc38 karpathy committed 1 year ago
also allow regenerating assistant message by clicking it, and make sure to feed good seed to generate
4346536 Andrej Karpathy committed 1 year ago