The best ChatGPT that $100 can buy.
Python
Commits on master
allow user to click on their message to edit them. conversation after that point is wiped
2846999 Andrej Karpathy committed 1 year ago
add script to train a 000 version of nanochat. currently it's a bit more like 00 and this would run in probably around 33 hours instead of the budget of 41 hours, so we might tune it later. i think it's ok for now
fae3aca Andrej Karpathy committed 1 year ago
fix subtle issue in token decoding in cases where multiple utf8 bytes need to be emitted into a single codepoint. exampels are emoji or foreign languages. basically we have to accumulate token sequences/text and only emit when we get full codepoints
4c3590c Andrej Karpathy committed 1 year ago
add basic logging to chat_web, which i think might be fun
03fa673 Andrej Karpathy committed 1 year ago
add very basic abuse prevention limits to chat_web so it's ok to host endpoints
52bfeea Andrej Karpathy committed 1 year ago
allow multiple GPUs to do inference in a data parallel way
01fb290 Andrej Karpathy committed 1 year ago
dont evaluate the sampling evals during SFT they are too slow. keep the multiple choice evals. delete unused imports
190d951 Andrej Karpathy committed 1 year ago
fix bug in learning rate multiplier, it was ramping up instead of ramping down. see more in Issue #68. also add --dry_run option useful for experimentation
b8076dd Andrej Karpathy committed 1 year ago
fix: return inf instead of crashing when evaluate_bpb has zero total_bytes
02440f6 Bhaskar committed 1 year ago
Fix: Handle missing d<number> model tags in find_largest_model
afaa5b4 Mirza-Samad-Ahmed-Baig committed 1 year ago