The best ChatGPT that $100 can buy.
Python
Update run1000.sh to add missing --run=$WANDB_RUN
Jing Zhangba4f40bf588a
diff --git a/run1000.sh b/run1000.shindex e0bc4c4..46325d9 100644--- a/run1000.sh+++ b/run1000.sh@@ -70,7 +70,7 @@ python -m scripts.tok_eval# which would decrease model performance. Possibly 2, 3 or so epochs is ~ok, but certainly not ideal and at 10+ epochs we'd# start to overfit hard.# 5) That's it, everything else (e.g. the learning rates) is adjusted automatically by the training script.-torchrun --standalone --nproc_per_node=8 -m scripts.base_train -- --depth=32 --device_batch_size=8+torchrun --standalone --nproc_per_node=8 -m scripts.base_train -- --depth=32 --device_batch_size=8 --run=$WANDB_RUNtorchrun --standalone --nproc_per_node=8 -m scripts.base_losstorchrun --standalone --nproc_per_node=8 -m scripts.base_eval