🧠 两小时从 0 训出你的 64M 大模型。Train your own 64M LLM from scratch in 2 hours.
Commits on master
Merge pull request #594 from whiteswordLI/fix/lora-load-ddp-weights
048d84a jingyaogong committed 11 months ago
Fix: support loading DDP-saved LoRA weights for inference
3a18fdd whitesword committed 11 months ago
[fix] Refactor get_lr function to include min_lr calculation
bf3878a dyhuachi committed 11 months ago