Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Python cliconsumer-gpudpofine-tuningggufhuggingfacellmllmopslocal-ailocal-llmloralow-vrammachine-learningollamapeftpythonpytorchqlorasfttransformers
Commits on main
feat(stream): admit Kimi K2 through transformers' own DeepseekV3Config behind a guard (#2107)
90e4921 Alpamys Makazhan committed 28 days ago
fix(sweep): stop random search hanging on a value listed twice (#2007)
c850599 Mohammad Hijjawi committed 28 days ago
ci: install the CPU-only torch wheel on the Linux jobs (#2118)
7d355d3 Alpamys Makazhan committed 29 days ago
feat(cli): add eager --version option (#2101) (#2105)
4dc0bc3 Nariman Abdikarim committed 29 days ago
fix(unlearn): respect explicit unlearn_alpha: 0.0 for pure forget loss (#2108) (#2114)
72aab2a Nariman Abdikarim committed 29 days ago
fix(eval): give mini_mmlu headroom below the 1.000 rail (#1192, 3/5) (#2113)
43d351f Aaron Probha committed 29 days ago
refactor(export): remove deprecated awq and gptq export formats (#1710) (#1951)
5a6df6b Nariman Abdikarim committed 29 days ago
feat(provenance): bind streamed base loads to recorded commits (#2094)
503aba5 Nurkhan Esenbek committed 29 days ago
fix(ui): delete training temp config when run ends (Refs #1464) (#1952)
d13fb3f Shivansh Shukla committed 29 days ago
fix(train): refuse the start confirm when stdin is not a TTY (#2052)
11fad3d vaputa committed 29 days ago
bench: publish the stream_loss_chunk peak-VRAM harness and its sizing section (#2102)
63dbb8c Yang Bai committed 29 days ago
fix(config): refuse data.chat_template with backend: mlx (#2051)
9584429 vaputa committed 29 days ago
feat(cloud): add RunPod controller with verified cleanup (#2081)
fc47970 Nurkhan Esenbek committed 29 days ago
ci: measure coverage only outside pull requests; pin the Docker guard range (#2109)
5c01d5e Alpamys Makazhan committed 29 days ago
fix(stream): refuse a packed or integer-quantised source by name, before the cache is written (#2103)
4a78a7b Alpamys Makazhan committed 29 days ago