Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Python cliconsumer-gpudpofine-tuningggufhuggingfacellmllmopslocal-ailocal-llmloralow-vrammachine-learningollamapeftpythonpytorchqlorasfttransformers
Commits on main
test: skip the CPU bf16 autocast expert-stream case on Windows CI runners (illegal instruction) (#2167)
0ec5a1e Alpamys Makazhan committed 26 days ago
fix(tests): strip ANSI codes before matching console output in test_errors.py (#2176)
85d8c5f Daivik Awasthi committed 26 days ago
test(train): check the step trains, and cover asr with asr_lora (#797) (#2175)
297d5f4 Yang Bai committed 26 days ago
feat(merge): add --low-memory to merge a LoRA adapter tensor by tensor (#2006)
3ed0d7c Kuanysh committed 26 days ago
fix(serve): require --tool-auth-token for the python and bash tool routes on every bind (#2174)
38aded1 Alpamys Makazhan committed 26 days ago
fix(train): set the expandable_segments hint before detect_device starts CUDA (#2149) (#2156)
fd2bda4 Yang Bai committed 26 days ago
fix(train): thread the freeze plan into the LoRA layer selection (#1432) (#2145)
9d22776 Vansh Sharma committed 26 days ago
fix(train): honor gradient checkpointing in distill, classifier, asr and unlearn (#797) (#2140)
99e3e86 Yang Bai committed 26 days ago
fix(data): provide PDF and DOCX ingestion dependencies (#2096)
9eea763 Nurkhan Esenbek committed 26 days ago
fix(config): refuse unsupported resident Kimi K2 loads (#2130)
69bc8cb Nurkhan Esenbek committed 26 days ago
test: run the linear-growth timing tests on Linux only (#2148)
31b7057 Alpamys Makazhan committed 26 days ago
fix(serve): /v1/tools/python requires OS-level isolation, as /v1/tools/bash does (#2166)
080af6f Alpamys Makazhan committed 26 days ago
bench(giant-moe): seq-scaling probe on the synthetic 1T step (NO VERDICT, gate V5) (#2163)
3ad7ec3 Alpamys Makazhan committed 26 days ago
fix(config): refuse lora rank_pattern/alpha_pattern with backend: unsloth (they were ignored) (#2165)
5814100 Alpamys Makazhan committed 27 days ago