Skip to content

armgit / Soup

Public Imported from GitHub
0

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

docs(contributors): #2126 [skip ci]

Alpamyse5fa5c2af0be
diff --git a/CONTRIBUTORS.md b/CONTRIBUTORS.md
index 71272331..8214e589 100644
--- a/CONTRIBUTORS.md
+++ b/CONTRIBUTORS.md
@@ -256,6 +256,7 @@ Listed by first contribution. PR numbers link the work.
- Made the CLI work with both a standalone Click and the Click newer Typer releases vendor: one compatibility layer for the command, exception and `ParameterSource` lookups, a nightly-only `typer-vendored` CI job pinned to Typer 0.27.3 / Click 8.4.2, and floor-job cases. **The part worth copying is the CI shape**: the new lane runs on schedule and dispatch only, so pull requests pay nothing for it, and its gate is pinned by a test that four mutations of the condition fail; the one macOS failure (`/var` -> `/private/var`) came back with a test that reproduces it on POSIX ([#1803](https://github.com/MakazhanAlpamys/Soup/issues/1803), [#2013](https://github.com/MakazhanAlpamys/Soup/pull/2013))
- Added the RunPod cloud-training controller behind `soup train --cloud runpod` (#264's remaining code slice): plan-only stub, closed GPU table, token-gated submit, and a delete that only counts once a GET returns 404, run as an isolated controller (`python -I`, allow-listed environment that keeps the proxy, temporary-directory, Windows and SSH-agent settings, per-run known-hosts file, output that replaces unencodable characters). **The part worth copying is the mutation table in the description**: after the first review every unguarded check got a test that fails when it is removed, the hardening items came in the same push, and the last round pinned each forwarded variable with its own parametrized case. 73 tests in `test_runpod_hardening.py`; the 44 one-line mutations of the controller and 23 of 25 new ones fail a named test (the other two are an equivalent Windows default and an untested `hasattr` guard) ([#264](https://github.com/MakazhanAlpamys/Soup/issues/264), [#2081](https://github.com/MakazhanAlpamys/Soup/pull/2081))
- Bound single-process layer streaming to the run's recorded Hub commit (#1902, first streaming slice): tokenizer, architecture config, meta skeletons and both weight downloads share one resolved commit, and the shard and weight-copy cache slots are keyed by it as `<slug>@<commit>`. They took the review's rulings (Unsloth left unbound so its pre-quantized mapping keeps working, the wider identity work taken out into separate pull requests, the first-run re-shard stated in the changelog and guide) and closed the last gap the mutation check found: both slot tests now pin the `@` separator, so changing it to `-` or `_` fails a named test. 10 new tests plus 26 in the extended CLI test; removing any of the boundaries fails a named test ([#1902](https://github.com/MakazhanAlpamys/Soup/issues/1902), [#2094](https://github.com/MakazhanAlpamys/Soup/pull/2094))
+ - Closed #2119: a KTO `label` of `null`, a float, a list or an object trained as a desirable or undesirable row instead of being refused (`bool(raw_label)` made `[]` False and `["no"]` True; floats were read as `> 0`, so `0.5` was desirable and `nan` undesirable). They made the shared converter accept a bool, the six documented strings and exactly `-1`, `0` and `1`, and refuse everything else with a `ValueError` that names the label and shows the value, so `soup data validate` and `soup train --dry-run` report it before any model loads. The tests enumerate the spellings (including `1.0`, `nan`, `inf`, `-1` as a string) through the converter, the loader reason and both CLI paths, and flip the old test that pinned `None -> False`; with the file as it is on `main` 42 of 66 fail, and six source mutations (the `bool()` branch, floats as `> 0`, integral floats, any integer, `-1` inverted, a message without the value) each fail at least one named test. The explicit bool branch is redundant and survives as an equivalent mutation ([#2119](https://github.com/MakazhanAlpamys/Soup/issues/2119), [#2126](https://github.com/MakazhanAlpamys/Soup/pull/2126))
- **AmixDigital** ([@Amix29](https://github.com/Amix29))
- Added native Sesame CSM fine-tuning for transcript/audio pairs, training the backbone and depth decoder while keeping the Mimi codec frozen; documented supported inputs, refusals and the scoped Apple Silicon evidence ([#265](https://github.com/MakazhanAlpamys/Soup/issues/265), [#1769](https://github.com/MakazhanAlpamys/Soup/pull/1769)).