Skip to content

Ears for coding agents: let AI hear, review and make sound. CPU-only, open source.

round 5 notes: correct the finish time (16:30)

Leonxlnxd43e7abbd725
diff --git a/OVERNIGHT.md b/OVERNIGHT.md
index c3cb644..bcf0ee0 100644
--- a/OVERNIGHT.md
+++ b/OVERNIGHT.md
@@ -21,7 +21,7 @@ branch; the user verifies before anything reaches `main`.
| 2 | 05:20-08:55 | **forge v2 families.** Six maker areas (whoosh, sweep, impact, ui, tonal, digital) rewrote or added 22 recipes with CHARACTER parameters (length, brightness, sweep / pitch range, weight, texture) and FAMILIES of presets per category: 34 categories (18 real + 16 pro designed), 168 finals, 4-6 variants each, every member searched inside a narrow box around its preset, then one final run scoring the members together with robust re-renders; per-recipe model-free study checks (`measure` / `target_check` / `study_extra`) from docs/motion-sfx-study.md. Judge / integrator: benchmark additions (pro_* phrasings, `<cat>/final/` layout, audition.wav skipped), five core fixes (8-line reverb IR NaN, single-ref `score_refs` crash, flat_top false positive on subs, seed-bank cap 12 -> 48, `optimize` keeps DEFAULTS outside a narrow recipe SPACE), notify_04 start click re-rendered away, logo_sting audition rebuilt without the rejected variants. | Tests: 355 passed, 15 skipped (full fast suite, 416 s). Held-out bench `eval/forge/results_v2r2.md`: clones fixed (var cos v1 -> v2: click 0.886 -> 0.681, typing_key 0.965 -> 0.705, pop 0.917 -> 0.735, impact 0.931 -> 0.881, whoosh_fast 0.957 -> 0.856; real 0.48-0.86); tails fixed for click (t40 x 0.56 -> 1.22) and typing_key (1.67 -> 1.29 = real x), not for whoosh_fast (0.51 -> 0.49); 3 artifact flags in 168 sounds, all deliberate; critic passes 60 / 168. Best: whoosh_big (inside 7/7, real 5; AudioSet 'Whoosh' 5/5), typing_key, pro_pop_in. Worst: swipe (4-12 kHz 17 dB under the bench cloth), whoosh_fast + swish (tail 2x short, 8 dB boom, 15 dB hiss), logo_sting (rings 2.5x long). |
| 3 | 08:55-11:30 | **forge v2 fixes + core r3.** Five maker areas fixed the round-2 judge's faults in 29 categories (183 finals, round-2 finals kept in `<category>/final_r2/`): whoosh engine (continuous hiss band, long concave tail, `low_lag`, shelves, fabric rustle) for whoosh_fast / swish / swipe / whoosh_big / pro_whoosh_big; logo_sting redefined as a composed reveal (lead-in -> strike -> note / dyad -> short tail); impact contact sheen; UI (click room fed only the transient, toggle first contact loudest, tap contact + two-stage body, pro_click bodies, pro_hover_tick spike + grains, pro_pop_in families, pop snap); tonal (shimmer / notify free rings, pro_notify head, pro_pop chirp controls, riser / pro_riser / pro_zip noise layers); digital (typing_key width + thock, pro_typing grain / blip members, pro_glitch burst drama). Core: polish false flags (aliasing on the fold grid, ring narrow / pitch guards, designed / gated gates), critic thin-ref fallback (`Critic(category=)`, STUDY_TARGETS), reverb IR cache + fixed rooms, holdout / score_refs caches, `palette()` and `forge(families=)`. New: `earshot gallery` (static listening page, compare mode). Judge: full bench, own spectrogram sheets, round-2 finals put back for pop and pro_zip (r3 worse on the bench; r3 kept in `final_r3/`). | Tests: 400 passed, 15 skipped (full fast suite, 316 s). Held-out bench `eval/forge/results_v2r3.md`: swipe tone 13.5 -> 6.1 dB (4-12 kHz -35.9 -> -20.7, bench -19.2); whoosh_fast t40 x 0.49 -> 0.90, tone 9.4 -> 5.8 dB; swish t40 x 0.68 -> 1.04; logo_sting t40 x 2.48 -> 1.03, inside 3.5 -> 6 of 6; shimmer t40 x 0.48 -> 0.97, curve 14.1 -> 4.1 dB; typing_key stereo corr 0.34 -> 0.96; pro_click tone 25.8 -> 15.4 dB; clones fixed in pro_typing_key / run (0.93 -> 0.81) and pro_pop_in (0.90 -> 0.75); 0 artifact flags in 183 (r2: 3). Costs: AudioSet still hears door / knock in whoosh_fast / swish, impact contact now 11 dB brighter than the bench, model checks fell in typing_key / notify. |
| 4 | 11:30-14:00 | **forge v2 polish + finalize.** Three polish areas re-delivered 14 categories (round-3 finals in `<category>/final_r3/`). whoosh: the 'door' reading measured to the tail (a dark room ringing on the peak band), hiss that outlives the body, an accelerating 130 ms approach for whoosh_fast, side-signal width for swipe, new optional keys (`hiss_pre/tail/mfloor/width`, `low_width`, `room_damp`). impact: a quieter band-limited sheen, `plate` / `scatter` layers, a low strike under logo_sting, `zap` / `ctick` and five gestures for pro_logo_sting, `grain_jit` for pro_impact (its r3 0 dB onset tick came from forge's mid-range fill of missing SPACE keys). ui-tonal: toggle spring -> noisy rattle + steep high-pass (`hp_steep`), tap contact low-pass (`contact_lp_x`), pro_tap kick cue capped, notify `strike_max`, riser without drones, pro_pop `c_air` on one member; pro_notify tried twice, not delivered. Every new key defaults to the old behaviour. Also: the launch film re-scored with forge v2 (`earshot_launch_v2.mp4` in the local earshot-launch project). Then a clean blind test and a v1 -> v2 progress file (`eval/forge/blind_v2.py`). The gallery now has `--embed-compressed` and `--alias`. New: `docs/FORGE_V2.md` and `eval/forge/scrub_paths.py` (`bench.py` now writes scrubbed paths). The finalizer ran one full bench, kept r4 in all 14 categories and rebuilt the blind test, progress file, galleries and film. | Tests: 416 passed, 15 skipped (fast suite, final tree). Held-out bench `eval/forge/results_v2r4.md`, r3 -> r4: whoosh_fast variety 0.886 -> 0.768, darken -0.64 -> -0.05, AudioSet door-like top-1 6/6 -> 3/6. swish: AudioSet names 0 -> 0.8, typ z -3.1 -> 0.6. swipe: stereo corr 0.90 -> 0.64 (bench 0.68). toggle tone 10.4 -> 7.8 dB; tap tone 8.2 -> 5.8 dB, t40 x 1.82 -> 1.00. impact tone 5.3 -> 4.4 dB, variety 0.905 -> 0.849, onset tick 6.5 dB darker. pro_logo_sting tone 24.4 -> 15.9 dB; logo_sting 16.4 -> 13.1 dB (env oct worse); riser 11.3 -> 9.3 dB (env / curve worse). pro_impact's model checks fell; it was kept on the spectrogram. Breadth: tone at least as close as real forge refs in 18 of 21 categories (r3 17); 0 artifact flags in 183. Film: critique 16 -> 19 of 22 in range, realness 0.73 -> 0.85, cues within 1 frame 86 -> 95 %, -14.0 LUFS / TP -2.3. |
-| 5 | 14:05-16:45 | **forge v2 polish 2 + clean blind test + finalize.** polish-ui re-delivered whoosh_fast (the hiss band keeps sinking through the tail: new optional `tail_sweep` / `tail_tau` / `hiss_q` / `tail_gust` keys; per-member door fixes), tap (round-3 picks with per-member overrides) and logo_sting (smooth shimmer wash `shimmer_smooth`, round-3 leads, reverse_bloom `swell_trim`). polish-pro re-delivered pro_logo_sting (new sting mode 'gesture': five launch gestures from sines, filtered noise and a reverb fed above 250 Hz), pro_pop (natural chirp `c_nat`: no drive, no stepped gates) and pro_notify (the film ding made clean: no drive, no noise breath, a semitone ladder). Core fixed the round-4 fill bug (`search.fill_start`: start, recipe DEFAULTS, render-module DEFAULTS; mid-range only with a `MidRangeFill` warning), pinned every delivered member in the seed banks (`save_seeds(delivered=)`, `pin_delivered()`; 183 pins) and audited all 34 finals (hidden mid-range values only in pro_impact, kept). The blind test was rebuilt with symmetric trims and a cleanliness report that stops the build on a fail (`blind_v2.py --dry-run / --allow-fail`). Film: computed presence harmonics for phones (`v2lib.presence()`), a gentler logo limiter, the riser apex on its cue, a round-1 bug that skipped the sub drop / sting gates. The finalizer ran one full bench, kept r5 in 4 categories and put r4 back for tap and pro_pop (r5 in `final_r5/`), re-pinned the seed banks and rebuilt the blind test, progress file, galleries and film. | Tests: 433 passed, 15 skipped (fast suite, final tree, two halves 7.4 + 1.3 min). Held-out bench `eval/forge/results_v2r5.md`, r4 -> r5: pro_logo_sting variety 0.908 -> 0.642, tone 15.9 -> 15.6 dB, env oct 2.50 -> 2.15, margin -1.30 -> -0.68; whoosh_fast darken -0.05 -> -0.24 (bench -0.2), AudioSet names 0.5 -> 1.0 (variety 0.768 -> 0.831, inside the real rows); logo_sting decay roughness 0.46 -> 0.34 dB, pre-hit dip 14.6 -> 2.0 dB (reverse_bloom); pro_notify without the round-4 hiss, variety 0.822 -> 0.936. Not kept: tap (variety, curve, width worse) and pro_pop (variety 0.649 -> 0.780, phrase z and margin down; four members became steady beeps). Breadth unchanged: tone at least as close as real forge refs in 18 of 21, inside counts 11 of 22, 0 artifact flags in 183. Blind test: cleanliness PASS, 20 trials, 0.00 LU apart at the loudest moment, true peaks <= -1 dBTP, 118 s. Film: cues within 1 frame 95 -> 98 %, logo limiting 7.1 -> 3.3 dB, logo rise on a phone curve +1.1 -> +8.8 dB, critique 19 of 22, -14.0 LUFS / TP -2.2. |
+| 5 | 14:05-16:30 | **forge v2 polish 2 + clean blind test + finalize.** polish-ui re-delivered whoosh_fast (the hiss band keeps sinking through the tail: new optional `tail_sweep` / `tail_tau` / `hiss_q` / `tail_gust` keys; per-member door fixes), tap (round-3 picks with per-member overrides) and logo_sting (smooth shimmer wash `shimmer_smooth`, round-3 leads, reverse_bloom `swell_trim`). polish-pro re-delivered pro_logo_sting (new sting mode 'gesture': five launch gestures from sines, filtered noise and a reverb fed above 250 Hz), pro_pop (natural chirp `c_nat`: no drive, no stepped gates) and pro_notify (the film ding made clean: no drive, no noise breath, a semitone ladder). Core fixed the round-4 fill bug (`search.fill_start`: start, recipe DEFAULTS, render-module DEFAULTS; mid-range only with a `MidRangeFill` warning), pinned every delivered member in the seed banks (`save_seeds(delivered=)`, `pin_delivered()`; 183 pins) and audited all 34 finals (hidden mid-range values only in pro_impact, kept). The blind test was rebuilt with symmetric trims and a cleanliness report that stops the build on a fail (`blind_v2.py --dry-run / --allow-fail`). Film: computed presence harmonics for phones (`v2lib.presence()`), a gentler logo limiter, the riser apex on its cue, a round-1 bug that skipped the sub drop / sting gates. The finalizer ran one full bench, kept r5 in 4 categories and put r4 back for tap and pro_pop (r5 in `final_r5/`), re-pinned the seed banks and rebuilt the blind test, progress file, galleries and film. | Tests: 433 passed, 15 skipped (fast suite, final tree, two halves 7.4 + 1.3 min). Held-out bench `eval/forge/results_v2r5.md`, r4 -> r5: pro_logo_sting variety 0.908 -> 0.642, tone 15.9 -> 15.6 dB, env oct 2.50 -> 2.15, margin -1.30 -> -0.68; whoosh_fast darken -0.05 -> -0.24 (bench -0.2), AudioSet names 0.5 -> 1.0 (variety 0.768 -> 0.831, inside the real rows); logo_sting decay roughness 0.46 -> 0.34 dB, pre-hit dip 14.6 -> 2.0 dB (reverse_bloom); pro_notify without the round-4 hiss, variety 0.822 -> 0.936. Not kept: tap (variety, curve, width worse) and pro_pop (variety 0.649 -> 0.780, phrase z and margin down; four members became steady beeps). Breadth unchanged: tone at least as close as real forge refs in 18 of 21, inside counts 11 of 22, 0 artifact flags in 183. Blind test: cleanliness PASS, 20 trials, 0.00 LU apart at the loudest moment, true peaks <= -1 dBTP, 118 s. Film: cues within 1 frame 95 -> 98 %, logo limiting 7.1 -> 3.3 dB, logo rise on a phone curve +1.1 -> +8.8 dB, critique 19 of 22, -14.0 LUFS / TP -2.2. |
### Round 1 notes (integrator)
- What works end to end: `earshot forge <recipe> [--refset CAT]` -> critic v2 inside search v2 (pre-screen reuses the
@@ -217,7 +217,7 @@ still the deciding test.
- the seed banks also hold not-delivered attempts (ui-tonal) and only 1 of 5 logo_sting members.
- **Human listening (the blind test) is still the deciding test.** Nobody has listened.
-### Round 5 notes (finalizer, 15:56-16:45)
+### Round 5 notes (finalizer, 15:56-16:30)
- **Benchmark.** One full run at 15:58 on the delivered tree (`eval/forge/results_v2r5.json` / `.md`); nothing was
tuned on it. polish-ui had run it once (14:56), polish-pro twice (14:47 on candidates, 15:05 on the final tree).
The core area spent its one run on a typing_key re-render that it withdrew at 14:44; typing_key's final is the
diff --git a/eval/forge/results_v2r5.md b/eval/forge/results_v2r5.md
index f5fb08d..dcc76f9 100644
--- a/eval/forge/results_v2r5.md
+++ b/eval/forge/results_v2r5.md
@@ -219,7 +219,7 @@ Diversity among the made variants (CLAP cosine mean / max, tonal distance min dB
- whoosh_big: cos 0.76 / 0.902, tone min 3.3 dB, 0 near duplicate pair(s) (bench refs: cos 0.495 / 0.768, tone min 3.17 dB)
- whoosh_fast: cos 0.831 / 0.921, tone min 3.0 dB, 0 near duplicate pair(s) (bench refs: cos 0.772 / 0.951, tone min 2.28 dB)
-## Judge notes (round 5, finalizer, 15:56-16:45)
+## Judge notes (round 5, finalizer, 15:56-16:30)
Made = `out/forge_v2/<category>/final/` after round 5 (183 sounds, 34 categories). Round 5 re-delivered 6 categories:
whoosh_fast, tap, logo_sting (polish-ui) and pro_logo_sting, pro_pop, pro_notify (polish-pro). Their round-4 finals