Clone any viral video with AI agents. Not just a script, the whole workflow: swap the face, the words, the B-roll, ship 100 variants in one command, and get your 100M views.
TypeScript agentic-aiaiai-agentsai-videocompilerdslffmpeggenerative-aillmmarkup-languagemonorepoplugin-systemprogramming-languagetext-to-videotypescriptvideovideo-automationvideo-clonevideo-editingvideo-generation
feat(v2): add author media surfaces and graph-first contracts
kashorina820db63ee62
diff --git a/README.md b/README.mdindex def6ff40..261fe2f8 100644--- a/README.md+++ b/README.md@@ -6,8 +6,8 @@> Candidate from a `BuildRequest`, and memoizes the reverse closure by stable `OperationId` before the> Build Machine executes anything. Reuse and product-level “Pin” UI actions are ordinary> Existing-Value Candidates, not Core branches; Providers only execute already selected exact-> CapabilityRefs. Declarative affinity prevents exact media evidence or provided values from being-> attached to the wrong Narrative/Basis.+> CapabilityRefs. Declarative affinity compares intrinsic identities such as ProgramSpace and the+> exact acoustic Blob; dependency and provenance truth stay in Graph, Derivation and Receipt.> `packages/speech-take` proves atomic Product plus ordinary audio/visual Projection;> `packages/elaborator` now links parser-independent Author Modules in two phases—predeclaring every> component output before resolving forward references—and expands content-addressed static@@ -83,25 +83,23 @@ remain optional. There is no privileged `@svml/author` package or required `.svkIf a domain Type declares a semantic validator, the Host additionally uses `@svml/validation` (oran equivalent implementation); the Type still does not enter Core.-Semantic Video Markup Language is a semantic source language for information-flow-video. Script creates stable semantic addresses. A Composition selects one-content-addressed `ProgramBasis` and one exact `SemanticMap`; flat Track-Components then lower every audiovisual contribution into one deterministic-HyperFrames HTML document.+Semantic Video Markup Language is a graph language for semantic, information-flow video. `.svml`+is the pleasant author notation; package Surfaces lower it into peer Logical Outputs, Candidates+and Operations. Script creates stable semantic addresses, while optional Film, Track and render+packages are ordinary graph regions rather than a mandatory one-way compiler pipeline.```text-.svml + transitive .svk/.svs/.svc imports + lock + evidence- │- ├─ typed Plan IR ─────────────────────────────> Canvas view- ├─ Basis Producer ─────> TemporalBasisProduction- ├─ Locator ────────────> CompleteSemanticMap- ├─ Basis + Map ────────> TemporalBinding ─────> Timeline view- └─ flat Track[] ───────> Composition ─────────> HyperFrames HTML+ ┌─> visual Track ───────────┐+.svml ─> typed Records + Graph ─> Take ├─> optional Composition ─> render+ │ └─> audio ─> evidence ─> Map ─┘+ ├────────────────────────────────────────────> any Map/Track Target+ └─> another independent branch ──────────────> another Target```-Canvas and Timeline are views of the same source closure, not additional-authoring truths. Provider tasks, pins, takes, caches and queue state belong to a-Runtime Host and do not enter the source language.+Reverse Demand starts from whichever Targets the user asks for, deduplicates shared Operations and+never grants final Film/render special status. Canvas and Timeline are views of the same source+closure, not additional authoring truths. Provider tasks, reused values, caches and queue state+belong to Graph realization or Runtime state and do not become hidden fields in the author source.## Implemented v1 slice@@ -232,8 +230,8 @@ generation provider is invoked by tests or compilation.Script Surface and specifies the complete namespaced author experience for two Seedance Mini speechtakes, Seedance B-roll, explicit WhisperX alignment, two speaker caption styles, editorial text,peer Tracks, Film and Hyperframes rendering. Its README marks every implemented and missing lowering;-Script, Film and Render are accepted by the current compiler, while the intervening generation,-Speech and Track Surfaces remain a design target.+Script, authored Image, Seedance generation, Film and Render are accepted by the current compiler,+while Speech assembly and Track Surfaces remain the next target.## Specification and implementation recorddiff --git a/docs/README.md b/docs/README.mdindex 6f219ce6..243985da 100644--- a/docs/README.md+++ b/docs/README.md@@ -10,41 +10,45 @@ inside a historical design record does not make that record normative.2. [`implementation-status.md`](./implementation-status.md) — what the v2 rewrite actuallyimplements now and what remains planned.3. [`../spec/core-kernel-v1.md`](../spec/core-kernel-v1.md) — current domain-free Kernel laws.-4. [`implementation-status.md#domain-neutral-package-boundary`](./implementation-status.md#domain-neutral-package-boundary)+4. [`graph-first-value-boundary-v1.md`](./graph-first-value-boundary-v1.md) — the implemented law+ that SVML lowers to a graph and that values contain intrinsic meaning while Graph, Derivation and+ Receipt own relationships and lineage.+5. [`implementation-status.md#domain-neutral-package-boundary`](./implementation-status.md#domain-neutral-package-boundary)— the minimal package stack for video and non-video domains.-5. [`../spec/script-surface-v1.md`](../spec/script-surface-v1.md) — current official Script Surface+6. [`../spec/script-surface-v1.md`](../spec/script-surface-v1.md) — current official Script Surfacetarget.-6. [`../spec/track-composition-v1.md`](../spec/track-composition-v1.md) — implemented flat Track and+7. [`../spec/track-composition-v1.md`](../spec/track-composition-v1.md) — implemented flat Track andComposition law and the generic HyperFrames lowering boundary.-7. [`../spec/track-expressiveness-v1.md`](../spec/track-expressiveness-v1.md) — executable freeze gate+8. [`../spec/track-expressiveness-v1.md`](../spec/track-expressiveness-v1.md) — executable freeze gatefor old-system Text, Caption, media-box, stacking and materialization behavior. It explains whythe current Track is a contract candidate rather than a public compatibility promise.-8. [`../spec/hyperframes-visual-ir-v1.md`](../spec/hyperframes-visual-ir-v1.md) — the one versioned,+9. [`../spec/hyperframes-visual-ir-v1.md`](../spec/hyperframes-visual-ir-v1.md) — the one versioned,closed terminal visual language shared by video components; not a Core or author-component API.-9. [`../examples/talking-film-golden/README.md`](../examples/talking-film-golden/README.md) — the- canonical v2 authoring target: implemented Script syntax surrounded by the Film, Seedance,- WhisperX, Caption, B-roll, Text, SVS and render Surfaces that must be built next.-10. [`package-vocabulary-and-ownership-v1.md`](./package-vocabulary-and-ownership-v1.md) — target+10. [`../examples/talking-film-golden/README.md`](../examples/talking-film-golden/README.md) — the+ canonical v2 authoring target: implemented Script, authored Image, Seedance generation, Film,+ SVS and render syntax surrounded by Speech assembly, WhisperX, Caption, B-roll and Text Surfaces+ that remain to be completed.+11. [`package-vocabulary-and-ownership-v1.md`](./package-vocabulary-and-ownership-v1.md) — targetnaming and ownership for framework, video, Provider, Runtime, queues, stores and distributions.-11. [`../spec/author-surface-binding-v1.md`](../spec/author-surface-binding-v1.md) — implemented+12. [`../spec/author-surface-binding-v1.md`](../spec/author-surface-binding-v1.md) — implementedpackage-owned binding from generic imported Records such as SVS Recipes into typed Programs,AuthorComponents and Graph Fragments.-12. [`local-developer-runtime-v1.md`](./local-developer-runtime-v1.md) — implemented local+13. [`local-developer-runtime-v1.md`](./local-developer-runtime-v1.md) — implemented localSQLite/filesystem Runtime assembly, trusted configuration, recovery law and environment swaps.-13. [`kie-generation-modules-v1.md`](./kie-generation-modules-v1.md) — implemented seven exact+14. [`kie-generation-modules-v1.md`](./kie-generation-modules-v1.md) — implemented seven exactgeneration model modules, shared generated-media Products and the recoverable KIE Provider.-14. [`kie-live-smoke-2026-08-06.md`](./kie-live-smoke-2026-08-06.md) — credential-free deployment+15. [`kie-live-smoke-2026-08-06.md`](./kie-live-smoke-2026-08-06.md) — credential-free deploymentevidence from seven representative live model calls and one synthetic-reference upload.-15. [`media-inspection-and-normalization-v1.md`](./media-inspection-and-normalization-v1.md) —+16. [`media-inspection-and-normalization-v1.md`](./media-inspection-and-normalization-v1.md) —implemented all-stream inspection, attached-picture-safe selection, shared-origin A/Vnormalization and the boundary that prevents embedded AAC from becoming speech by inference.-16. [`media-execution-boundary-v1.md`](./media-execution-boundary-v1.md) — the implemented rule that+17. [`media-execution-boundary-v1.md`](./media-execution-boundary-v1.md) — the implemented rule thatplanning is ordinary code while probe/decode/mix/render/mux are explicit Provider Needs, plusthe visual/audio/mux split for final HyperFrames output, canonical WhisperX evidence-audio pathand implemented local Providers.-17. [`../services/whisperx/README.md`](../services/whisperx/README.md) — installation, runtime+18. [`../services/whisperx/README.md`](../services/whisperx/README.md) — installation, runtimeidentity, path confinement and queue boundary for the implemented warm local WhisperX service.-18. [`node-package-activation-v1.md`](./node-package-activation-v1.md) — implemented trusted author+19. [`node-package-activation-v1.md`](./node-package-activation-v1.md) — implemented trusted authorand deterministic compute facet locking, with the exact boundary that keeps source imports awayfrom Provider and Runtime authority.diff --git a/examples/talking-film-golden/README.md b/examples/talking-film-golden/README.mdindex 65606cb0..92a10007 100644--- a/examples/talking-film-golden/README.md+++ b/examples/talking-film-golden/README.md@@ -1,8 +1,8 @@# Talking-film authoring golden fixture-Status: **v2 authoring target, not executable end to end yet.** Script, Film, generic SVS and the-explicit HyperFrames Render Surface are implemented. The intervening generation, Speech and Track-components are the concrete package-local work remaining.+Status: **v2 authoring target, not executable end to end yet.** Script, authored Image, Seedance+generation, Film, generic SVS and the explicit HyperFrames Render Surface are implemented. Speech+assembly and Track components are the concrete package-local work remaining.This example replaces neither the executable v1 fixtures nor their regression value. In particular,`examples/flat-track-launch` remains the capability oracle for selections, moments, B-roll motion,@@ -71,12 +71,12 @@ Candidates and Operations.| Author syntax | Owning package | Lowered meaning | Repository state ||---|---|---|---|| `<script>` | `@svml/script` | authored `Narrative` and projections | implemented |-| `media:Image` | `@svml/media` | content-addressed authored Artifact | package/Surface missing |-| `seedance:Prompt` | `@svml/seedance` | package-private immutable direction value | missing |-| `seedance:Speech model="mini"` | `@svml/seedance` | explicit Seedance Mini Need returning one speech clip Product | missing |+| `media:Image` | `@svml/media` | content-addressed authored Artifact | implemented |+| `seedance:Prompt` | `@svml/seedance` | package-private immutable direction value | implemented |+| `seedance:Speech model="mini"` | `@svml/seedance` | explicit Seedance Mini Need plus primary-video projection | implemented; explicit duration remains authored until Speech scheduling exists || `speech:Spine` | `@svml/speech` | ordered clips -> one `SpeechBasis`, then ordinary projections | basis and four locked projection facets implemented; author assembly missing || `whisperx:Alignment` | `@svml/whisperx` | 48k speech master -> explicit 16k evidence Need -> WhisperX -> provider-neutral `@svml/speech-align` -> Map | Graph Fragment, locked deterministic components, local media projection and local Provider/service implemented; Surface missing |-| `seedance:Video model="mini"` | `@svml/seedance` | explicit Seedance Mini video Need | missing |+| `seedance:Video model="mini"` | `@svml/seedance` | explicit Seedance Mini video Need plus primary-video projection | implemented || `broll:Track` | `@svml/broll` | semantic windows + media + recipe -> peer Visual/Audio Tracks | Program/lowering implemented; Surface missing || `caption:Track` | `@svml/caption-gemini` | timed projection + Gemini cue grouping + role recipe -> VisualTrack | timing/lowering and owner validators are locked components; complete Recipe audit and Gemini/role Surface missing || `text:Track` | `@svml/text-track` | package Program -> VisualTrack | Program/lowering implemented; Surface/exact-font use missing |@@ -84,7 +84,7 @@ Candidates and Operations.| `render:Video` | `@svml/hyperframes-render` | Composition -> silent HyperframesDocument render + explicit program audio + mux -> final video Artifact + Receipt | Surface, Fragment and all local execution Providers implemented || `studio.svs` | `@svml/svs` | generic immutable Recipe Records; consuming packages must validate and lower them | parser and recursive source import implemented; video recipe consumers/exact font lowering missing |-The missing work is intentionally package-local. None of these rows requires a new Core video type,+The remaining work is intentionally package-local. None of these rows requires a new Core video type,a component-family registry in Core, a privileged Film root or another Track kind.## Expected Provider bindingsdiff --git a/examples/talking-film-golden/main.svml b/examples/talking-film-golden/main.svmlindex 86508be1..6276c88a 100644--- a/examples/talking-film-golden/main.svml+++ b/examples/talking-film-golden/main.svml@@ -1,7 +1,8 @@<!--SVML authoring golden fixture.- Script, Film and HyperFrames Render Surfaces are implemented. The intervening- generation, Speech and Track Surfaces remain the package-local design target.+ Script, authored media, Seedance generation, Film and HyperFrames Render+ Surfaces are implemented. Speech assembly and Track Surfaces remain the+ package-local design target.--><svml><import from="@svml/script@1"/>@@ -58,6 +59,7 @@model="mini"script={script.segment.opening}prompt={alice-direction}+ duration="8"><seedance:Reference image={alice-reference} role="character"/></seedance:Speech>@@ -67,6 +69,7 @@model="mini"script={script.segment.answer}prompt={bob-direction}+ duration="8"><seedance:Reference image={bob-reference} role="character"/></seedance:Speech>@@ -84,6 +87,7 @@id="product-motion"model="mini"prompt={product-direction}+ duration="5"><seedance:Reference image={product-reference} role="subject"/></seedance:Video>diff --git a/packages/broll/src/manifest.ts b/packages/broll/src/manifest.tsindex 3858c8a1..807ad900 100644--- a/packages/broll/src/manifest.ts+++ b/packages/broll/src/manifest.ts@@ -91,7 +91,6 @@ export const brollProgramSchema: ValueSchema = object({export const brollProductSchema: ValueSchema = object({contract: { schema: { kind: "literal", value: "svml.broll-product@1" } },productDigest: { schema: digest },- programDigest: { schema: digest },programSpace: { schema: programSpaceSchema },visualTrack: { schema: visualTrackSchema },audioTrack: { schema: audioTrackSchema },@@ -122,7 +121,6 @@ export const brollManifest: ModuleManifest = {name: "product",type: brollTypes.product,affinity: [- { resultPointer: "/programDigest", input: "program", inputPointer: "/digest" },{ resultPointer: "/programSpace/digest", input: "space", inputPointer: "/digest" },],}],@@ -141,7 +139,6 @@ export const brollManifest: ModuleManifest = {type: contractTypes.visualTrack,affinity: [{ resultPointer: "/programSpaceDigest", input: "product", inputPointer: "/programSpace/digest" },- { resultPointer: "/sources/0/digest", input: "product", inputPointer: "/programDigest" },],}],needs: [],@@ -159,7 +156,6 @@ export const brollManifest: ModuleManifest = {type: contractTypes.audioTrack,affinity: [{ resultPointer: "/programSpaceDigest", input: "product", inputPointer: "/programSpace/digest" },- { resultPointer: "/sources/0/digest", input: "product", inputPointer: "/programDigest" },],}],needs: [],diff --git a/packages/broll/src/program.ts b/packages/broll/src/program.tsindex e1487ad2..0c2efaf0 100644--- a/packages/broll/src/program.ts+++ b/packages/broll/src/program.ts@@ -383,7 +383,6 @@ function audioClips(program: BrollProgram, programSpace: ProgramSpace): AudioClifunction productContent(value: Omit<BrollProduct, "productDigest">): Omit<BrollProduct, "productDigest"> {return {contract: "svml.broll-product@1",- programDigest: value.programDigest,programSpace: structuredClone(value.programSpace),visualTrack: structuredClone(value.visualTrack),audioTrack: structuredClone(value.audioTrack),@@ -397,13 +396,11 @@ export function computeBrollProductDigest(value: Omit<BrollProduct, "productDigeexport function compileBrollProduct(programSpace: ProgramSpace, program: BrollProgram): BrollProduct {assertBrollProgramIdentity(program, programSpace);const { incoming, outgoing } = transitionMaps(program, programSpaceFrameCount(programSpace));- const sources = [{ name: "program", digest: program.digest }];const visualTrack = sealVisualTrack({contract: "svml.visual-track@1",visualIr: "svml.hyperframes-visual-ir@1",id: `${program.id}:visual`,programSpaceDigest: programSpace.digest,- sources,presents: program.items.map((item) => ({id: item.id,span: { ...item.span },@@ -415,12 +412,10 @@ export function compileBrollProduct(programSpace: ProgramSpace, program: BrollPrcontract: "svml.audio-track@1",id: `${program.id}:audio`,programSpaceDigest: programSpace.digest,- sources,clips: audioClips(program, programSpace),});const content = productContent({contract: "svml.broll-product@1",- programDigest: program.digest,programSpace,visualTrack,audioTrack,@@ -435,10 +430,7 @@ export function assertBrollProductIdentity(product: BrollProduct, programSpace:assertProgramSpaceIdentity(product.programSpace);if (product.contract !== "svml.broll-product@1") throw new Error("Unsupported BrollProduct contract.");if (- !isDigest(product.programDigest)- || product.programSpace.digest !== programSpace.digest- || product.visualTrack.sources.find((source) => source.name === "program")?.digest !== product.programDigest- || product.audioTrack.sources.find((source) => source.name === "program")?.digest !== product.programDigest+ product.programSpace.digest !== programSpace.digest) throw new Error("BrollProduct affinity is invalid.");const { productDigest: _digest, ...content } = product;if (!isDigest(product.productDigest) || product.productDigest !== computeBrollProductDigest(content)) {diff --git a/packages/broll/src/types.ts b/packages/broll/src/types.tsindex 5f073328..6c0044ee 100644--- a/packages/broll/src/types.ts+++ b/packages/broll/src/types.ts@@ -66,7 +66,6 @@ export type BrollProgram = {export type BrollProduct = {readonly contract: "svml.broll-product@1";readonly productDigest: Digest;- readonly programDigest: Digest;readonly programSpace: ProgramSpace;readonly visualTrack: VisualTrack;readonly audioTrack: AudioTrack;diff --git a/packages/broll/test/broll.test.ts b/packages/broll/test/broll.test.tsindex 41c55e21..b84e6a5d 100644--- a/packages/broll/test/broll.test.ts+++ b/packages/broll/test/broll.test.ts@@ -88,7 +88,6 @@ test("B-roll owns local motion while every item remains an independently stackedvisualIr: "svml.hyperframes-visual-ir@1",id: "middle-overlay",programSpaceDigest: programSpace.digest,- sources: [{ name: "request", digest: digestOf("middle-overlay") }],presents: [{id: "middle",span: { startFrame: 0, endFrameExclusive: 300 },@@ -186,7 +185,6 @@ test("an Existing BrollProduct cannot recompute its own digest around an out-of-});const content = {contract: product.contract,- programDigest: product.programDigest,programSpace: product.programSpace,visualTrack: invalidVisual,audioTrack: product.audioTrack,diff --git a/packages/caption/src/manifest.ts b/packages/caption/src/manifest.tsindex e590202c..41fbb961 100644--- a/packages/caption/src/manifest.ts+++ b/packages/caption/src/manifest.ts@@ -58,8 +58,6 @@ const timedCaptionRegion = object({});export const timedCaptionProjectionSchema: ValueSchema = object({contract: { schema: { kind: "literal", value: "svml.timed-caption-projection@1" } },- semanticIndexDigest: { schema: digest },- speechTimeMapDigest: { schema: digest },programSpace: { schema: programSpaceSchema },text: { schema: { kind: "string" } },regions: { schema: { kind: "array", items: timedCaptionRegion } },@@ -136,8 +134,6 @@ export const captionManifest: ModuleManifest = {name: "caption",type: captionTypes.timedProjection,affinity: [- { resultPointer: "/semanticIndexDigest", input: "narrative", inputPointer: "/semanticIndex/digest" },- { resultPointer: "/speechTimeMapDigest", input: "map", inputPointer: "/mapDigest" },{ resultPointer: "/programSpace/digest", input: "map", inputPointer: "/programSpace/digest" },],}],@@ -159,8 +155,6 @@ export const captionManifest: ModuleManifest = {type: contractTypes.visualTrack,affinity: [{ resultPointer: "/programSpaceDigest", input: "caption", inputPointer: "/programSpace/digest" },- { resultPointer: "/sources/0/digest", input: "program", inputPointer: "/digest" },- { resultPointer: "/sources/1/digest", input: "caption", inputPointer: "/projectionDigest" },],}],needs: [],diff --git a/packages/caption/src/presentation.ts b/packages/caption/src/presentation.tsindex 83efdf38..62cfb0a6 100644--- a/packages/caption/src/presentation.ts+++ b/packages/caption/src/presentation.ts@@ -133,7 +133,6 @@ export function planCaptionPresentation(: characterFlow(region));const payload = {contract: "svml.caption-presentation-plan@0" as const,- sourceProjectionDigest: projection.projectionDigest,mode,units,};diff --git a/packages/caption/src/temporalize.ts b/packages/caption/src/temporalize.tsindex 89cbed70..33d9c31e 100644--- a/packages/caption/src/temporalize.ts+++ b/packages/caption/src/temporalize.ts@@ -22,12 +22,6 @@ export function temporalizeCaption(narrative: Narrative,map: CompleteSemanticMap,): TimedCaptionProjection {- if (map.semanticIndexDigest !== narrative.semanticIndex.digest) {- throw new CaptionProjectionError(- "CAPTION_SEMANTIC_INDEX",- "Caption Projection and speech time map use different Semantic Indexes.",- );- }const timingByToken = new Map(map.tokens.map((token) => [token.tokenId, token]));const sourceTiming = (startToken: number, endTokenExclusive: number, owner: string) => {const source = narrative.tokens.slice(startToken, endTokenExclusive);@@ -69,8 +63,6 @@ export function temporalizeCaption(});const payload = {contract: "svml.timed-caption-projection@1" as const,- semanticIndexDigest: narrative.semanticIndex.digest,- speechTimeMapDigest: map.mapDigest,programSpace: map.programSpace,text: narrative.captionProjection.text,regions,diff --git a/packages/caption/src/track.ts b/packages/caption/src/track.tsindex d22a59ec..12040150 100644--- a/packages/caption/src/track.ts+++ b/packages/caption/src/track.ts@@ -132,10 +132,6 @@ export function renderCaptionTrack(visualIr: "svml.hyperframes-visual-ir@1",id: program.id,programSpaceDigest: projection.programSpace.digest,- sources: [- { name: "program", digest: program.digest },- { name: "projection", digest: projection.projectionDigest },- ],presents: plan.units.flatMap((unit) => {const startFrame = Math.max(0, frameAt(projection, unit.startSec));const measuredEnd = Math.min(totalFrames, frameAt(projection, unit.endSec));diff --git a/packages/caption/src/types.ts b/packages/caption/src/types.tsindex c167ccc3..942e252a 100644--- a/packages/caption/src/types.ts+++ b/packages/caption/src/types.ts@@ -29,8 +29,6 @@ export type TimedCaptionRegion = {export type TimedCaptionProjection = {readonly contract: "svml.timed-caption-projection@1";- readonly semanticIndexDigest: Digest;- readonly speechTimeMapDigest: Digest;readonly programSpace: ProgramSpace;readonly text: string;readonly regions: readonly TimedCaptionRegion[];@@ -53,7 +51,6 @@ export type CaptionPresentationUnit = {export type CaptionPresentationPlan = {readonly contract: "svml.caption-presentation-plan@0";- readonly sourceProjectionDigest: Digest;readonly mode: CaptionPresentationMode;readonly units: readonly CaptionPresentationUnit[];readonly planDigest: Digest;diff --git a/packages/caption/test/caption.test.ts b/packages/caption/test/caption.test.tsindex 23bb1eb8..57777409 100644--- a/packages/caption/test/caption.test.ts+++ b/packages/caption/test/caption.test.ts@@ -54,17 +54,15 @@ function locate(narrative: Narrative, durationSec: number, segments: readonly AlsegmentId: segment.id,startSec: segments[index]!.startSec,endSec: segments[index]!.endSec,- sourceArtifactDigest: digestOf(`caption:clip:${segment.id}`),}));const basis = sealSpeechBasis({contract: "svml.speech-basis@1",- narrativeDigest: narrative.semanticIndex.digest,programSpace,audio: { digest: audioDigest, size: 1, mediaType: "audio/wav", durationSec },visualTrack: { clips: basisSegments.map((segment) => ({segmentId: segment.segmentId,artifact: {- digest: segment.sourceArtifactDigest,+ digest: digestOf(`caption:clip:${segment.segmentId}`),size: 1,mediaType: "video/mp4",durationSec: segment.endSec - segment.startSec,@@ -76,17 +74,13 @@ function locate(narrative: Narrative, durationSec: number, segments: readonly Al});const evidence = sealAlignedTranscriptEvidence({contract: "svml.aligned-transcript-evidence@1",- basisDigest: basis.basisDigest,- audioArtifactDigest: basis.audio.digest,+ audioArtifactDigest: digestOf("caption:acoustic-evidence"),programSpaceDigest: basis.programSpace.digest,- rawEvidenceArtifactDigest: digestOf("caption:raw-evidence"),durationSec,segments,});const audioBasis: SpeechAudioBasis = {contract: "svml.speech-audio-basis@1",- basisDigest: basis.basisDigest,- narrativeDigest: basis.narrativeDigest,programSpace: basis.programSpace,audio: basis.audio,segments: basis.segments,@@ -209,7 +203,6 @@ test("official caption styling lowers to an ordinary self-contained VisualTrack"assert.equal(track.contract, "svml.visual-track@1");assert.equal(track.programSpaceDigest, map.programSpace.digest);- assert.deepEqual(track.sources.map((source) => source.name), ["program", "projection"]);assert.equal(track.presents[0]?.elements.some((element) => element.kind === "text"), true);assert.equal(track.presents.flatMap((present) => present.elements).some((element) => "text" in element && element.text.includes("Hello")),@@ -237,8 +230,10 @@ test("two caption styles become two peer Tracks without mutating one another", (const secondTrack = renderCaptionTrack(projection, second);assert.notEqual(firstTrack.digest, secondTrack.digest);- assert.equal(firstTrack.sources.find((source) => source.name === "projection")?.digest, projection.projectionDigest);- assert.equal(secondTrack.sources.find((source) => source.name === "projection")?.digest, projection.projectionDigest);+ assert.deepEqual(+ firstTrack.presents.map((present) => present.span),+ secondTrack.presents.map((present) => present.span),+ );assert.equal(firstTrack.presents[0]?.stacking.order, 100);assert.equal(secondTrack.presents[0]?.stacking.order, 101);});diff --git a/packages/cli/README.md b/packages/cli/README.mdindex 62e74309..fac82473 100644--- a/packages/cli/README.md+++ b/packages/cli/README.md@@ -27,10 +27,10 @@ pnpm svml:v2 status <build-id> --runtime ./svml.runtime.tspnpm svml:v2 cancel <build-id> --runtime ./svml.runtime.ts```-`check` is usable for the implemented Script, Film, Render and recursively imported `.svs` sources.-`plan` is fully implemented by the generic Node compiler. A complete author video still awaits the-generation, Speech and Track Surfaces that produce Film's inputs; the CLI does not fabricate those-missing facts.+`check` is usable for the implemented Script, authored Image, Seedance generation, Film, Render and+recursively imported `.svs` sources. `plan` is fully implemented by the generic Node compiler. A+complete author video still awaits Speech assembly and Track Surfaces that produce Film's inputs;+the CLI does not fabricate those missing facts.`build` compiles the same locked BuildState and passes it to a trusted local Runtime config module.The default Build identity is content-derived, so the same invocation resumes durable local state;diff --git a/packages/cli/test/cli.test.ts b/packages/cli/test/cli.test.tsindex 1626a40e..b3604fa9 100644--- a/packages/cli/test/cli.test.ts+++ b/packages/cli/test/cli.test.ts@@ -39,10 +39,78 @@ test("official v2 CLI checks a real Script source through the Node compiler host"@svml/[email protected]","@svml/svs@1",]);- assert.deepEqual(result.exports, [{ name: "story", type: {- module: { name: "@svml/narrative", version: "0.0.0-dev" },- name: "Narrative",- }, kind: "record" }]);+ assert.deepEqual(result.exports, [+ { name: "story", type: {+ module: { name: "@svml/narrative", version: "0.0.0-dev" },+ name: "Narrative",+ }, kind: "record" },+ { name: "story.segment.opening", type: {+ module: { name: "@svml/narrative", version: "0.0.0-dev" },+ name: "NarrativeExcerpt",+ }, kind: "record" },+ ]);+});++test("official media and Seedance Surfaces lower author intent into exact generation steps", async () => {+ const root = await mkdtemp(join(tmpdir(), "svml-cli-generation-"));+ const file = join(root, "main.svml");+ await writeFile(join(root, "host.png"), new Uint8Array([137, 80, 78, 71]));+ await writeFile(file, `<svml>+ <import from="@svml/script@1"/>+ <import as="media" from="@svml/media@1"/>+ <import as="seedance" from="@svml/seedance@1"/>+ <script id="story"><opening><HOST>Say exactly these words.</opening></script>+ <media:Image id="host" src="./host.png"/>+ <seedance:Prompt id="direction">+ Locked medium close-up in a quiet daylight studio.+ </seedance:Prompt>+ <seedance:Speech id="take" model="mini" script={story.segment.opening}+ prompt={direction} duration="5">+ <seedance:Reference image={host} role="character"/>+ </seedance:Speech>+ <seedance:Video id="motion" model="mini" prompt={direction} duration="5"/>+ </svml>`, "utf8");++ let checkedOutput = "";+ await runCli(["check", file], { write: (text) => { checkedOutput += text; } });+ const checked = JSON.parse(checkedOutput) as {+ readonly ok: boolean;+ readonly sourceAssets: readonly { readonly mediaType: string }[];+ readonly exports: readonly { readonly name: string }[];+ };+ assert.equal(checked.ok, true);+ assert.deepEqual(checked.sourceAssets.map((item) => item.mediaType), ["image/png"]);+ assert.deepEqual(checked.exports.map((item) => item.name), [+ "direction",+ "host",+ "motion.request",+ "motion.video",+ "story",+ "story.segment.opening",+ "take",+ "take.request",+ ]);++ let planOutput = "";+ await runCli([+ "plan", file,+ "--target", "take",+ "--target", "motion.video",+ ], { write: (text) => { planOutput += text; } });+ const plan = JSON.parse(planOutput) as {+ readonly goals: readonly unknown[];+ readonly steps: readonly { readonly producer: { readonly name: string } }[];+ };+ assert.equal(plan.goals.length, 2);+ assert.deepEqual(+ plan.steps.map((step) => step.producer.name).sort(),+ [+ "request-seedance-2-mini",+ "request-seedance-2-mini",+ "select-primary-video",+ "select-primary-video",+ ],+ );});test("official v2 CLI closes the explicit HyperFrames render package without loading a Provider", async () => {diff --git a/packages/contracts/README.md b/packages/contracts/README.mdindex f93df866..bc979e2e 100644--- a/packages/contracts/README.md+++ b/packages/contracts/README.md@@ -14,11 +14,18 @@ and may later become `@svml/video` without changing those logical identities. Thcontains Provider- and Frontend-neutral data contracts, identity validators and static schemasonly. It does not parse SVML, execute external services, align speech or render Tracks.+`NarrativeExcerpt` is the shared contiguous author-selection contract used by+`script.segment.<id>` and speech-capable generation packages. It keeps model packages independent+of the official Script parser; the actual `<media:Image>` Surface implementation likewise lives in+the separate physical `@svml/media` package.+`VisualTrack`, `AudioTrack` and `Composition` implement the flat composition law in[`../../spec/track-composition-v1.md`](../../spec/track-composition-v1.md). Caption, Speech andB-roll are upstream package concerns; the final Composition contract contains no family field.-`VisualTrack` is an ownership/provenance aggregate, while each `VisualPresent` owns its own frame-span and absolute z so Presents from different Tracks may interleave without cross-Track access.+`VisualTrack` is one self-contained render contribution, while each `VisualPresent` owns its own+frame span and absolute z so Presents from different Tracks may interleave without cross-Track+access. Upstream ownership and provenance live in the Graph and Derivation rather than a generic+`sources[]` field copied into every Track.Every VisualTrack explicitly binds the closed[`svml.hyperframes-visual-ir@1`](../../spec/hyperframes-visual-ir-v1.md) target. This is the commondiff --git a/packages/contracts/src/identity.ts b/packages/contracts/src/identity.tsindex e50c9416..5ac5bc87 100644--- a/packages/contracts/src/identity.ts+++ b/packages/contracts/src/identity.ts@@ -112,9 +112,7 @@ export function assertSpeechEvidenceAudioIdentity(value: SpeechEvidenceAudio): vthrow new Error("Unsupported SpeechEvidenceAudio contract.");}if (- !isDigest(value.basisDigest)- || !isDigest(value.narrativeDigest)- || !isDigest(value.programSpaceDigest)+ !isDigest(value.programSpaceDigest)|| !isDigest(value.sourceAudioArtifactDigest)|| value.artifact.kind !== "blob"|| !isDigest(value.artifact.digest)@@ -181,9 +179,6 @@ export function assertSpeechAudioBasisIdentity(basis: SpeechAudioBasis): void {if (basis.contract !== "svml.speech-audio-basis@1") {throw new Error("Unsupported SpeechAudioBasis contract.");}- if (!isDigest(basis.basisDigest) || !isDigest(basis.narrativeDigest)) {- throw new Error("SpeechAudioBasis identity digest is invalid.");- }assertProgramSpaceIdentity(basis.programSpace);if (!Number.isFinite(basis.programSpace.durationSec)@@ -205,7 +200,6 @@ export function assertSpeechAudioBasisIdentity(basis: SpeechAudioBasis): void {|| segment.startSec < previousEnd|| segment.endSec < segment.startSec|| segment.endSec > basis.programSpace.durationSec- || !isDigest(segment.sourceArtifactDigest)) {throw new Error("SpeechAudioBasis Segment is invalid or out of order.");}diff --git a/packages/contracts/src/index.ts b/packages/contracts/src/index.tsindex 7c2d9e86..d9f4c0c3 100644--- a/packages/contracts/src/index.ts+++ b/packages/contracts/src/index.ts@@ -53,6 +53,7 @@ export {contractTypes,mediaManifest,mediaManifestDigest,+ mediaSurfaceImplementationDigests,mediaValidatorDigests,mediaModuleRef,narrativeManifest,@@ -78,6 +79,7 @@ export {synchronizedMediaSchema,timelineAudioSchema,narrativeSchema,+ narrativeExcerptSchema,programSpaceSchema,speechAudioBasisSchema,speechEvidenceAudioSchema,diff --git a/packages/contracts/src/manifest.ts b/packages/contracts/src/manifest.tsindex 9071a804..34b196c1 100644--- a/packages/contracts/src/manifest.ts+++ b/packages/contracts/src/manifest.ts@@ -16,6 +16,7 @@ export const compositionModuleRef = { name: "@svml/composition", version: "0.0.0export const contractTypes = {narrative: { module: narrativeModuleRef, name: "Narrative" },+ narrativeExcerpt: { module: narrativeModuleRef, name: "NarrativeExcerpt" },blobArtifact: { module: mediaModuleRef, name: "BlobArtifact" },mediaArtifact: { module: mediaModuleRef, name: "MediaArtifactRef" },mediaInspection: { module: mediaModuleRef, name: "MediaInspection" },@@ -113,6 +114,19 @@ export const narrativeSchema: ValueSchema = object({}) },});+export const narrativeExcerptSchema: ValueSchema = object({+ contract: { schema: { kind: "literal", value: "svml.narrative-excerpt@1" } },+ kind: { schema: { kind: "literal", value: "segment" } },+ id: { schema: string },+ tokenStart: { schema: integer },+ tokenEndExclusive: { schema: integer },+ serializations: { schema: object({+ dialogue: { schema: { kind: "string" } },+ speech: { schema: { kind: "string" } },+ }) },+ excerptDigest: { schema: digest },+});+export const mediaArtifactSchema = object({digest: { schema: digest }, size: { schema: integer }, mediaType: { schema: string }, durationSec: { schema: number },});@@ -190,8 +204,6 @@ export const mediaInspectionSchema: ValueSchema = object({export const mediaStreamSelectionSchema: ValueSchema = object({contract: { schema: { kind: "literal", value: "svml.media-stream-selection@1" } },- sourceArtifactDigest: { schema: digest },- inspectionDigest: { schema: digest },videoStreamIndex: { schema: integer, optional: true },audioStreamIndex: { schema: integer, optional: true },spanAuthority: { schema: { kind: "string", enum: ["video", "audio"] } },@@ -203,9 +215,6 @@ export const mediaStreamSelectionSchema: ValueSchema = object({export const synchronizedMediaSchema: ValueSchema = object({contract: { schema: { kind: "literal", value: "svml.synchronized-media@1" } },- sourceArtifactDigest: { schema: digest },- inspectionDigest: { schema: digest },- selectionDigest: { schema: digest },timeline: { schema: object({spanAuthority: { schema: { kind: "string", enum: ["video", "audio"] } },frameRate: { schema: mediaRationalSchema },@@ -323,12 +332,11 @@ export const programSpaceSchema = object({});const basisSegment = object({segmentId: { schema: string }, startSec: { schema: number }, endSec: { schema: number },- sourceArtifactDigest: { schema: digest },});export const speechBasisSchema: ValueSchema = object({contract: { schema: { kind: "literal", value: "svml.speech-basis@1" } },- basisDigest: { schema: digest }, narrativeDigest: { schema: digest },+ basisDigest: { schema: digest },programSpace: { schema: programSpaceSchema }, audio: { schema: mediaArtifactSchema },visualTrack: { schema: object({ clips: { schema: { kind: "array", items: object({segmentId: { schema: string }, artifact: { schema: mediaArtifactSchema }, startSec: { schema: number }, endSec: { schema: number },@@ -338,14 +346,12 @@ export const speechBasisSchema: ValueSchema = object({export const speechAudioBasisSchema: ValueSchema = object({contract: { schema: { kind: "literal", value: "svml.speech-audio-basis@1" } },- basisDigest: { schema: digest }, narrativeDigest: { schema: digest },programSpace: { schema: programSpaceSchema }, audio: { schema: mediaArtifactSchema },segments: { schema: { kind: "array", minItems: 1, items: basisSegment } },});export const speechEvidenceAudioSchema: ValueSchema = object({contract: { schema: { kind: "literal", value: "svml.speech-evidence-audio@1" } },- basisDigest: { schema: digest }, narrativeDigest: { schema: digest },programSpaceDigest: { schema: digest }, sourceAudioArtifactDigest: { schema: digest },artifact: { schema: blobArtifactSchema(["audio/wav"]) },codec: { schema: { kind: "literal", value: "pcm_s16le" } },@@ -377,8 +383,8 @@ const charEvidence = object({});export const alignedTranscriptEvidenceFields = {contract: { schema: { kind: "literal", value: "svml.aligned-transcript-evidence@1" } },- basisDigest: { schema: digest }, audioArtifactDigest: { schema: digest }, programSpaceDigest: { schema: digest },- rawEvidenceArtifactDigest: { schema: digest }, evidenceDigest: { schema: digest }, durationSec: { schema: number },+ audioArtifactDigest: { schema: digest }, programSpaceDigest: { schema: digest },+ evidenceDigest: { schema: digest }, durationSec: { schema: number },segments: { schema: { kind: "array", minItems: 1, items: object({sourceSegmentId: { schema: string }, startSec: { schema: number }, endSec: { schema: number },words: { schema: { kind: "array", items: wordEvidence } },@@ -416,9 +422,7 @@ const alignmentGroup = object({export const completeSemanticMapSchema: ValueSchema = object({contract: { schema: { kind: "literal", value: "svml.complete-semantic-map@1" } },- semanticIndexDigest: { schema: digest }, basisDigest: { schema: digest }, audioArtifactDigest: { schema: digest },- programSpaceDigest: { schema: digest }, programSpace: { schema: programSpaceSchema },- evidenceDigest: { schema: digest }, locatorDigest: { schema: digest },+ programSpace: { schema: programSpaceSchema },quantizationPolicy: { schema: { kind: "literal", value: "nearest-frame" } }, durationSec: { schema: number },segments: { schema: { kind: "array", items: timedSegment } },tokens: { schema: { kind: "array", items: timedToken } },@@ -489,15 +493,12 @@ const visualPresent = object({stacking: { schema: object({ order: { schema: signedInteger }, tieBreak: { schema: string } }) },elements: { schema: { kind: "array", minItems: 1, items: visualElement } },});-const trackSource = object({ name: { schema: string }, digest: { schema: digest } });-export const visualTrackSchema: ValueSchema = object({contract: { schema: { kind: "literal", value: "svml.visual-track@1" } },visualIr: { schema: { kind: "literal", value: HYPERFRAMES_VISUAL_IR_V1 } },digest: { schema: digest },id: { schema: string },programSpaceDigest: { schema: digest },- sources: { schema: { kind: "array", items: trackSource } },presents: { schema: { kind: "array", items: visualPresent } },});@@ -518,7 +519,6 @@ export const audioTrackSchema: ValueSchema = object({digest: { schema: digest },id: { schema: string },programSpaceDigest: { schema: digest },- sources: { schema: { kind: "array", items: trackSource } },clips: { schema: { kind: "array", items: audioClip } },});@@ -540,7 +540,10 @@ export const narrativeManifest: ModuleManifest = {name: narrativeModuleRef.name,version: narrativeModuleRef.version,dependencies: [],- types: [{ name: contractTypes.narrative.name, schema: narrativeSchema }],+ types: [+ { name: contractTypes.narrative.name, schema: narrativeSchema },+ { name: contractTypes.narrativeExcerpt.name, schema: narrativeExcerptSchema },+ ],capabilities: [],surfaces: [],producers: [],@@ -555,6 +558,10 @@ export const mediaValidatorDigests = {muxedMedia: digestOf("@svml/media/validate-muxed-media@1"),} as const;+export const mediaSurfaceImplementationDigests = {+ image: digestOf("@svml/media/image-surface@1"),+} as const;+export const mediaManifest: ModuleManifest = {format: "svml.module@0",name: mediaModuleRef.name,@@ -639,7 +646,17 @@ export const mediaManifest: ModuleManifest = {{ name: contractTypes.compositableSurface.name, schema: compositableSurfaceSchema },],capabilities: [],- surfaces: [],+ surfaces: [{+ name: "image",+ tag: "Image",+ mode: "structured",+ outputs: [contractTypes.blobArtifact],+ implementation: {+ kind: "trusted-frontend-surface",+ locator: "@svml/media/image-surface",+ digest: mediaSurfaceImplementationDigests.image,+ },+ }],producers: [],};diff --git a/packages/contracts/src/media-identity.ts b/packages/contracts/src/media-identity.tsindex eb48c246..e9d49e7a 100644--- a/packages/contracts/src/media-identity.ts+++ b/packages/contracts/src/media-identity.ts@@ -155,8 +155,6 @@ export function sealMediaStreamSelection(export function verifyMediaStreamSelection(value: unknown): asserts value is MediaStreamSelection {const item = object(value, "MediaStreamSelection") as unknown as MediaStreamSelection;assert(item.contract === "svml.media-stream-selection@1", "MediaStreamSelection contract is invalid");- assert(isDigest(item.sourceArtifactDigest), "MediaStreamSelection source digest is invalid");- assert(isDigest(item.inspectionDigest), "MediaStreamSelection inspection digest is invalid");if (item.videoStreamIndex !== undefined) nonNegativeInteger(item.videoStreamIndex, "MediaStreamSelection.videoStreamIndex");if (item.audioStreamIndex !== undefined) nonNegativeInteger(item.audioStreamIndex, "MediaStreamSelection.audioStreamIndex");assert(item.videoStreamIndex !== undefined || item.audioStreamIndex !== undefined,@@ -181,9 +179,6 @@ export function sealSynchronizedMedia(export function verifySynchronizedMedia(value: unknown): asserts value is SynchronizedMedia {const item = object(value, "SynchronizedMedia") as unknown as SynchronizedMedia;assert(item.contract === "svml.synchronized-media@1", "SynchronizedMedia contract is invalid");- assert(isDigest(item.sourceArtifactDigest), "SynchronizedMedia source digest is invalid");- assert(isDigest(item.inspectionDigest), "SynchronizedMedia inspection digest is invalid");- assert(isDigest(item.selectionDigest), "SynchronizedMedia selection digest is invalid");assert(item.timeline.spanAuthority === "video" || item.timeline.spanAuthority === "audio","SynchronizedMedia authority is invalid");verifyRational(item.timeline.frameRate, "SynchronizedMedia.timeline.frameRate");diff --git a/packages/contracts/src/media.ts b/packages/contracts/src/media.tsindex 417fe8da..4c42baaa 100644--- a/packages/contracts/src/media.ts+++ b/packages/contracts/src/media.ts@@ -71,8 +71,6 @@ export type MediaInspection = {export type MediaStreamSelection = {readonly contract: "svml.media-stream-selection@1";- readonly sourceArtifactDigest: Digest;- readonly inspectionDigest: Digest;readonly videoStreamIndex?: number;readonly audioStreamIndex?: number;readonly spanAuthority: "video" | "audio";@@ -86,9 +84,6 @@ export type MediaStreamSelection = {export type SynchronizedMedia = {readonly contract: "svml.synchronized-media@1";- readonly sourceArtifactDigest: Digest;- readonly inspectionDigest: Digest;- readonly selectionDigest: Digest;readonly timeline: {readonly spanAuthority: "video" | "audio";readonly frameRate: MediaRational;diff --git a/packages/contracts/src/narrative.ts b/packages/contracts/src/narrative.tsindex 0bae7ea1..6054ae19 100644--- a/packages/contracts/src/narrative.ts+++ b/packages/contracts/src/narrative.ts@@ -108,4 +108,22 @@ export type Narrative = {readonly speech: string;};};++/**+ * One author-selected contiguous excerpt. Script is one possible producer;+ * generation and speech packages consume this shared value without importing+ * Script's parser or source representation.+ */+export type NarrativeExcerpt = {+ readonly contract: "svml.narrative-excerpt@1";+ readonly kind: "segment";+ readonly id: string;+ readonly tokenStart: number;+ readonly tokenEndExclusive: number;+ readonly serializations: {+ readonly dialogue: string;+ readonly speech: string;+ };+ readonly excerptDigest: Digest;+};import type { Digest } from "@svml/protocol";diff --git a/packages/contracts/src/speech.ts b/packages/contracts/src/speech.tsindex c04923f5..17e4a374 100644--- a/packages/contracts/src/speech.ts+++ b/packages/contracts/src/speech.ts@@ -23,14 +23,11 @@ export type SpeechBasisSegment = {readonly segmentId: string;readonly startSec: number;readonly endSec: number;- readonly sourceArtifactDigest: Digest;};export type SpeechBasis = {readonly contract: "svml.speech-basis@1";readonly basisDigest: Digest;- /** Semantic identity of the authored Narrative whose speech this Basis realizes. */- readonly narrativeDigest: Digest;readonly programSpace: ProgramSpace;readonly audio: MediaArtifactRef;readonly visualTrack: {@@ -47,8 +44,6 @@ export type SpeechBasis = {/** Deterministic audio projection of one atomic SpeechBasis/SpeechTake Product. */export type SpeechAudioBasis = {readonly contract: "svml.speech-audio-basis@1";- readonly basisDigest: Digest;- readonly narrativeDigest: Digest;readonly programSpace: ProgramSpace;readonly audio: MediaArtifactRef;readonly segments: readonly SpeechBasisSegment[];@@ -57,8 +52,6 @@ export type SpeechAudioBasis = {/** Canonical 16 kHz mono PCM projection used only for acoustic alignment evidence. */export type SpeechEvidenceAudio = {readonly contract: "svml.speech-evidence-audio@1";- readonly basisDigest: Digest;- readonly narrativeDigest: Digest;readonly programSpaceDigest: Digest;/** The 48 kHz speech-master bytes from which this projection was derived. */readonly sourceAudioArtifactDigest: Digest;@@ -113,10 +106,9 @@ export type AlignedTranscriptSegment = {export type AlignedTranscriptEvidence = {readonly contract: "svml.aligned-transcript-evidence@1";- readonly basisDigest: Digest;+ /** Exact acoustic Artifact measured by the recognizer. */readonly audioArtifactDigest: Digest;readonly programSpaceDigest: Digest;- readonly rawEvidenceArtifactDigest: Digest;readonly evidenceDigest: Digest;readonly durationSec: number;readonly segments: readonly AlignedTranscriptSegment[];@@ -169,13 +161,7 @@ export type SemanticTimePoint = {export type CompleteSemanticMap = {readonly contract: "svml.complete-semantic-map@1";- readonly semanticIndexDigest: Digest;- readonly basisDigest: Digest;- readonly audioArtifactDigest: Digest;- readonly programSpaceDigest: Digest;readonly programSpace: ProgramSpace;- readonly evidenceDigest: Digest;- readonly locatorDigest: Digest;readonly quantizationPolicy: "nearest-frame";readonly durationSec: number;readonly segments: readonly TimedSpeechSegment[];diff --git a/packages/contracts/src/track.ts b/packages/contracts/src/track.tsindex d9d0d22f..24fe5d9d 100644--- a/packages/contracts/src/track.ts+++ b/packages/contracts/src/track.ts@@ -97,11 +97,6 @@ export type VisualPresent = {readonly elements: readonly VisualElement[];};-export type TrackSource = {- readonly name: string;- readonly digest: Digest;-};-export type VisualTrack = {readonly contract: "svml.visual-track@1";/** The one terminal visual language shared by official video components. */@@ -109,8 +104,6 @@ export type VisualTrack = {readonly digest: Digest;readonly id: string;readonly programSpaceDigest: Digest;- /** Domain-neutral semantic commitments bound by Producer affinity declarations. */- readonly sources: readonly TrackSource[];/** Author-owned contributions that Composition may interleave by absolute z. */readonly presents: readonly VisualPresent[];};@@ -132,7 +125,6 @@ export type AudioTrack = {readonly digest: Digest;readonly id: string;readonly programSpaceDigest: Digest;- readonly sources: readonly TrackSource[];readonly clips: readonly AudioClip[];};@@ -199,22 +191,6 @@ function assertStyle(style: readonly VisualStyleDeclaration[], label: string): v}}-function assertSources(sources: readonly TrackSource[], label: string): void {- const names = new Set<string>();- for (const source of sources) {- assertNonEmpty(source.name, `${label} source name`);- if (names.has(source.name)) throw new Error(`${label} contains duplicate source ${source.name}.`);- names.add(source.name);- if (!isDigest(source.digest)) throw new Error(`${label}.${source.name} source digest is invalid.`);- }-}--function normalizeSources(sources: readonly TrackSource[]): TrackSource[] {- return [...sources]- .map((source) => ({ name: source.name, digest: source.digest }))- .sort((left, right) => left.name.localeCompare(right.name));-}-function assertAttributes(attributes: readonly VisualAttribute[] | undefined, label: string): void {const names = new Set<string>();for (const attribute of attributes ?? []) {@@ -431,7 +407,6 @@ function visualTrackContent(value: Omit<VisualTrack, "digest">): Omit<VisualTracvisualIr: value.visualIr,id: value.id,programSpaceDigest: value.programSpaceDigest,- sources: normalizeSources(value.sources),presents: [...value.presents].map((present) => ({id: present.id,@@ -451,7 +426,6 @@ function audioTrackContent(value: Omit<AudioTrack, "digest">): Omit<AudioTrack,contract: "svml.audio-track@1",id: value.id,programSpaceDigest: value.programSpaceDigest,- sources: normalizeSources(value.sources),clips: [...value.clips].map((clip) => ({id: clip.id,@@ -491,7 +465,6 @@ export function assertVisualTrackIdentity(track: VisualTrack, programSpace?: Proif (track.contract !== "svml.visual-track@1") throw new Error("Unsupported VisualTrack contract.");if (track.visualIr !== HYPERFRAMES_VISUAL_IR_V1) throw new Error("Unsupported VisualTrack visual IR.");assertNonEmpty(track.id, "VisualTrack id");- assertSources(track.sources, track.id);if (!isDigest(track.programSpaceDigest)) throw new Error(`${track.id} has an invalid ProgramSpace digest.`);if (programSpace !== undefined && track.programSpaceDigest !== programSpace.digest) {throw new Error(`${track.id} belongs to another ProgramSpace.`);@@ -512,7 +485,6 @@ export function assertAudioTrackIdentity(track: AudioTrack, programSpace?: Progrif (programSpace !== undefined) assertProgramSpaceIdentity(programSpace);if (track.contract !== "svml.audio-track@1") throw new Error("Unsupported AudioTrack contract.");assertNonEmpty(track.id, "AudioTrack id");- assertSources(track.sources, track.id);if (!isDigest(track.programSpaceDigest)) throw new Error(`${track.id} has an invalid ProgramSpace digest.`);if (programSpace !== undefined && track.programSpaceDigest !== programSpace.digest) {throw new Error(`${track.id} belongs to another ProgramSpace.`);diff --git a/packages/contracts/test/render.test.ts b/packages/contracts/test/render.test.tsindex 38f4641a..8825a675 100644--- a/packages/contracts/test/render.test.ts+++ b/packages/contracts/test/render.test.ts@@ -86,7 +86,6 @@ test("exact fonts own font selection and cannot conflict with raw CSS font factsvisualIr: "svml.hyperframes-visual-ir@1",id: "invalid-font-track",programSpaceDigest: space.digest,- sources: [{ name: "fixture", digest: digestOf("invalid-font-track") }],presents: [{id: "title",span: { startFrame: 0, endFrameExclusive: 60 },@@ -119,7 +118,6 @@ test("animated materialized Surfaces must exactly share the Present frame domainvisualIr: "svml.hyperframes-visual-ir@1",id: "surface-track",programSpaceDigest: space.digest,- sources: [{ name: "receipt", digest: digestOf("surface-receipt") }],presents: [{id: "surface",span: { startFrame: 0, endFrameExclusive: 60 },diff --git a/packages/contracts/test/speech-evidence.test.ts b/packages/contracts/test/speech-evidence.test.tsindex 63e8cd82..9448664d 100644--- a/packages/contracts/test/speech-evidence.test.ts+++ b/packages/contracts/test/speech-evidence.test.ts@@ -26,8 +26,6 @@ test("speech evidence uses integer rational boundary projection rather than floatest("SpeechEvidenceAudio binds source bytes, evidence bytes and the complete sample map", () => {const value = sealSpeechEvidenceAudio({contract: "svml.speech-evidence-audio@1",- basisDigest: digestOf("basis"),- narrativeDigest: digestOf("narrative"),programSpaceDigest: digestOf("program"),sourceAudioArtifactDigest: digestOf("master"),artifact: {@@ -41,7 +39,7 @@ test("SpeechEvidenceAudio binds source bytes, evidence bytes and the complete sachannels: 1,sampleFrames: 16_000,durationSec: 1,- segments: [{ segmentId: "line", startSec: 0, endSec: 1, sourceArtifactDigest: digestOf("visual") }],+ segments: [{ segmentId: "line", startSec: 0, endSec: 1 }],sampleMap: {algorithm: "rational-boundary-round@1",sourceSampleRate: 48_000,diff --git a/packages/contracts/test/track.test.ts b/packages/contracts/test/track.test.tsindex 532ecf2b..9e3489e0 100644--- a/packages/contracts/test/track.test.ts+++ b/packages/contracts/test/track.test.ts@@ -44,7 +44,6 @@ function fixture() {visualIr: "svml.hyperframes-visual-ir@1",id: "caption",programSpaceDigest: programSpace.digest,- sources: [{ name: "projection", digest: digestOf("caption-projection") }],presents: [{id: "cue-1",span: { startFrame: 0, endFrameExclusive: 60 },@@ -59,7 +58,6 @@ function fixture() {contract: "svml.audio-track@1",id: "speech",programSpaceDigest: programSpace.digest,- sources: [{ name: "basis", digest: digestOf("speech-basis") }],clips: [{ id: "speech", span: { startFrame: 0, endFrameExclusive: 120 }, artifact: audio, bus: "speech" }],});return { programSpace, visual, sound };diff --git a/packages/core/src/affinity.ts b/packages/core/src/affinity.tsindex d1013fc0..68a8ac5f 100644--- a/packages/core/src/affinity.ts+++ b/packages/core/src/affinity.ts@@ -51,9 +51,12 @@ function atPointer(value: unknown, pointer: string, subject: string): unknown {return current;}-function inlineValue(value: StoredValue, subject: string): unknown {- invariant(value.kind === "inline", "AFFINITY_REQUIRES_INLINE_VALUE", `${subject} must be inline`, subject);- return value.value;+function affinityValue(value: StoredValue): unknown {+ // BlobRef is a first-class StoredValue and has stable JSON fields. Treating it+ // as its own affinity value lets generic packages prove that a projected+ // artifact is the exact member of an inline Product without wrapping bytes in+ // a domain-specific object.+ return value.kind === "inline" ? value.value : value;}function sourceRecordId(graph: CompiledGraph, plan: BuildPlan, source: GraphValueRef): string {@@ -87,8 +90,8 @@ export function verifyRecordAffinity(`${outputId} cannot prove affinity to ${sourceId}; provide that source or mark this Candidate substitute`,outputId,);- const resultValue = atPointer(inlineValue(record.value, record.id), constraint.resultPointer, record.id);- const sourceValue = atPointer(inlineValue(source.value, source.id), constraint.sourcePointer, source.id);+ const resultValue = atPointer(affinityValue(record.value), constraint.resultPointer, record.id);+ const sourceValue = atPointer(affinityValue(source.value), constraint.sourcePointer, source.id);invariant(canonicalStringify(resultValue) === canonicalStringify(sourceValue),"AFFINITY_MISMATCH",@@ -161,8 +164,8 @@ export function verifyProducerRecordAffinity(`${record.id} cannot prove affinity to ${inputId}`,record.id,);- const resultValue = atPointer(inlineValue(record.value, record.id), affinity.resultPointer, record.id);- const inputValue = atPointer(inlineValue(input.value, input.id), affinity.inputPointer, input.id);+ const resultValue = atPointer(affinityValue(record.value), affinity.resultPointer, record.id);+ const inputValue = atPointer(affinityValue(input.value), affinity.inputPointer, input.id);invariant(canonicalStringify(resultValue) === canonicalStringify(inputValue),"AFFINITY_MISMATCH",diff --git a/packages/core/test/core.test.ts b/packages/core/test/core.test.tsindex afb318d4..d7ee8f05 100644--- a/packages/core/test/core.test.ts+++ b/packages/core/test/core.test.ts@@ -8,12 +8,16 @@ import {reduce,validatePlan,verifyBuildState,+ verifyRecordAffinity,} from "@svml/core";import type {BuildEvent,+ BuildPlan,BuildState,+ CompiledGraph,FulfillNeedCommand,InvokeProducerCommand,+ TypedRecord,} from "@svml/protocol";import { createGreetingBuild, producers } from "./greeting-fixture.js";@@ -164,6 +168,53 @@ test("Producer result affinity rejects an exact output that lies about its input);});+test("affinity can prove a first-class BlobRef without a domain wrapper", () => {+ const selected = {+ kind: "blob",+ digest: digestOf("selected-image"),+ size: 3,+ mediaType: "image/png",+ } as const;+ const source = {+ id: "set",+ value: { kind: "inline", value: { images: [selected] } },+ } as unknown as TypedRecord;+ const output = {+ id: "image",+ conformance: "exact",+ value: selected,+ } as unknown as TypedRecord;+ const graph = {+ outputs: [{+ id: "primary-image",+ affinity: [{+ resultPointer: "/digest",+ source: { kind: "record", id: source.id },+ sourcePointer: "/images/0/digest",+ }],+ }],+ } as unknown as CompiledGraph;+ const plan = { selections: [] } as unknown as BuildPlan;++ assert.doesNotThrow(() => verifyRecordAffinity(+ graph,+ plan,+ "primary-image",+ output,+ (id) => id === source.id ? source : undefined,+ ));+ assert.throws(+ () => verifyRecordAffinity(+ graph,+ plan,+ "primary-image",+ { ...output, value: { ...selected, digest: digestOf("different-image") } },+ (id) => id === source.id ? source : undefined,+ ),+ (error: unknown) => error instanceof CoreError && error.code === "AFFINITY_MISMATCH",+ );+});+test("an exact Need rejects a substitute fulfillment", () => {const current = reachNeed();assert.throws(diff --git a/packages/film/test/film.test.ts b/packages/film/test/film.test.tsindex 8bcf20f6..5a92b927 100644--- a/packages/film/test/film.test.ts+++ b/packages/film/test/film.test.ts@@ -98,7 +98,6 @@ const background = sealVisualTrack({visualIr: "svml.hyperframes-visual-ir@1",id: "background-track",programSpaceDigest: space.digest,- sources: [{ name: "fixture", digest: digestOf("background") }],presents: [{id: "background",span: { startFrame: 0, endFrameExclusive: 120 },@@ -110,7 +109,6 @@ const audio = sealAudioTrack({contract: "svml.audio-track@1",id: "empty-audio-track",programSpaceDigest: space.digest,- sources: [{ name: "fixture", digest: digestOf("audio") }],clips: [],});@@ -264,6 +262,6 @@ test("the Driver folds peer Tracks, then independently compiles the Composition"test("Film rejects duplicate Track ids before Composition", () => {const set = appendFilmVisualTrack(createFilmTrackSet(space), background);- const duplicate = sealVisualTrack({ ...background, sources: [{ name: "other", digest: digestOf("other") }] });+ const duplicate = sealVisualTrack({ ...background });assert.throws(() => appendFilmVisualTrack(set, duplicate), /already contains Track id/u);});diff --git a/packages/film/test/surface.test.ts b/packages/film/test/surface.test.tsindex 418a2830..2a9394d5 100644--- a/packages/film/test/surface.test.ts+++ b/packages/film/test/surface.test.ts@@ -71,14 +71,12 @@ const visual = sealVisualTrack({visualIr: "svml.hyperframes-visual-ir@1",id: "visual",programSpaceDigest: space.digest,- sources: [{ name: "fixture", digest: digestOf("film-surface-visual") }],presents: [],});const audio = sealAudioTrack({contract: "svml.audio-track@1",id: "audio",programSpaceDigest: space.digest,- sources: [{ name: "fixture", digest: digestOf("film-surface-audio") }],clips: [],});diff --git a/packages/generation/package.json b/packages/generation/package.jsonindex e7c73c1f..1def7e89 100644--- a/packages/generation/package.json+++ b/packages/generation/package.json@@ -8,6 +8,7 @@},"dependencies": {"@svml/component-kit": "workspace:*",+ "@svml/contracts": "workspace:*","@svml/protocol": "workspace:*"},"devDependencies": {diff --git a/packages/generation/src/component.ts b/packages/generation/src/component.tsindex a682a62f..299eef3a 100644--- a/packages/generation/src/component.ts+++ b/packages/generation/src/component.ts@@ -5,6 +5,8 @@ import {verifyGeneratedVideoSet,} from "./identity.js";import {+ generationProducerDigests,+ generationProducers,generationTypes,generationValidatorDigests,} from "./manifest.js";@@ -14,9 +16,40 @@ function inline(value: { readonly kind: string; readonly value?: unknown }, subjreturn value.value;}+function primary(+ value: { readonly kind: string; readonly value?: unknown },+ kind: "image" | "video",+): import("@svml/protocol").BlobRef {+ const content = inline(value, `Generated${kind === "image" ? "Image" : "Video"}Set`) as {+ readonly images?: readonly import("@svml/protocol").BlobRef[];+ readonly videos?: readonly import("@svml/protocol").BlobRef[];+ };+ const selected = kind === "image" ? content.images?.[0] : content.videos?.[0];+ if (selected === undefined) throw new Error(`Generated ${kind} set has no primary artifact`);+ return selected;+}+/** Host-side semantic refinements for the shared generated-media contracts. */export const generationComponent = {name: "@svml/generation",+ producers: [+ {+ producer: generationProducers.primaryImage,+ implementationDigest: generationProducerDigests.primaryImage,+ handler: ({ inputs }) => ({+ outputs: { image: primary(inputs.set!.value, "image") },+ needs: {},+ }),+ },+ {+ producer: generationProducers.primaryVideo,+ implementationDigest: generationProducerDigests.primaryVideo,+ handler: ({ inputs }) => ({+ outputs: { video: primary(inputs.set!.value, "video") },+ needs: {},+ }),+ },+ ],validators: [{type: generationTypes.imageSet,diff --git a/packages/generation/src/identity.ts b/packages/generation/src/identity.tsindex b9fccaa9..700d90da 100644--- a/packages/generation/src/identity.ts+++ b/packages/generation/src/identity.ts@@ -55,8 +55,6 @@ export function verifyGenerationRequestDigest(value: unknown): asserts value isexport function sealGeneratedImageSet(content: GeneratedImageSetContent): GeneratedImageSet {assert(content.contract === "svml.generated-image-set@1", "Generated image contract is invalid");- assert(content.model.trim().length > 0, "Generated image model is empty");- assert(isDigest(content.requestDigest), "Generated image request digest is invalid");assert(content.images.length > 0, "Generated image set is empty");content.images.forEach((artifact) => assertGenerationBlobRef(artifact, "image/"));const normalized = canonicalize(content) as unknown as GeneratedImageSetContent;@@ -66,8 +64,6 @@ export function sealGeneratedImageSet(content: GeneratedImageSetContent): Generaexport function verifyGeneratedImageSet(value: unknown): asserts value is GeneratedImageSet {const object = plainObject(value, "Generated image set") as unknown as GeneratedImageSet;assert(object.contract === "svml.generated-image-set@1", "Generated image contract is invalid");- assert(typeof object.model === "string" && object.model.length > 0, "Generated image model is empty");- assert(isDigest(object.requestDigest), "Generated image request digest is invalid");assert(Array.isArray(object.images) && object.images.length > 0, "Generated image set is empty");object.images.forEach((artifact) => assertGenerationBlobRef(artifact, "image/"));const { resultDigest, ...content } = object;@@ -76,10 +72,6 @@ export function verifyGeneratedImageSet(value: unknown): asserts value is Generaexport function sealGeneratedVideoSet(content: GeneratedVideoSetContent): GeneratedVideoSet {assert(content.contract === "svml.generated-video-set@1", "Generated video contract is invalid");- assert(content.model.trim().length > 0, "Generated video model is empty");- assert(isDigest(content.requestDigest), "Generated video request digest is invalid");- assert(Number.isFinite(content.requestedDurationSec) && content.requestedDurationSec >= 0,- "Generated video requested duration is invalid");assert(content.videos.length > 0, "Generated video set is empty");content.videos.forEach((artifact) => assertGenerationBlobRef(artifact, "video/"));const normalized = canonicalize(content) as unknown as GeneratedVideoSetContent;@@ -89,10 +81,6 @@ export function sealGeneratedVideoSet(content: GeneratedVideoSetContent): Generaexport function verifyGeneratedVideoSet(value: unknown): asserts value is GeneratedVideoSet {const object = plainObject(value, "Generated video set") as unknown as GeneratedVideoSet;assert(object.contract === "svml.generated-video-set@1", "Generated video contract is invalid");- assert(typeof object.model === "string" && object.model.length > 0, "Generated video model is empty");- assert(isDigest(object.requestDigest), "Generated video request digest is invalid");- assert(Number.isFinite(object.requestedDurationSec) && object.requestedDurationSec >= 0,- "Generated video requested duration is invalid");assert(Array.isArray(object.videos) && object.videos.length > 0, "Generated video set is empty");object.videos.forEach((artifact) => assertGenerationBlobRef(artifact, "video/"));const { resultDigest, ...content } = object;diff --git a/packages/generation/src/index.ts b/packages/generation/src/index.tsindex b7d0c6fe..0bb36c9d 100644--- a/packages/generation/src/index.ts+++ b/packages/generation/src/index.ts@@ -12,6 +12,8 @@ export {generationManifest,generationManifestDigest,generationModuleRef,+ generationProducerDigests,+ generationProducers,generationTypes,generationValidatorDigests,} from "./manifest.js";diff --git a/packages/generation/src/manifest.ts b/packages/generation/src/manifest.tsindex 628daf24..dd6735f8 100644--- a/packages/generation/src/manifest.ts+++ b/packages/generation/src/manifest.ts@@ -1,5 +1,9 @@+import {+ contractTypes,+ videoContractDependencies,+} from "@svml/contracts";import { digestOf } from "@svml/protocol";-import type { ModuleManifest, TypeRef } from "@svml/protocol";+import type { ModuleManifest, ProducerRef, TypeRef } from "@svml/protocol";import { generatedImageSetSchema, generatedVideoSetSchema } from "./schema.js";@@ -14,11 +18,21 @@ export const generationValidatorDigests = {videoSet: digestOf("@svml/generation/validate-generated-video-set@1"),};+export const generationProducers = {+ primaryImage: { module: generationModuleRef, name: "select-primary-image" },+ primaryVideo: { module: generationModuleRef, name: "select-primary-video" },+} satisfies Record<string, ProducerRef>;++export const generationProducerDigests = {+ primaryImage: digestOf("@svml/generation/select-primary-image@1"),+ primaryVideo: digestOf("@svml/generation/select-primary-video@1"),+} as const;+export const generationManifest: ModuleManifest = {format: "svml.module@0",name: generationModuleRef.name,version: generationModuleRef.version,- dependencies: [],+ dependencies: [videoContractDependencies.media],types: [{name: generationTypes.imageSet.name,@@ -47,7 +61,38 @@ export const generationManifest: ModuleManifest = {],capabilities: [],surfaces: [],- producers: [],+ producers: [+ {+ name: generationProducers.primaryImage.name,+ inputs: [{ name: "set", type: generationTypes.imageSet }],+ outputs: [{+ name: "image",+ type: contractTypes.blobArtifact,+ affinity: [{ resultPointer: "/digest", input: "set", inputPointer: "/images/0/digest" }],+ }],+ needs: [],+ implementation: {+ kind: "registered",+ locator: "@svml/generation/select-primary-image",+ digest: generationProducerDigests.primaryImage,+ },+ },+ {+ name: generationProducers.primaryVideo.name,+ inputs: [{ name: "set", type: generationTypes.videoSet }],+ outputs: [{+ name: "video",+ type: contractTypes.blobArtifact,+ affinity: [{ resultPointer: "/digest", input: "set", inputPointer: "/videos/0/digest" }],+ }],+ needs: [],+ implementation: {+ kind: "registered",+ locator: "@svml/generation/select-primary-video",+ digest: generationProducerDigests.primaryVideo,+ },+ },+ ],};export const generationManifestDigest = digestOf(generationManifest);diff --git a/packages/generation/src/schema.ts b/packages/generation/src/schema.tsindex fa204697..f8ac281c 100644--- a/packages/generation/src/schema.ts+++ b/packages/generation/src/schema.ts@@ -30,8 +30,6 @@ export function generationObjectSchema(export const generatedImageSetSchema = generationObjectSchema({contract: { schema: { kind: "literal", value: "svml.generated-image-set@1" } },- model: { schema: { kind: "string", minLength: 1, maxLength: 255 } },- requestDigest: { schema: generationDigestSchema },images: {schema: {kind: "array",@@ -45,9 +43,6 @@ export const generatedImageSetSchema = generationObjectSchema({export const generatedVideoSetSchema = generationObjectSchema({contract: { schema: { kind: "literal", value: "svml.generated-video-set@1" } },- model: { schema: { kind: "string", minLength: 1, maxLength: 255 } },- requestDigest: { schema: generationDigestSchema },- requestedDurationSec: { schema: { kind: "number", minimum: 0 } },videos: {schema: {kind: "array",diff --git a/packages/generation/src/types.ts b/packages/generation/src/types.tsindex 3ca9ebf3..b32919de 100644--- a/packages/generation/src/types.ts+++ b/packages/generation/src/types.ts@@ -2,19 +2,12 @@ import type { BlobRef, Digest } from "@svml/protocol";export type GeneratedImageSet = {readonly contract: "svml.generated-image-set@1";- /** Provider-neutral model identity requested by the author module. */- readonly model: string;- readonly requestDigest: Digest;readonly images: readonly BlobRef[];readonly resultDigest: Digest;};export type GeneratedVideoSet = {readonly contract: "svml.generated-video-set@1";- /** Provider-neutral model identity requested by the author module. */- readonly model: string;- readonly requestDigest: Digest;- readonly requestedDurationSec: number;readonly videos: readonly BlobRef[];readonly resultDigest: Digest;};diff --git a/packages/generation/test/identity.test.ts b/packages/generation/test/identity.test.tsindex a67ad118..4553c945 100644--- a/packages/generation/test/identity.test.ts+++ b/packages/generation/test/identity.test.ts@@ -5,8 +5,10 @@ import { registerTypeValidatorFacets } from "@svml/component-kit";import { MemoryArtifactStore } from "@svml/driver-node";import {generationComponent,+ generationProducers,generationTypes,sealGeneratedImageSet,+ sealGeneratedVideoSet,verifyGeneratedImageSet,} from "@svml/generation";import { TypeValidatorRegistry } from "@svml/validation";@@ -16,13 +18,30 @@ test("generated media validators bind artifacts and result contents", async () =const image = await store.put(new Uint8Array([4, 5, 6]), "image/png");const result = sealGeneratedImageSet({contract: "svml.generated-image-set@1",- model: "gpt-image-2",- requestDigest: image.digest,images: [image],});verifyGeneratedImageSet(result);- assert.throws(() => verifyGeneratedImageSet({ ...result, model: "tampered" }), /result digest differs/u);+ assert.throws(() => verifyGeneratedImageSet({ ...result, images: [] }), /empty/u);const validators = new TypeValidatorRegistry();registerTypeValidatorFacets(validators, generationComponent.validators);assert.ok(validators.resolve(generationTypes.imageSet));});++test("the primary-video projection returns the ordered Product member as a Blob value", async () => {+ const store = new MemoryArtifactStore();+ const first = await store.put(new Uint8Array([1, 2, 3]), "video/mp4");+ const second = await store.put(new Uint8Array([4, 5, 6]), "video/mp4");+ const set = sealGeneratedVideoSet({+ contract: "svml.generated-video-set@1",+ videos: [first, second],+ });+ const facet = generationComponent.producers.find((item) =>+ item.producer.name === generationProducers.primaryVideo.name);+ assert.ok(facet);+ const result = await facet.handler({+ inputs: { set: { value: { kind: "inline", value: set } } },+ } as never);+ assert.ok("video" in result.outputs);+ assert.deepEqual(result.outputs.video, first);+ assert.deepEqual(result.needs, {});+});diff --git a/packages/hyperframes/test/browser-visual.test.ts b/packages/hyperframes/test/browser-visual.test.tsindex 9cdcc9fc..fd7f3c2b 100644--- a/packages/hyperframes/test/browser-visual.test.ts+++ b/packages/hyperframes/test/browser-visual.test.ts@@ -112,7 +112,6 @@ test("locked font and straight-alpha Surface survive one real Hyperframes browsevisualIr: "svml.hyperframes-visual-ir@1",id: "blue",programSpaceDigest: space.digest,- sources: [{ name: "fixture", digest: digest(Buffer.from("blue")) }],presents: [{id: "blue",span: { startFrame: 0, endFrameExclusive: 1 },@@ -134,7 +133,6 @@ test("locked font and straight-alpha Surface survive one real Hyperframes browsevisualIr: "svml.hyperframes-visual-ir@1",id: "surface",programSpaceDigest: space.digest,- sources: [{ name: "receipt", digest: digest(Buffer.from("surface")) }],presents: [{id: "surface",span: { startFrame: 0, endFrameExclusive: 1 },@@ -161,7 +159,6 @@ test("locked font and straight-alpha Surface survive one real Hyperframes browsevisualIr: "svml.hyperframes-visual-ir@1",id: "text",programSpaceDigest: space.digest,- sources: [{ name: "fixture", digest: digest(Buffer.from("text")) }],presents: [{id: "text",span: { startFrame: 0, endFrameExclusive: 1 },diff --git a/packages/hyperframes/test/document.test.ts b/packages/hyperframes/test/document.test.tsindex 8f907a30..9c68881d 100644--- a/packages/hyperframes/test/document.test.ts+++ b/packages/hyperframes/test/document.test.ts@@ -42,7 +42,6 @@ function fixture() {visualIr: "svml.hyperframes-visual-ir@1",id: "lower",programSpaceDigest: programSpace.digest,- sources: [{ name: "request", digest: digestOf("lower:request") }],presents: [{id: "picture",span: { startFrame: 0, endFrameExclusive: 30 },@@ -61,7 +60,6 @@ function fixture() {visualIr: "svml.hyperframes-visual-ir@1",id: "upper",programSpaceDigest: programSpace.digest,- sources: [{ name: "projection", digest: digestOf("upper:projection") }],presents: [{id: "words",span: { startFrame: 3, endFrameExclusive: 20 },@@ -76,7 +74,6 @@ function fixture() {contract: "svml.audio-track@1",id: "sound",programSpaceDigest: programSpace.digest,- sources: [{ name: "basis", digest: digestOf("sound:basis") }],clips: [{ id: "main", span: { startFrame: 0, endFrameExclusive: 30 }, artifact: sound, bus: "speech" }],});const composition = sealComposition({@@ -219,7 +216,6 @@ test("content-bound fonts and typed compositable Surfaces cross the same ArtifacvisualIr: "svml.hyperframes-visual-ir@1",id: "bound-render-dependencies",programSpaceDigest: space.digest,- sources: [{ name: "fixture", digest: digestOf("bound-render-dependencies") }],presents: [{id: "bound",span: { startFrame: 0, endFrameExclusive: 30 },diff --git a/packages/hyperframes/test/track-expressiveness.test.ts b/packages/hyperframes/test/track-expressiveness.test.tsindex b74e3262..4ad79312 100644--- a/packages/hyperframes/test/track-expressiveness.test.ts+++ b/packages/hyperframes/test/track-expressiveness.test.ts@@ -132,7 +132,6 @@ test("Text three-box and frame/content/line/word paint semantics lower without pvisualIr: "svml.hyperframes-visual-ir@1",id: "text-three-box-witness",programSpaceDigest: programSpace.digest,- sources: [{ name: "text-program", digest: digestOf("text-layout-v2-program") }],presents: [textPresent("frame-paint", 0, "frame"),textPresent("content-paint", 1, "content"),@@ -183,10 +182,6 @@ test("Caption range/cue/content boxes and word-local timing remain an ordinary VvisualIr: "svml.hyperframes-visual-ir@1",id: "caption-three-box-witness",programSpaceDigest: programSpace.digest,- sources: [- { name: "caption-program", digest: digestOf("dual-font-caption-program") },- { name: "timed-projection", digest: digestOf("caption-projection") },- ],presents: [{id: "cue-1",span: { startFrame: 30, endFrameExclusive: 90 },@@ -271,7 +266,6 @@ test("one content box lowers independent backdrop and foreground samples of onevisualIr: "svml.hyperframes-visual-ir@1",id: "media-two-box-witness",programSpaceDigest: programSpace.digest,- sources: [{ name: "media-program", digest: digestOf("media-box-style-v1") }],presents: [{id: "media-card",span: { startFrame: 60, endFrameExclusive: 180 },@@ -346,7 +340,6 @@ test("Presents from one authoring Track interleave with a peer Track by absolutevisualIr: "svml.hyperframes-visual-ir@1",id: "ranking-witness",programSpaceDigest: programSpace.digest,- sources: [{ name: "ranking-program", digest: digestOf("ranking-program") }],presents: [{id: "board",@@ -373,7 +366,6 @@ test("Presents from one authoring Track interleave with a peer Track by absolutevisualIr: "svml.hyperframes-visual-ir@1",id: "peer-text",programSpaceDigest: programSpace.digest,- sources: [{ name: "text-program", digest: digestOf("peer-text") }],presents: [{id: "peer",span: { startFrame: 0, endFrameExclusive: 300 },@@ -414,7 +406,6 @@ test("a complex owned visual may materialize as a typed compositable Surface witvisualIr: "svml.hyperframes-visual-ir@1",id: "materialized-visual-witness",programSpaceDigest: programSpace.digest,- sources: [{ name: "materialization-receipt", digest: digestOf("particle-render-receipt") }],presents: [{id: "surface",span: { startFrame: 120, endFrameExclusive: 180 },diff --git a/packages/media-pipeline/src/component.ts b/packages/media-pipeline/src/component.tsindex da79bdd2..4e695bf5 100644--- a/packages/media-pipeline/src/component.ts+++ b/packages/media-pipeline/src/component.ts@@ -107,11 +107,8 @@ export const mediaPipelineComponent = {verifyMediaInspection(inspection);verifyMediaStreamSelection(selection);verifyMediaSelectionRequest(request);- if (inspection.source.digest !== source.digest || selection.sourceArtifactDigest !== source.digest) {- throw new Error("Media normalization inputs belong to different source artifacts");- }- if (selection.inspectionDigest !== inspection.inspectionDigest) {- throw new Error("Media normalization selection belongs to another inspection");+ if (inspection.source.digest !== source.digest) {+ throw new Error("Media normalization inspection belongs to another source artifact");}const need: NormalizeMediaNeed = {contract: "svml.normalize-media-request@1",@@ -138,8 +135,6 @@ export const mediaPipelineComponent = {}const need: ProjectSpeechEvidenceAudioNeed = {contract: "svml.project-speech-evidence-audio-request@1",- basisDigest: audio.basisDigest,- narrativeDigest: audio.narrativeDigest,programSpaceDigest: audio.programSpace.digest,source: {kind: "blob",diff --git a/packages/media-pipeline/src/fragment.ts b/packages/media-pipeline/src/fragment.tsindex 0a19036e..63e5f0b6 100644--- a/packages/media-pipeline/src/fragment.ts+++ b/packages/media-pipeline/src/fragment.ts@@ -45,11 +45,6 @@ export const synchronizedMediaFragment = sealGraphFragment({type: contractTypes.synchronizedMedia,root: operation("normalize"),semanticInputs: ["request", "source"],- affinity: [- { resultPointer: "/sourceArtifactDigest", source: input("source"), sourcePointer: "/digest" },- { resultPointer: "/inspectionDigest", source: operation("inspect"), sourcePointer: "/inspectionDigest" },- { resultPointer: "/selectionDigest", source: operation("select"), sourcePointer: "/selectionDigest" },- ],fidelity: "exact",}],});diff --git a/packages/media-pipeline/src/manifest.ts b/packages/media-pipeline/src/manifest.tsindex d0376a57..436d2fde 100644--- a/packages/media-pipeline/src/manifest.ts+++ b/packages/media-pipeline/src/manifest.ts@@ -196,10 +196,6 @@ export const mediaPipelineManifest: ModuleManifest = {outputs: [{name: "selection",type: contractTypes.mediaStreamSelection,- affinity: [- { resultPointer: "/sourceArtifactDigest", input: "inspection", inputPointer: "/source/digest" },- { resultPointer: "/inspectionDigest", input: "inspection", inputPointer: "/inspectionDigest" },- ],}],needs: [],implementation: {@@ -221,11 +217,6 @@ export const mediaPipelineManifest: ModuleManifest = {name: "media",capability: mediaPipelineCapabilities.normalize,returns: contractTypes.synchronizedMedia,- affinity: [- { resultPointer: "/sourceArtifactDigest", input: "source", inputPointer: "/digest" },- { resultPointer: "/inspectionDigest", input: "inspection", inputPointer: "/inspectionDigest" },- { resultPointer: "/selectionDigest", input: "selection", inputPointer: "/selectionDigest" },- ],}],implementation: {kind: "registered",@@ -242,8 +233,6 @@ export const mediaPipelineManifest: ModuleManifest = {capability: mediaPipelineCapabilities.projectSpeechEvidenceAudio,returns: contractTypes.speechEvidenceAudio,affinity: [- { resultPointer: "/basisDigest", input: "audio", inputPointer: "/basisDigest" },- { resultPointer: "/narrativeDigest", input: "audio", inputPointer: "/narrativeDigest" },{ resultPointer: "/programSpaceDigest", input: "audio", inputPointer: "/programSpace/digest" },{ resultPointer: "/sourceAudioArtifactDigest", input: "audio", inputPointer: "/audio/digest" },],diff --git a/packages/media-pipeline/src/selection.ts b/packages/media-pipeline/src/selection.tsindex 8ba4238c..8b4c9f80 100644--- a/packages/media-pipeline/src/selection.ts+++ b/packages/media-pipeline/src/selection.ts@@ -122,8 +122,6 @@ export function selectMediaStreams(: video !== undefined ? "primary-moving@1" as const : "default-audio@1" as const;return sealMediaStreamSelection({contract: "svml.media-stream-selection@1",- sourceArtifactDigest: inspection.source.digest,- inspectionDigest: inspection.inspectionDigest,...(video === undefined ? {} : { videoStreamIndex: video.index }),...(audio === undefined ? {} : { audioStreamIndex: audio.index }),spanAuthority: request.spanAuthority,diff --git a/packages/media-pipeline/src/types.ts b/packages/media-pipeline/src/types.tsindex 7c32e095..69841b3a 100644--- a/packages/media-pipeline/src/types.ts+++ b/packages/media-pipeline/src/types.ts@@ -44,8 +44,6 @@ export type NormalizeMediaNeed = {export type ProjectSpeechEvidenceAudioNeed = {readonly contract: "svml.project-speech-evidence-audio-request@1";- readonly basisDigest: Digest;- readonly narrativeDigest: Digest;readonly programSpaceDigest: Digest;readonly source: BlobRef;readonly sourceSampleRate: 48_000;diff --git a/packages/media/README.md b/packages/media/README.mdnew file mode 100644index 00000000..c06b6742--- /dev/null+++ b/packages/media/README.md@@ -0,0 +1,7 @@+# `@svml/media`++Author-facing media declarations for the neutral `@svml/media` contract module.++`<media:Image>` requests bytes through the Host-owned source-asset capability and emits one+content-addressed `BlobArtifact`. It does not open files itself, inspect media, call a Provider or+promote an embedded audio stream to speech.diff --git a/packages/media/package.json b/packages/media/package.jsonnew file mode 100644index 00000000..1d033fb0--- /dev/null+++ b/packages/media/package.json@@ -0,0 +1,13 @@+{+ "name": "@svml/media",+ "version": "0.0.0-dev",+ "private": true,+ "type": "module",+ "exports": {+ ".": "./src/index.ts"+ },+ "dependencies": {+ "@svml/contracts": "workspace:*",+ "@svml/text": "workspace:*"+ }+}diff --git a/packages/media/src/index.ts b/packages/media/src/index.tsnew file mode 100644index 00000000..db685bac--- /dev/null+++ b/packages/media/src/index.ts@@ -0,0 +1,7 @@+export { decodeMediaImageSurface } from "./surface.js";+export {+ mediaManifest,+ mediaManifestDigest,+ mediaModuleRef,+ mediaSurfaceImplementationDigests,+} from "@svml/contracts";diff --git a/packages/media/src/surface.ts b/packages/media/src/surface.tsnew file mode 100644index 00000000..e0ea421a--- /dev/null+++ b/packages/media/src/surface.ts@@ -0,0 +1,73 @@+import {+ contractTypes,+} from "@svml/contracts";+import type {+ StructuredElement,+ StructuredSurfaceHandler,+} from "@svml/text";++const MEDIA_TYPES = new Map([+ [".avif", "image/avif"],+ [".gif", "image/gif"],+ [".jpeg", "image/jpeg"],+ [".jpg", "image/jpeg"],+ [".png", "image/png"],+ [".webp", "image/webp"],+]);++function stringAttribute(element: StructuredElement, name: string): string {+ const value = element.attributes[name];+ if (typeof value !== "string" || value.trim().length === 0) {+ throw new Error(`${element.name}.${name} must be a non-empty string`);+ }+ return value.trim();+}++function assertChildrenEmpty(element: StructuredElement): void {+ if (element.children.some((child) => child.kind === "element" || child.value.trim().length > 0)) {+ throw new Error(`${element.name} does not accept children`);+ }+}++function mediaTypeFor(element: StructuredElement, source: string): string {+ const explicit = element.attributes["media-type"];+ if (explicit !== undefined) {+ if (typeof explicit !== "string" || !explicit.startsWith("image/")) {+ throw new Error(`${element.name}.media-type must be an image media type`);+ }+ return explicit;+ }+ const clean = source.split(/[?#]/u, 1)[0]!.toLocaleLowerCase("en");+ const dot = clean.lastIndexOf(".");+ const inferred = dot < 0 ? undefined : MEDIA_TYPES.get(clean.slice(dot));+ if (inferred === undefined) {+ throw new Error(`${element.name}.src needs a known image extension or an explicit media-type`);+ }+ return inferred;+}++/** Host resolves and stages the bytes; this Surface only declares their authored media meaning. */+export const decodeMediaImageSurface: StructuredSurfaceHandler = async ({ element, resolveAsset }) => {+ const names = Object.keys(element.attributes).sort();+ if (names.join(",") !== "id,src" && names.join(",") !== "id,media-type,src") {+ throw new Error(`${element.name} requires id and src, with optional media-type`);+ }+ assertChildrenEmpty(element);+ const id = stringAttribute(element, "id");+ const source = stringAttribute(element, "src");+ const mediaType = mediaTypeFor(element, source);+ const resolved = await resolveAsset({ from: source, mediaType, range: element.range });+ if (!resolved.artifact.mediaType.startsWith("image/")) {+ throw new Error(`${element.name}.src did not resolve to an image artifact`);+ }+ return {+ records: [{+ id,+ type: contractTypes.blobArtifact,+ value: resolved.artifact,+ range: element.range,+ }],+ components: [],+ fragments: [],+ };+};diff --git a/packages/model-kit/src/index.ts b/packages/model-kit/src/index.tsindex 719c6783..97fbe727 100644--- a/packages/model-kit/src/index.ts+++ b/packages/model-kit/src/index.ts@@ -126,7 +126,6 @@ export function defineExactModelModule(options: DefineExactModelModuleOptions):name: "generation",capability: item.capability,returns: item.returns,- affinity: [{ resultPointer: "/requestDigest", input: "request", inputPointer: "/requestDigest" }],}],implementation: {kind: "registered",@@ -151,11 +150,6 @@ export function defineExactModelModule(options: DefineExactModelModuleOptions):type: item.returns,root: { kind: "fragment-operation", operation: "generate" },semanticInputs: ["request"],- affinity: [{- resultPointer: "/requestDigest",- source: { kind: "fragment-input", name: "request" },- sourcePointer: "/requestDigest",- }],fidelity: "exact",}],});diff --git a/packages/prelude-video/README.md b/packages/prelude-video/README.mdindex f2e6e321..e66b0214 100644--- a/packages/prelude-video/README.md+++ b/packages/prelude-video/README.md@@ -5,7 +5,11 @@ Manifests, the SVS Frontend, official Text Surfaces and the deterministic computowned by those modules. Compiler and Runtime Hosts grant those facets independently. The packagehas no Provider, credential, store, queue, network or rendering authority.-The aggregate now carries the complete `@svml/speech-take`, `@svml/speech-align` and+The aggregate installs the ordinary `@svml/media` Image Surface, the exact `@svml/seedance`+Prompt/Speech/Video Surfaces and the shared generated-media primary projection. These are package+facets, not CLI or Core branches.++The aggregate also carries the complete `@svml/speech-take`, `@svml/speech-align` and`@svml/caption` Manifests, including four Product projections, the provider-neutral timing locator,Caption temporalization, VisualTrack lowering and Caption-owned validators. A physical package-locktest proves that these dependencies are discovered from the installed package closure rather thandiff --git a/packages/prelude-video/package.json b/packages/prelude-video/package.jsonindex a67dca18..a706fdff 100644--- a/packages/prelude-video/package.json+++ b/packages/prelude-video/package.json@@ -12,11 +12,14 @@"dependencies": {"@svml/caption": "workspace:*","@svml/contracts": "workspace:*",+ "@svml/generation": "workspace:*","@svml/film": "workspace:*","@svml/hyperframes": "workspace:*","@svml/hyperframes-render": "workspace:*","@svml/media-pipeline": "workspace:*",+ "@svml/media": "workspace:*","@svml/script": "workspace:*",+ "@svml/seedance": "workspace:*","@svml/speech-align": "workspace:*","@svml/speech-take": "workspace:*","@svml/svs": "workspace:*"diff --git a/packages/prelude-video/src/index.ts b/packages/prelude-video/src/index.tsindex d847e849..e4b39952 100644--- a/packages/prelude-video/src/index.ts+++ b/packages/prelude-video/src/index.ts@@ -2,6 +2,10 @@ import {videoContractManifests,videoContractsComponents,} from "@svml/contracts";+import {+ generationComponent,+ generationManifest,+} from "@svml/generation";import {captionComponent,captionManifest,@@ -27,6 +31,11 @@ import {mediaPipelineComponent,mediaPipelineManifest,} from "@svml/media-pipeline";+import {+ decodeMediaImageSurface,+ mediaModuleRef,+ mediaSurfaceImplementationDigests,+} from "@svml/media";import type { NodePackageActivation } from "@svml/package-loader-node";import {decodeScriptSurface,@@ -34,6 +43,15 @@ import {scriptModuleRef,scriptSurfaceImplementationDigest,} from "@svml/script";+import {+ decodeSeedancePromptSurface,+ decodeSeedanceSpeechSurface,+ decodeSeedanceVideoSurface,+ seedanceComponent,+ seedanceManifest,+ seedanceModuleRef,+ seedanceSurfaceImplementationDigests,+} from "@svml/seedance";import {speechAlignComponent,speechAlignManifest,@@ -48,7 +66,14 @@ export const svmlPackage: NodePackageActivation = {format: "svml.node-package@1",name: "@svml/prelude-video",modules: [- ...videoContractManifests.map((manifest) => ({ manifest })),+ ...videoContractManifests.map((manifest) => ({+ manifest,+ ...(manifest.name === mediaModuleRef.name+ ? { specifiers: ["@svml/media", "@svml/media@1"] }+ : {}),+ })),+ { manifest: generationManifest },+ { manifest: seedanceManifest, specifiers: ["@svml/seedance", "@svml/seedance@1"] },{ manifest: scriptManifest, specifiers: ["@svml/script", "@svml/script@1"] },{ manifest: svsManifest },{ manifest: hyperframesManifest },@@ -65,6 +90,8 @@ export const svmlPackage: NodePackageActivation = {frontends: [svsFrontend],components: [...videoContractsComponents,+ generationComponent,+ seedanceComponent,captionComponent,mediaPipelineComponent,speechAlignComponent,@@ -73,6 +100,34 @@ export const svmlPackage: NodePackageActivation = {hyperframesRenderComponent,],textSurfaces: [+ {+ module: mediaModuleRef,+ surface: "image",+ mode: "structured",+ implementationDigest: mediaSurfaceImplementationDigests.image,+ handler: decodeMediaImageSurface,+ },+ {+ module: seedanceModuleRef,+ surface: "prompt",+ mode: "structured",+ implementationDigest: seedanceSurfaceImplementationDigests.prompt,+ handler: decodeSeedancePromptSurface,+ },+ {+ module: seedanceModuleRef,+ surface: "speech",+ mode: "structured",+ implementationDigest: seedanceSurfaceImplementationDigests.speech,+ handler: decodeSeedanceSpeechSurface,+ },+ {+ module: seedanceModuleRef,+ surface: "video",+ mode: "structured",+ implementationDigest: seedanceSurfaceImplementationDigests.video,+ handler: decodeSeedanceVideoSurface,+ },{module: scriptModuleRef,surface: "script",diff --git a/packages/prelude-video/test/activation.test.ts b/packages/prelude-video/test/activation.test.tsindex 41dc06ea..9878787e 100644--- a/packages/prelude-video/test/activation.test.ts+++ b/packages/prelude-video/test/activation.test.ts@@ -12,6 +12,7 @@ import {captionComponent,captionManifest,} from "@svml/caption";+import { generationComponent } from "@svml/generation";import {createNodePackageLock,loadNodePackages,@@ -26,6 +27,7 @@ import {speechTakeComponent,speechTakeManifest,} from "@svml/speech-take";+import { seedanceComponent } from "@svml/seedance";import { svmlPackage } from "../src/index.js";@@ -81,12 +83,17 @@ test("the installed official package lock physically contains speech and Captionassert.equal(lock.artifacts.some((artifact) => artifact.name === "@svml/speech-take"), true);assert.equal(lock.artifacts.some((artifact) => artifact.name === "@svml/speech-align"), true);assert.equal(lock.artifacts.some((artifact) => artifact.name === "@svml/caption"), true);+ assert.equal(lock.artifacts.some((artifact) => artifact.name === "@svml/media"), true);+ assert.equal(lock.artifacts.some((artifact) => artifact.name === "@svml/generation"), true);+ assert.equal(lock.artifacts.some((artifact) => artifact.name === "@svml/seedance"), true);await writeNodePackageLock(lockPath, lock);const packages = await loadNodePackages(lockPath, installedRoot);const components = nodePackageComponents(packages);assert.equal(components.some((component) => component.name === "@svml/speech-take"), true);assert.equal(components.some((component) => component.name === "@svml/speech-align"), true);assert.equal(components.some((component) => component.name === "@svml/caption"), true);+ assert.equal(components.includes(generationComponent), true);+ assert.equal(components.includes(seedanceComponent), true);} finally {await rm(directory, { recursive: true, force: true });}diff --git a/packages/provider-hyperframes-local/test/provider.test.ts b/packages/provider-hyperframes-local/test/provider.test.tsindex e7d5fed2..6d7851e8 100644--- a/packages/provider-hyperframes-local/test/provider.test.ts+++ b/packages/provider-hyperframes-local/test/provider.test.ts@@ -34,7 +34,6 @@ function documentFixture() {visualIr: "svml.hyperframes-visual-ir@1",id: "provider-proof",programSpaceDigest: programSpace.digest,- sources: [{ name: "fixture", digest: digestOf("provider-proof") }],presents: [{id: "card",span: { startFrame: 0, endFrameExclusive: 12 },diff --git a/packages/provider-kie/package.json b/packages/provider-kie/package.jsonindex 6928980c..c06782e0 100644--- a/packages/provider-kie/package.json+++ b/packages/provider-kie/package.json@@ -22,6 +22,7 @@"devDependencies": {"@svml/artifact-store-fs": "workspace:*","@svml/component-kit": "workspace:*",+ "@svml/contracts": "workspace:*","@svml/core": "workspace:*","@svml/driver-node": "workspace:*","@svml/elaborator": "workspace:*",diff --git a/packages/provider-kie/src/catalog.ts b/packages/provider-kie/src/catalog.tsindex f8b01562..f337e6fa 100644--- a/packages/provider-kie/src/catalog.ts+++ b/packages/provider-kie/src/catalog.ts@@ -44,11 +44,9 @@ import type { SeedreamRequest } from "@svml/seedream";export type KieArtifactUrlResolver = (artifact: BlobRef) => Promise<string>;export type KieTask = {- readonly authorModel: string;readonly model: string;readonly input: CanonicalValue;readonly result: "image" | "video";- readonly requestedDurationSec?: number;};export type KieModelAdapter = {@@ -105,10 +103,8 @@ const seedanceAdapters = ([if (groups.audio.length > 0) modeInput.reference_audio_urls = await urls(groups.audio, resolve);}return {- authorModel,model: kieModel,result: "video",- requestedDurationSec: request.durationSec,input: canonicalize({prompt: request.prompt,...modeInput,@@ -154,11 +150,9 @@ const minimaxAdapters = ([if (audios.length > 0) input.reference_audio_urls = await urls(audios, resolve);}return {- authorModel: "minimax-h3",model: kieModel,input: canonicalize(input),result: "video",- requestedDurationSec: request.durationSec,};},));@@ -189,11 +183,9 @@ const geminiAdapter = adapter(})));}return {- authorModel: request.model,model: "gemini-omni-video",input: canonicalize(input),result: "video",- requestedDurationSec: request.durationSec,};},);@@ -221,12 +213,10 @@ const grokAdapters = (["text", "image", "preview-1.5"] as const).map((mode) => ainput.image_urls = await urls(request.images, resolve);}return {- authorModel: request.model,model: request.mode === "text" ? "grok-imagine/text-to-video": request.mode === "image" ? "grok-imagine/image-to-video" : "grok-imagine-video-1-5-preview",input: canonicalize(input),result: "video",- requestedDurationSec: request.durationSec,};},));@@ -245,7 +235,6 @@ const gptImageAdapters = (["text", "image"] as const).map((mode) => adapter(};if (request.mode === "image") input.input_urls = await urls(request.images, resolve);return {- authorModel: request.model,model: request.mode === "text" ? "gpt-image-2-text-to-image" : "gpt-image-2-image-to-image",input: canonicalize(input),result: "image",@@ -263,7 +252,6 @@ const nanoAdapters = (["v2", "pro"] as const).map((key) => adapter(verifyNanoBananaRequest(value, model);const request = value as NanoBananaRequest;return {- authorModel: request.model,model,result: "image",input: canonicalize({@@ -294,7 +282,6 @@ const seedreamAdapters = (["text", "image"] as const).map((mode) => adapter(};if (request.mode === "image") input.image_urls = await urls(request.images, resolve);return {- authorModel: request.model,model: request.mode === "text" ? "seedream/5-lite-text-to-image" : "seedream/5-lite-image-to-image",input: canonicalize(input),result: "image",diff --git a/packages/provider-kie/src/provider.ts b/packages/provider-kie/src/provider.tsindex f71bff57..de069242 100644--- a/packages/provider-kie/src/provider.ts+++ b/packages/provider-kie/src/provider.ts@@ -64,11 +64,9 @@ type KieCheckpoint = {readonly taskId: string;readonly catalogKey: string;readonly model: string;- readonly authorModel: string;readonly result: "image" | "video";readonly requestDigest: Digest;readonly contentRequestDigest: Digest;- readonly requestedDurationSec?: number;readonly startedAt: number;readonly polls: number;readonly pollFailures: number;@@ -445,11 +443,9 @@ function endpoint(options: {taskId,catalogKey: adapter.key,model: task.model,- authorModel: task.authorModel,result: task.result,requestDigest: context.need.requestDigest,contentRequestDigest: contentRequestDigest(context.need.constraints),- ...(task.requestedDurationSec === undefined ? {} : { requestedDurationSec: task.requestedDurationSec }),startedAt: options.now(),polls: 0,pollFailures: 0,@@ -509,15 +505,10 @@ function endpoint(options: {const result = checkpoint.result === "image"? sealGeneratedImageSet({contract: "svml.generated-image-set@1",- model: checkpoint.authorModel,- requestDigest: checkpoint.contentRequestDigest,images: artifacts,}): sealGeneratedVideoSet({contract: "svml.generated-video-set@1",- model: checkpoint.authorModel,- requestDigest: checkpoint.contentRequestDigest,- requestedDurationSec: checkpoint.requestedDurationSec ?? 0,videos: artifacts,});const vendorMetrics: Record<string, CanonicalValue> = {};diff --git a/packages/provider-kie/test/live-smoke.ts b/packages/provider-kie/test/live-smoke.tsindex 06548c77..b7fcfe3d 100644--- a/packages/provider-kie/test/live-smoke.ts+++ b/packages/provider-kie/test/live-smoke.ts@@ -14,6 +14,7 @@ import {sealTypedModule,start,} from "@svml/core";+import { mediaManifest, narrativeManifest } from "@svml/contracts";import {geminiOmniComponent,geminiOmniEndpoints,@@ -339,7 +340,7 @@ function selectCases(cases: readonly SmokeCase[]): readonly SmokeCase[] {}async function createBuild(item: SmokeCase): Promise<ReturnType<typeof start>> {- const closure = createResolvedClosure([generationManifest, item.manifest]);+ const closure = createResolvedClosure([mediaManifest, narrativeManifest, generationManifest, item.manifest]);const validators = new TypeValidatorRegistry();registerTypeValidatorFacets(validators, generationComponent.validators);registerTypeValidatorFacets(validators, item.component.validators);diff --git a/packages/provider-kie/test/models.test.ts b/packages/provider-kie/test/models.test.tsindex 891b0695..c5c80c01 100644--- a/packages/provider-kie/test/models.test.ts+++ b/packages/provider-kie/test/models.test.ts@@ -2,6 +2,7 @@ import assert from "node:assert/strict";import test from "node:test";import { createResolvedClosure, digestOf } from "@svml/core";+import { mediaManifest, narrativeManifest } from "@svml/contracts";import { verifyGraphFragment } from "@svml/elaborator";import {geminiOmniDefinition,@@ -39,6 +40,8 @@ test("all model manifests close over the shared generation contract and every FrseedreamDefinition,];const closure = createResolvedClosure([+ mediaManifest,+ narrativeManifest,generationManifest,seedanceManifest,minimaxH3Manifest,diff --git a/packages/provider-kie/test/provider.test.ts b/packages/provider-kie/test/provider.test.tsindex f63590aa..a8b81b88 100644--- a/packages/provider-kie/test/provider.test.ts+++ b/packages/provider-kie/test/provider.test.ts@@ -146,8 +146,8 @@ test("KIE uploads content-addressed references, resumes one task, and persists gconst result = completed.result.value.kind === "inline"? completed.result.value.value as Record<string, unknown> : {};assert.equal(result.contract, "svml.generated-video-set@1");- assert.equal(result.model, "seedance-2-mini");- assert.equal(result.requestDigest, requestValue.requestDigest);+ assert.equal("model" in result, false, "model choice belongs to the request graph and Receipt");+ assert.equal("requestDigest" in result, false, "request lineage belongs to the Need Receipt, not generated media");const videos = result.videos as Array<{ digest: string }>;assert.equal(videos.length, 1);assert.equal(await artifacts.has(videos[0]!.digest as `sha256:${string}`), true);diff --git a/packages/provider-media-local/src/provider.ts b/packages/provider-media-local/src/provider.tsindex a6d4121f..931cd2f5 100644--- a/packages/provider-media-local/src/provider.ts+++ b/packages/provider-media-local/src/provider.ts@@ -351,10 +351,7 @@ function normalizeNeed(value: CanonicalValue): NormalizeMediaNeed {"NormalizeMediaNeed is invalid");verifyMediaInspection(item.inspection);verifyMediaStreamSelection(item.selection);- assert(item.inspection.source.digest === item.source.digest- && item.selection.sourceArtifactDigest === item.source.digest- && item.selection.inspectionDigest === item.inspection.inspectionDigest,- "NormalizeMediaNeed affinity is invalid");+ assert(item.inspection.source.digest === item.source.digest, "NormalizeMediaNeed source is invalid");assert(item.audio.sampleRate === 48_000 && item.audio.channels === 2&& item.audio.codec === "pcm_s16le" && item.audio.loudness === "preserve","NormalizeMediaNeed audio profile is unsupported");@@ -582,9 +579,6 @@ export function createLocalMediaProvider(config: CreateLocalMediaProviderOptions}const media = sealSynchronizedMedia({contract: "svml.synchronized-media@1",- sourceArtifactDigest: need.source.digest,- inspectionDigest: need.inspection.inspectionDigest,- selectionDigest: need.selection.selectionDigest,timeline: {spanAuthority: need.selection.spanAuthority,frameRate: need.frameRate,@@ -689,8 +683,6 @@ export function createLocalMediaProvider(config: CreateLocalMediaProviderOptionsconst artifact = await context.artifacts.put(await readFile(output), "audio/wav");const evidence: SpeechEvidenceAudio = sealSpeechEvidenceAudio({contract: "svml.speech-evidence-audio@1",- basisDigest: need.basisDigest,- narrativeDigest: need.narrativeDigest,programSpaceDigest: need.programSpaceDigest,sourceAudioArtifactDigest: need.source.digest,artifact,diff --git a/packages/provider-media-local/test/provider.test.ts b/packages/provider-media-local/test/provider.test.tsindex 0d8650b0..5ed896d1 100644--- a/packages/provider-media-local/test/provider.test.ts+++ b/packages/provider-media-local/test/provider.test.ts@@ -268,8 +268,6 @@ test("local media Provider derives one exact 16 kHz mono WhisperX evidence artifconst source = await artifacts.put(await readFile(sourcePath), "audio/wav");const constraints = canonicalize({contract: "svml.project-speech-evidence-audio-request@1",- basisDigest: digestOf("evidence:basis"),- narrativeDigest: digestOf("evidence:narrative"),programSpaceDigest: digestOf("evidence:program-space"),source,sourceSampleRate: 48_000,@@ -285,7 +283,6 @@ test("local media Provider derives one exact 16 kHz mono WhisperX evidence artifsegmentId: "line",startSec: 0,endSec: 48_001 / 48_000,- sourceArtifactDigest: digestOf("evidence:visual"),}],});const request = need(diff --git a/packages/provider-whisperx-local/src/provider.ts b/packages/provider-whisperx-local/src/provider.tsindex 9290dd7b..bfa3a4ff 100644--- a/packages/provider-whisperx-local/src/provider.ts+++ b/packages/provider-whisperx-local/src/provider.ts@@ -338,11 +338,8 @@ export function createLocalWhisperXProvider(config: CreateLocalWhisperXProviderOconst evidence: WhisperXAlignmentEvidence = sealWhisperXAlignmentEvidence({contract: "svml.whisperx-alignment-evidence@2",engine: "whisperx",- basisDigest: request.basisDigest,- audioArtifactDigest: request.sourceAudioArtifactDigest,- evidenceAudioDigest: request.evidenceAudioDigest,+ audioArtifactDigest: request.audio.digest,programSpaceDigest: request.programSpaceDigest,- rawEvidenceArtifactDigest: rawArtifact.digest,durationSec: request.durationSec,segments,});@@ -355,6 +352,7 @@ export function createLocalWhisperXProvider(config: CreateLocalWhisperXProviderOserviceVersion: expectedServiceVersion,whisperxVersion: expectedWhisperXVersion,punktTabDigest: expectedPunktTabDigest,+ rawEvidenceArtifact: rawArtifact,language: typeof response.language === "string" ? response.language : request.language ?? "unknown",inputTranscoded: false,}));diff --git a/packages/provider-whisperx-local/test/provider.test.ts b/packages/provider-whisperx-local/test/provider.test.tsindex 24823d12..ee22034a 100644--- a/packages/provider-whisperx-local/test/provider.test.ts+++ b/packages/provider-whisperx-local/test/provider.test.ts@@ -22,8 +22,8 @@ import {} from "../src/index.js";const sourceSegments = [- { segmentId: "opening", startSec: 0, endSec: 1, sourceArtifactDigest: digestOf("opening") },- { segmentId: "answer", startSec: 1, endSec: 2, sourceArtifactDigest: digestOf("answer") },+ { segmentId: "opening", startSec: 0, endSec: 1 },+ { segmentId: "answer", startSec: 1, endSec: 2 },];const loopbackEnabled = process.env.SVML_LOOPBACK_TESTS === "1";@@ -136,8 +136,6 @@ test("local Provider stages canonical evidence bytes unchanged and binds sidecarconst artifact = await artifacts.put(expected, "audio/wav");const evidenceAudio = sealSpeechEvidenceAudio({contract: "svml.speech-evidence-audio@1",- basisDigest: digestOf("loopback:basis"),- narrativeDigest: digestOf("loopback:narrative"),programSpaceDigest: digestOf("loopback:program"),sourceAudioArtifactDigest: digestOf("loopback:speech-master"),artifact,@@ -193,9 +191,7 @@ test("local Provider stages canonical evidence bytes unchanged and binds sidecarassert.equal(output.value.kind, "inline");const value = output.value.kind === "inline" ? output.value.value : null;assert.equal((value as { readonly audioArtifactDigest?: unknown }).audioArtifactDigest,- evidenceAudio.sourceAudioArtifactDigest);- assert.equal((value as { readonly evidenceAudioDigest?: unknown }).evidenceAudioDigest,- evidenceAudio.evidenceAudioDigest);+ evidenceAudio.artifact.digest);assert.equal((value as { readonly segments?: readonly unknown[] }).segments?.length, 2);assert.equal((value as { readonly contract?: unknown }).contract, "svml.whisperx-alignment-evidence@2");assert.equal(contractTypes.speechEvidenceAudio.name, "SpeechEvidenceAudio");diff --git a/packages/script/README.md b/packages/script/README.mdindex 71960365..cfada96a 100644--- a/packages/script/README.md+++ b/packages/script/README.md@@ -31,3 +31,7 @@ semantic-preserving formatter and the raw `decodeScriptSurface` handler. Sourcestate remain private to Script; its authored Narrative Record uses the Frontend-neutral type from`@svml/contracts`, so third-party author surfaces can feed the same WhisperX, locator and captioncomponents without importing Script internals.++Every named Segment is additionally exported as `script.segment.<id>` with the shared+`NarrativeExcerpt` type. Seedance and future speech packages consume that narrow value rather than+Script's parser AST; another authoring package may produce the same contract.diff --git a/packages/script/src/index.ts b/packages/script/src/index.tsindex 39a567de..1cd92aba 100644--- a/packages/script/src/index.ts+++ b/packages/script/src/index.ts@@ -1,6 +1,7 @@export { ScriptSyntaxError } from "./error.js";export { formatScript } from "./format.js";export {+ narrativeExcerptType,narrativeSchema,narrativeType,scriptManifest,@@ -8,6 +9,7 @@ export {scriptSurfaceImplementationDigest,} from "./manifest.js";export {+ narrativeSegmentExcerptValue,narrativeSourceMap,narrativeValue,serializeCaption,diff --git a/packages/script/src/manifest.ts b/packages/script/src/manifest.tsindex fc729099..f61e4d26 100644--- a/packages/script/src/manifest.ts+++ b/packages/script/src/manifest.ts@@ -8,6 +8,7 @@ import type { ModuleManifest, TypeRef } from "@svml/protocol";export const scriptModuleRef = { name: "@svml/script", version: "0.0.0-dev" } as const;export const narrativeType: TypeRef = contractTypes.narrative;+export const narrativeExcerptType: TypeRef = contractTypes.narrativeExcerpt;export { narrativeSchema };export const scriptSurfaceImplementationDigest = digestOf("@svml/script/surface@1");@@ -24,7 +25,7 @@ export const scriptManifest: ModuleManifest = {name: "script",tag: "script",mode: "raw",- outputs: [narrativeType],+ outputs: [narrativeType, narrativeExcerptType],implementation: {kind: "trusted-frontend-surface",locator: "@svml/script/surface",diff --git a/packages/script/src/narrative.ts b/packages/script/src/narrative.tsindex de465549..a7d42635 100644--- a/packages/script/src/narrative.ts+++ b/packages/script/src/narrative.ts@@ -1,8 +1,62 @@-import { canonicalize } from "@svml/core";+import { canonicalize, digestOf } from "@svml/core";import type { CanonicalValue } from "@svml/protocol";import type { ParsedNarrative } from "./types.js";+function cleanProjection(value: string): string {+ return value+ .replace(/\s+/gu, " ")+ .replace(/\s+([,.;:!?])/gu, "$1")+ .replace(/([([{])\s+/gu, "$1")+ .replace(/\s+([)\]}])/gu, "$1")+ .trim();+}++function joinProjection(parts: readonly string[]): string {+ return cleanProjection(parts.filter((part) => part.trim()).join(" "));+}++function segmentSerializations(segment: ParsedNarrative["segments"][number]): {+ readonly dialogue: string;+ readonly speech: string;+} {+ const speechParts: string[] = [];+ const dialogue: string[] = [];+ let role: string | undefined;+ let turn: string[] = [];+ const flush = (): void => {+ const body = joinProjection(turn);+ if (body) dialogue.push(role === undefined ? body : `${role}: ${body}`);+ turn = [];+ };+ for (const atom of segment.atoms) {+ if (atom.kind === "role") {+ flush();+ role = atom.label;+ continue;+ }+ speechParts.push(atom.speech);+ turn.push(atom.speech);+ }+ flush();+ return { dialogue: dialogue.join("\n"), speech: joinProjection(speechParts) };+}++export function narrativeSegmentExcerptValue(+ parsed: ParsedNarrative,+ segment: ParsedNarrative["segments"][number],+): CanonicalValue {+ const content = {+ contract: "svml.narrative-excerpt@1",+ kind: "segment",+ id: segment.id,+ tokenStart: segment.tokenStart,+ tokenEndExclusive: segment.tokenEndExclusive,+ serializations: segmentSerializations(segment),+ } as const;+ return canonicalize({ ...content, excerptDigest: digestOf(canonicalize(content)) });+}+function semanticBoundary(boundary: {readonly tokenIndex: number;readonly structuralPosition: number;diff --git a/packages/script/src/surface.ts b/packages/script/src/surface.tsindex b4a4e4c2..8d5d56b6 100644--- a/packages/script/src/surface.ts+++ b/packages/script/src/surface.ts@@ -1,8 +1,12 @@import { canonicalize } from "@svml/core";import { ScriptSyntaxError } from "./error.js";-import { narrativeSourceMap, narrativeValue } from "./narrative.js";-import { narrativeType } from "./manifest.js";+import {+ narrativeSegmentExcerptValue,+ narrativeSourceMap,+ narrativeValue,+} from "./narrative.js";+import { narrativeExcerptType, narrativeType } from "./manifest.js";import { parseScript } from "./parser.js";import type { ScriptSurfaceInput, ScriptSurfaceOutput } from "./types.js";@@ -69,6 +73,12 @@ export function decodeScriptSurface(input: ScriptSurfaceInput): ScriptSurfaceOutvalue: { kind: "inline", value: narrativeValue(parsed) },range: { start: input.openingStart, end: close.end },},+ ...parsed.segments.map((segment) => ({+ id: `${rawId}.segment.${segment.id}`,+ type: narrativeExcerptType,+ value: { kind: "inline" as const, value: narrativeSegmentExcerptValue(parsed, segment) },+ range: segment.range,+ })),],components: [],fragments: [],diff --git a/packages/seedance/README.md b/packages/seedance/README.mdnew file mode 100644index 00000000..b0e658b3--- /dev/null+++ b/packages/seedance/README.md@@ -0,0 +1,12 @@+# `@svml/seedance`++Exact Seedance author model module. It owns the request schema and the namespaced `Prompt`, `Video`+and `Speech` Surfaces; it does not contain KIE credentials, HTTP code, queues or runtime routing.++`Video` and `Speech` preserve the remote result as one atomic `GeneratedVideoSet`, then expose its+first ordered member through the shared deterministic primary-video projection. `Speech` consumes a+shared `NarrativeExcerpt`, so a third-party narrative Surface can feed it without importing the+official Script parser.++Duration is explicit in this low-level model Surface. A later Speech scheduling package may wrap it+with estimation without changing Core or the exact Seedance/KIE contracts.diff --git a/packages/seedance/package.json b/packages/seedance/package.jsonindex bd97adb4..fa4e4146 100644--- a/packages/seedance/package.json+++ b/packages/seedance/package.json@@ -7,8 +7,11 @@".": "./src/index.ts"},"dependencies": {+ "@svml/contracts": "workspace:*",+ "@svml/elaborator": "workspace:*","@svml/generation": "workspace:*","@svml/model-kit": "workspace:*",- "@svml/protocol": "workspace:*"+ "@svml/protocol": "workspace:*",+ "@svml/text": "workspace:*"}}diff --git a/packages/seedance/src/fragment.ts b/packages/seedance/src/fragment.tsnew file mode 100644index 00000000..05a0e4ea--- /dev/null+++ b/packages/seedance/src/fragment.ts@@ -0,0 +1,44 @@+import { contractTypes } from "@svml/contracts";+import { sealGraphFragment } from "@svml/elaborator";+import { generationProducers } from "@svml/generation";+import type { ExactModelEndpoint } from "@svml/model-kit";++const input = (name: string) => ({ kind: "fragment-input" as const, name });+const operation = (id: string) => ({ kind: "fragment-operation" as const, operation: id });++/**+ * Keep the remote GeneratedVideoSet atomic, then deterministically expose its+ * primary video as an ordinary BlobArtifact for downstream media programs.+ */+export function createSeedanceGenerationFragment(endpoint: ExactModelEndpoint) {+ return sealGraphFragment({+ name: `@svml/seedance/${endpoint.key}-primary-video@1`,+ inputs: [{ name: "request", type: endpoint.requestType }],+ operations: [+ {+ id: "generate",+ producer: endpoint.producer,+ inputs: { request: input("request") },+ result: { kind: "need", name: "generation", accepts: "exact" },+ },+ {+ id: "select-primary-video",+ producer: generationProducers.primaryVideo,+ inputs: { set: operation("generate") },+ result: { kind: "output", name: "video" },+ },+ ],+ exports: [{+ name: "video",+ type: contractTypes.blobArtifact,+ root: operation("select-primary-video"),+ semanticInputs: ["request"],+ affinity: [{+ resultPointer: "/digest",+ source: operation("generate"),+ sourcePointer: "/videos/0/digest",+ }],+ fidelity: "exact",+ }],+ });+}diff --git a/packages/seedance/src/index.ts b/packages/seedance/src/index.tsindex 4325c6be..99f6d4f6 100644--- a/packages/seedance/src/index.ts+++ b/packages/seedance/src/index.ts@@ -8,7 +8,11 @@ import {verifyGenerationRequestDigest,} from "@svml/generation";import { defineExactModelModule } from "@svml/model-kit";-import type { BlobRef, Digest, ValueSchema } from "@svml/protocol";+import {+ videoContractDependencies,+} from "@svml/contracts";+import { canonicalize, digestOf } from "@svml/protocol";+import type { BlobRef, Digest, TypeRef, ValueSchema } from "@svml/protocol";export const seedanceModuleRef = { name: "@svml/seedance", version: "0.0.0-dev" } as const;export const seedanceModels = ["seedance-2", "seedance-2-fast", "seedance-2-mini"] as const;@@ -40,6 +44,40 @@ export type SeedanceRequest<M extends SeedanceModel = SeedanceModel> = SeedanceRreadonly requestDigest: Digest;};+export type SeedancePrompt = {+ readonly contract: "svml.seedance-prompt@1";+ readonly text: string;+ readonly promptDigest: Digest;+};++export const seedanceTypes = {+ prompt: { module: seedanceModuleRef, name: "Prompt" },+} satisfies Record<string, TypeRef>;++export const seedanceSurfaceImplementationDigests = {+ prompt: digestOf("@svml/seedance/prompt-surface@1"),+ speech: digestOf("@svml/seedance/speech-surface@1"),+ video: digestOf("@svml/seedance/video-surface@1"),+} as const;++export function sealSeedancePrompt(text: string): SeedancePrompt {+ const normalized = text.trim();+ if (normalized.length === 0 || normalized.length > 20_000) {+ throw new Error("Seedance Prompt must contain 1 to 20,000 characters");+ }+ const content = { contract: "svml.seedance-prompt@1" as const, text: normalized };+ return { ...content, promptDigest: digestOf(canonicalize(content)) };+}++export function verifySeedancePrompt(value: unknown): asserts value is SeedancePrompt {+ assertObject(value);+ if (value.contract !== "svml.seedance-prompt@1" || typeof value.text !== "string" || value.text.length === 0) {+ throw new Error("Seedance Prompt is invalid");+ }+ const content = canonicalize({ contract: value.contract, text: value.text });+ if (value.promptDigest !== digestOf(content)) throw new Error("Seedance Prompt digest differs");+}+const referenceSchema: ValueSchema = {kind: "oneOf",variants: (["image", "video", "audio"] as const).map((kind) => generationObjectSchema({@@ -128,7 +166,7 @@ export function sealSeedanceRequest<M extends SeedanceModel>(return request;}-export const seedanceDefinition = defineExactModelModule({+const seedanceBaseDefinition = defineExactModelModule({module: seedanceModuleRef,endpoints: [["standard", "seedance-2"],@@ -145,7 +183,72 @@ export const seedanceDefinition = defineExactModelModule({})),});-export const seedanceManifest = seedanceDefinition.manifest;-export const seedanceManifestDigest = seedanceDefinition.manifestDigest;-export const seedanceEndpoints = seedanceDefinition.endpoints;-export const seedanceComponent = seedanceDefinition.component;+export const seedanceEndpoints = seedanceBaseDefinition.endpoints;++export const seedanceManifest = {+ ...seedanceBaseDefinition.manifest,+ dependencies: [+ ...seedanceBaseDefinition.manifest.dependencies,+ videoContractDependencies.narrative,+ ],+ types: [+ ...seedanceBaseDefinition.manifest.types,+ {+ name: seedanceTypes.prompt.name,+ schema: generationObjectSchema({+ contract: { schema: { kind: "literal", value: "svml.seedance-prompt@1" } },+ text: { schema: generationPromptSchema },+ promptDigest: { schema: generationDigestSchema },+ }),+ },+ ],+ surfaces: [+ {+ name: "prompt",+ tag: "Prompt",+ mode: "structured",+ outputs: [seedanceTypes.prompt],+ implementation: {+ kind: "trusted-frontend-surface",+ locator: "@svml/seedance/prompt-surface",+ digest: seedanceSurfaceImplementationDigests.prompt,+ },+ },+ {+ name: "speech",+ tag: "Speech",+ mode: "structured",+ outputs: Object.values(seedanceEndpoints).map((endpoint) => endpoint.requestType),+ implementation: {+ kind: "trusted-frontend-surface",+ locator: "@svml/seedance/speech-surface",+ digest: seedanceSurfaceImplementationDigests.speech,+ },+ },+ {+ name: "video",+ tag: "Video",+ mode: "structured",+ outputs: Object.values(seedanceEndpoints).map((endpoint) => endpoint.requestType),+ implementation: {+ kind: "trusted-frontend-surface",+ locator: "@svml/seedance/video-surface",+ digest: seedanceSurfaceImplementationDigests.video,+ },+ },+ ],+} as const;+export const seedanceManifestDigest = digestOf(seedanceManifest);+export const seedanceComponent = seedanceBaseDefinition.component;+export const seedanceDefinition = {+ ...seedanceBaseDefinition,+ manifest: seedanceManifest,+ manifestDigest: seedanceManifestDigest,+};++export { createSeedanceGenerationFragment } from "./fragment.js";+export {+ decodeSeedancePromptSurface,+ decodeSeedanceSpeechSurface,+ decodeSeedanceVideoSurface,+} from "./surface.js";diff --git a/packages/seedance/src/surface.ts b/packages/seedance/src/surface.tsnew file mode 100644index 00000000..00122e56--- /dev/null+++ b/packages/seedance/src/surface.ts@@ -0,0 +1,318 @@+import {+ contractTypes,+} from "@svml/contracts";+import { digestOf } from "@svml/protocol";+import type { BlobRef, CanonicalValue } from "@svml/protocol";+import type {+ StructuredElement,+ StructuredSurfaceHandler,+ SurfaceResolvedReference,+ TextAttributeValue,+} from "@svml/text";++import { createSeedanceGenerationFragment } from "./fragment.js";+import {+ sealSeedancePrompt,+ sealSeedanceRequest,+ seedanceEndpoints,+ seedanceTypes,+ verifySeedancePrompt,+} from "./index.js";+import type {+ SeedanceModel,+ SeedancePrompt,+ SeedanceReference,+} from "./index.js";++type ReferenceInput = SeedanceReference & { readonly role?: string };++function localName(value: string): string {+ return value.includes(":") ? value.slice(value.lastIndexOf(":") + 1) : value;+}++function attributes(+ element: StructuredElement,+ required: readonly string[],+ optional: readonly string[] = [],+): void {+ const allowed = new Set([...required, ...optional]);+ const unknown = Object.keys(element.attributes).filter((name) => !allowed.has(name));+ if (unknown.length > 0 || required.some((name) => element.attributes[name] === undefined)) {+ throw new Error(+ `${element.name} requires ${required.join(", ")}`+ + (optional.length === 0 ? "" : `; optional: ${optional.join(", ")}`),+ );+ }+}++function stringAttribute(element: StructuredElement, name: string): string {+ const value = element.attributes[name];+ if (typeof value !== "string" || value.trim().length === 0) {+ throw new Error(`${element.name}.${name} must be a non-empty string`);+ }+ return value.trim();+}++function optionalStringAttribute(element: StructuredElement, name: string): string | undefined {+ const value = element.attributes[name];+ if (value === undefined) return undefined;+ if (typeof value !== "string" || value.trim().length === 0) {+ throw new Error(`${element.name}.${name} must be a non-empty string`);+ }+ return value.trim();+}++function referenceAttribute(element: StructuredElement, name: string): string {+ const value: TextAttributeValue | undefined = element.attributes[name];+ if (typeof value !== "object" || value.kind !== "reference" || value.path.length === 0) {+ throw new Error(`${element.name}.${name} must be a whole-value reference`);+ }+ return value.path;+}++function sameType(left: SurfaceResolvedReference["type"], right: SurfaceResolvedReference["type"]): boolean {+ return left.module.name === right.module.name+ && left.module.version === right.module.version+ && left.name === right.name;+}++function resolved(+ element: StructuredElement,+ name: string,+ resolveReference: (path: string) => SurfaceResolvedReference | undefined,+): SurfaceResolvedReference {+ const path = referenceAttribute(element, name);+ const value = resolveReference(path);+ if (value === undefined) throw new Error(`${element.name}.${name} cannot resolve ${path}`);+ return value;+}++function inline(reference: SurfaceResolvedReference, subject: string): CanonicalValue {+ const value = reference.record?.value;+ if (value?.kind !== "inline") throw new Error(`${subject} must reference an authored value declared before use`);+ return value.value;+}++function prompt(reference: SurfaceResolvedReference, subject: string): SeedancePrompt {+ if (!sameType(reference.type, seedanceTypes.prompt)) throw new Error(`${subject} must reference a Seedance Prompt`);+ const value = inline(reference, subject);+ verifySeedancePrompt(value);+ return value;+}++function blob(reference: SurfaceResolvedReference, subject: string): BlobRef {+ if (!sameType(reference.type, contractTypes.blobArtifact)) throw new Error(`${subject} must reference a BlobArtifact`);+ const value = reference.record?.value;+ if (value?.kind !== "blob") throw new Error(`${subject} must reference an authored artifact declared before use`);+ return value;+}++function normalizedText(element: StructuredElement): string {+ if (element.children.some((child) => child.kind === "element")) {+ throw new Error(`${element.name} accepts text only`);+ }+ const raw = element.children.map((child) => child.kind === "text" ? child.value : "").join("");+ const lines = raw.replaceAll("\r\n", "\n").split("\n");+ while (lines[0]?.trim() === "") lines.shift();+ while (lines.at(-1)?.trim() === "") lines.pop();+ const indents = lines.filter((line) => line.trim()).map((line) => /^\s*/u.exec(line)?.[0].length ?? 0);+ const indent = indents.length === 0 ? 0 : Math.min(...indents);+ return lines.map((line) => line.slice(indent).trimEnd()).join("\n").trim();+}++function modelSelection(element: StructuredElement) {+ const requested = stringAttribute(element, "model");+ if (requested === "standard" || requested === "seedance-2") {+ return { endpoint: seedanceEndpoints.standard!, model: "seedance-2" as const };+ }+ if (requested === "fast" || requested === "seedance-2-fast") {+ return { endpoint: seedanceEndpoints.fast!, model: "seedance-2-fast" as const };+ }+ if (requested === "mini" || requested === "seedance-2-mini") {+ return { endpoint: seedanceEndpoints.mini!, model: "seedance-2-mini" as const };+ }+ throw new Error(`${element.name}.model must be standard, fast or mini`);+}++function integerAttribute(element: StructuredElement, name: string): number {+ const value = Number(stringAttribute(element, name));+ if (!Number.isSafeInteger(value)) throw new Error(`${element.name}.${name} must be an integer`);+ return value;+}++function booleanAttribute(element: StructuredElement, name: string, fallback: boolean): boolean {+ const value = optionalStringAttribute(element, name);+ if (value === undefined) return fallback;+ if (value === "true") return true;+ if (value === "false") return false;+ throw new Error(`${element.name}.${name} must be true or false`);+}++function generationSettings(element: StructuredElement, model: SeedanceModel): {+ readonly durationSec: number;+ readonly resolution: "480p" | "720p" | "1080p";+ readonly aspectRatio: "1:1" | "4:3" | "3:4" | "16:9" | "9:16" | "21:9" | "adaptive";+ readonly webSearch: boolean;+} {+ const durationSec = integerAttribute(element, "duration");+ if (durationSec < 4 || durationSec > 15) {+ throw new Error(`${element.name}.duration must be between 4 and 15 seconds`);+ }+ const resolution = optionalStringAttribute(element, "resolution") ?? "720p";+ if (resolution !== "480p" && resolution !== "720p" && resolution !== "1080p") {+ throw new Error(`${element.name}.resolution must be 480p, 720p or 1080p`);+ }+ if (resolution === "1080p" && model !== "seedance-2") {+ throw new Error(`${element.name}.resolution 1080p is available only for the standard model`);+ }+ const aspectRatio = optionalStringAttribute(element, "aspect-ratio") ?? "9:16";+ if (!["1:1", "4:3", "3:4", "16:9", "9:16", "21:9", "adaptive"].includes(aspectRatio)) {+ throw new Error(`${element.name}.aspect-ratio is not supported by Seedance`);+ }+ return {+ durationSec,+ resolution,+ aspectRatio: aspectRatio as "1:1" | "4:3" | "3:4" | "16:9" | "9:16" | "21:9" | "adaptive",+ webSearch: booleanAttribute(element, "web-search", false),+ };+}++function references(+ element: StructuredElement,+ resolveReference: (path: string) => SurfaceResolvedReference | undefined,+): ReferenceInput[] {+ const result: ReferenceInput[] = [];+ for (const child of element.children) {+ if (child.kind === "text") {+ if (child.value.trim().length > 0) throw new Error(`${element.name} accepts only Reference children`);+ continue;+ }+ if (localName(child.name) !== "Reference") throw new Error(`${element.name} accepts only Reference children`);+ attributes(child, [], ["image", "video", "audio", "role"]);+ const kinds = (["image", "video", "audio"] as const).filter((kind) => child.attributes[kind] !== undefined);+ if (kinds.length !== 1) throw new Error(`${child.name} requires exactly one of image, video or audio`);+ const kind = kinds[0]!;+ const source = resolved(child, kind, resolveReference);+ const artifact = blob(source, `${child.name}.${kind}`);+ if (!artifact.mediaType.startsWith(`${kind}/`)) {+ throw new Error(`${child.name}.${kind} must reference ${kind} media`);+ }+ const role = optionalStringAttribute(child, "role");+ result.push({ kind, artifact, ...(role === undefined ? {} : { role }) });+ }+ if (result.length > 12) throw new Error(`${element.name} accepts at most 12 references`);+ return result;+}++function referencePrompt(values: readonly ReferenceInput[]): string {+ const roles = values.flatMap((item, index) => item.role === undefined+ ? []+ : [`Reference ${item.kind} ${index + 1} is the ${item.role}.`]);+ return roles.length === 0 ? "" : `\n\nReference roles:\n${roles.join("\n")}`;+}++function excerpt(reference: SurfaceResolvedReference, subject: string): {+ readonly serializations: { readonly dialogue: string; readonly speech: string };+} {+ if (!sameType(reference.type, contractTypes.narrativeExcerpt)) {+ throw new Error(`${subject} must reference a NarrativeExcerpt such as script.segment.opening`);+ }+ const value = inline(reference, subject) as unknown as {+ readonly contract: string;+ readonly excerptDigest: string;+ readonly serializations?: { readonly dialogue?: string; readonly speech?: string };+ readonly [key: string]: CanonicalValue | undefined;+ };+ if (value.contract !== "svml.narrative-excerpt@1" || value.serializations === undefined+ || typeof value.serializations.dialogue !== "string" || typeof value.serializations.speech !== "string") {+ throw new Error(`${subject} NarrativeExcerpt is invalid`);+ }+ const { excerptDigest: _digest, ...content } = value;+ if (value.excerptDigest !== digestOf(content)) throw new Error(`${subject} NarrativeExcerpt digest differs`);+ if (value.serializations.speech.trim().length === 0) throw new Error(`${subject} contains no spoken text`);+ return value as { readonly serializations: { readonly dialogue: string; readonly speech: string } };+}++function generationOutput(+ element: StructuredElement,+ request: ReturnType<typeof sealSeedanceRequest>,+ output: string,+) {+ const { endpoint } = modelSelection(element);+ const fragment = createSeedanceGenerationFragment(endpoint);+ const requestId = `${stringAttribute(element, "id")}.request`;+ const id = stringAttribute(element, "id");+ return {+ records: [{+ id: requestId,+ type: endpoint.requestType,+ value: { kind: "inline" as const, value: request as unknown as CanonicalValue },+ range: element.range,+ }],+ components: [{+ id,+ fragment: fragment.id,+ inputs: { request: { kind: "record" as const, id: requestId } },+ outputs: { video: output },+ range: element.range,+ }],+ fragments: [fragment],+ };+}++export const decodeSeedancePromptSurface: StructuredSurfaceHandler = ({ element }) => {+ attributes(element, ["id"]);+ const id = stringAttribute(element, "id");+ const value = sealSeedancePrompt(normalizedText(element));+ return {+ records: [{+ id,+ type: seedanceTypes.prompt,+ value: { kind: "inline", value: value as unknown as CanonicalValue },+ range: element.range,+ }],+ components: [],+ fragments: [],+ };+};++export const decodeSeedanceVideoSurface: StructuredSurfaceHandler = ({ element, resolveReference }) => {+ attributes(element, ["id", "model", "prompt", "duration"], [+ "resolution", "aspect-ratio", "generate-audio", "web-search",+ ]);+ const selected = modelSelection(element);+ const declaredPrompt = prompt(resolved(element, "prompt", resolveReference), `${element.name}.prompt`);+ const refs = references(element, resolveReference);+ const request = sealSeedanceRequest({+ contract: "svml.seedance-request@1",+ model: selected.model,+ prompt: declaredPrompt.text + referencePrompt(refs),+ mode: refs.length === 0+ ? { kind: "text" }+ : { kind: "reference", items: refs.map(({ role: _role, ...item }) => item) },+ ...generationSettings(element, selected.model),+ generateAudio: booleanAttribute(element, "generate-audio", false),+ });+ return generationOutput(element, request, `${stringAttribute(element, "id")}.video`);+};++export const decodeSeedanceSpeechSurface: StructuredSurfaceHandler = ({ element, resolveReference }) => {+ attributes(element, ["id", "model", "script", "prompt", "duration"], [+ "resolution", "aspect-ratio", "web-search",+ ]);+ const selected = modelSelection(element);+ const declaredPrompt = prompt(resolved(element, "prompt", resolveReference), `${element.name}.prompt`);+ const spoken = excerpt(resolved(element, "script", resolveReference), `${element.name}.script`);+ const refs = references(element, resolveReference);+ const request = sealSeedanceRequest({+ contract: "svml.seedance-request@1",+ model: selected.model as SeedanceModel,+ prompt: `${declaredPrompt.text}${referencePrompt(refs)}\n\nSpoken dialogue — say exactly:\n${spoken.serializations.dialogue}`,+ mode: refs.length === 0+ ? { kind: "text" }+ : { kind: "reference", items: refs.map(({ role: _role, ...item }) => item) },+ ...generationSettings(element, selected.model),+ generateAudio: true,+ });+ return generationOutput(element, request, stringAttribute(element, "id"));+};diff --git a/packages/speech-align/src/locate.ts b/packages/speech-align/src/locate.tsindex 8e1e6007..7d7fd4e2 100644--- a/packages/speech-align/src/locate.ts+++ b/packages/speech-align/src/locate.ts@@ -58,12 +58,6 @@ function validateBasis(narrative: Narrative, basis: SpeechAudioBasis): void {if (basis.contract !== "svml.speech-audio-basis@1") {fail("SPEECH_BASIS_CONTRACT", "Unsupported SpeechAudioBasis contract.");}- if (!isDigest(basis.basisDigest) || !isDigest(basis.narrativeDigest)) {- fail("SPEECH_BASIS_DIGEST", "SpeechAudioBasis identity digest is invalid.");- }- if (basis.narrativeDigest !== narrative.semanticIndex.digest) {- fail("SPEECH_BASIS_NARRATIVE", "SpeechAudioBasis belongs to a different Narrative.");- }const { digest: _programDigest, ...programContent } = basis.programSpace;if (!isDigest(basis.programSpace.digest) || basis.programSpace.digest !== computeProgramSpaceDigest(programContent)) {fail("SPEECH_PROGRAM_DIGEST", "ProgramSpace digest does not match its canonical contents.");@@ -93,9 +87,6 @@ function validateBasis(narrative: Narrative, basis: SpeechAudioBasis): void {if (segment.startSec < previousEnd - EPSILON) {fail("SPEECH_BASIS_SEGMENTS", `SpeechAudioBasis Segment ${segment.segmentId} overlaps its predecessor.`);}- if (!isDigest(segment.sourceArtifactDigest)) {- fail("SPEECH_BASIS_ARTIFACT", `SpeechBasis Segment ${segment.segmentId} artifact digest is invalid.`);- }previousEnd = segment.endSec;}}@@ -111,11 +102,8 @@ function validateEvidence(if (!Number.isFinite(evidence.durationSec) || evidence.durationSec <= 0) {fail("SPEECH_DURATION", "Aligned-transcript duration must be positive and finite.");}- if (evidence.basisDigest !== basis.basisDigest) {- fail("SPEECH_EVIDENCE_BASIS", "Aligned transcript was measured from a different SpeechBasis.");- }- if (evidence.audioArtifactDigest !== basis.audio.digest) {- fail("SPEECH_EVIDENCE_AUDIO", "Aligned transcript was measured from a different audio Artifact.");+ if (!isDigest(evidence.audioArtifactDigest)) {+ fail("SPEECH_EVIDENCE_AUDIO", "Aligned transcript has no acoustic Artifact identity.");}if (evidence.programSpaceDigest !== basis.programSpace.digest) {fail("SPEECH_EVIDENCE_PROGRAM", "Aligned transcript uses a different ProgramSpace.");@@ -123,9 +111,6 @@ function validateEvidence(if (Math.abs(evidence.durationSec - basis.programSpace.durationSec) > EPSILON) {fail("SPEECH_EVIDENCE_DURATION", "Aligned transcript duration differs from SpeechBasis.");}- if (!isDigest(evidence.rawEvidenceArtifactDigest)) {- fail("SPEECH_EVIDENCE_RAW", "Aligned transcript raw Artifact digest is invalid.");- }const { evidenceDigest: _evidenceDigest, ...evidenceContent } = evidence;if (!isDigest(evidence.evidenceDigest)@@ -500,13 +485,7 @@ export function locateSpeechTiming(});const payload = {contract: "svml.complete-semantic-map@1" as const,- semanticIndexDigest: narrative.semanticIndex.digest,- basisDigest: basis.basisDigest,- audioArtifactDigest: basis.audio.digest,- programSpaceDigest: basis.programSpace.digest,programSpace: basis.programSpace,- evidenceDigest: evidence.evidenceDigest,- locatorDigest: speechLocatorDigest,quantizationPolicy: "nearest-frame" as const,durationSec: evidence.durationSec,segments: timedSegments,diff --git a/packages/speech-align/src/manifest.ts b/packages/speech-align/src/manifest.tsindex d1006d67..760e756a 100644--- a/packages/speech-align/src/manifest.ts+++ b/packages/speech-align/src/manifest.ts@@ -34,11 +34,7 @@ export const speechAlignManifest: ModuleManifest = {name: "map",type: contractTypes.completeSemanticMap,affinity: [- { resultPointer: "/semanticIndexDigest", input: "narrative", inputPointer: "/semanticIndex/digest" },- { resultPointer: "/basisDigest", input: "audio", inputPointer: "/basisDigest" },- { resultPointer: "/audioArtifactDigest", input: "audio", inputPointer: "/audio/digest" },- { resultPointer: "/programSpaceDigest", input: "audio", inputPointer: "/programSpace/digest" },- { resultPointer: "/evidenceDigest", input: "evidence", inputPointer: "/evidenceDigest" },+ { resultPointer: "/programSpace/digest", input: "audio", inputPointer: "/programSpace/digest" },],}],needs: [],diff --git a/packages/speech-align/test/speech-align.test.ts b/packages/speech-align/test/speech-align.test.tsindex df5c4b45..30041b66 100644--- a/packages/speech-align/test/speech-align.test.ts+++ b/packages/speech-align/test/speech-align.test.ts@@ -33,10 +33,8 @@ function evidence(args: {}): AlignedTranscriptEvidence {return sealAlignedTranscriptEvidence({contract: "svml.aligned-transcript-evidence@1",- basisDigest: args.basis.basisDigest,- audioArtifactDigest: args.basis.audio.digest,+ audioArtifactDigest: digestOf("fixture:whisperx:acoustic-input"),programSpaceDigest: args.basis.programSpace.digest,- rawEvidenceArtifactDigest: digestOf("fixture:whisperx:raw"),durationSec: args.basis.programSpace.durationSec,segments: [{@@ -66,18 +64,16 @@ function speechBasis(segmentId: segment.id,startSec: windows?.[index]?.startSec ?? durationSec * index / narrative.segments.length,endSec: windows?.[index]?.endSec ?? durationSec * (index + 1) / narrative.segments.length,- sourceArtifactDigest: digestOf(`fixture:clip:${segment.id}`),}));const take = sealSpeechBasis({contract: "svml.speech-basis@1",- narrativeDigest: narrative.semanticIndex.digest,programSpace,audio: { digest: audioDigest, size: 1, mediaType: "audio/wav", durationSec },visualTrack: {clips: segments.map((segment) => ({segmentId: segment.segmentId,artifact: {- digest: segment.sourceArtifactDigest,+ digest: digestOf(`fixture:clip:${segment.segmentId}`),size: 1,mediaType: "video/mp4",durationSec: segment.endSec - segment.startSec,@@ -94,8 +90,6 @@ function speechBasis(function audioProjection(basis: SpeechBasis): SpeechAudioBasis {return {contract: "svml.speech-audio-basis@1",- basisDigest: basis.basisDigest,- narrativeDigest: basis.narrativeDigest,programSpace: basis.programSpace,audio: basis.audio,segments: basis.segments,@@ -279,10 +273,8 @@ test("multiple Script Segments stay independent even when evidence records arriv]);const map = locateSpeechTiming(narrative, basis, sealAlignedTranscriptEvidence({contract: "svml.aligned-transcript-evidence@1",- basisDigest: basis.basisDigest,- audioArtifactDigest: basis.audio.digest,+ audioArtifactDigest: digestOf("fixture:segments:acoustic-input"),programSpaceDigest: basis.programSpace.digest,- rawEvidenceArtifactDigest: digestOf("fixture:segments:raw"),durationSec: 2,segments: [{@@ -322,24 +314,21 @@ test("invalid overlapping evidence word windows fail instead of producing a reve);});-test("Evidence from another same-duration audio Basis is rejected before alignment", () => {+test("Evidence is rejected for another coordinate space without replaying hidden provenance", () => {const narrative = parseScript("affinity.svml", "<line>Hello world.</line>");- const firstBasis = speechBasis(narrative, 2);- const firstEvidence = evidence({- basis: firstBasis,- words: [- { text: "Hello", startSec: 0.1, endSec: 0.4 },- { text: "world", startSec: 0.5, endSec: 0.9 },- ],+ const basis = speechBasis(narrative, 2);+ const mismatched = evidence({+ basis,+ words: [{ text: "Hello", startSec: 0.1, endSec: 0.4 }, { text: "world", startSec: 0.5, endSec: 0.9 }],+ });+ const anotherSpace = sealProgramSpace({+ contract: "svml.program-space@0",+ durationSec: 2,+ frameRate: { numerator: 30, denominator: 1 },});- const secondBasis: SpeechAudioBasis = {- ...firstBasis,- basisDigest: digestOf("fixture:another-take"),- audio: { ...firstBasis.audio, digest: digestOf("fixture:another-same-duration-audio") },- };assert.throws(- () => locateSpeechTiming(narrative, secondBasis, firstEvidence),- (error: unknown) => error instanceof SpeechAlignmentError && error.code === "SPEECH_EVIDENCE_BASIS",+ () => locateSpeechTiming(narrative, basis, { ...mismatched, programSpaceDigest: anotherSpace.digest }),+ (error: unknown) => error instanceof SpeechAlignmentError && error.code === "SPEECH_EVIDENCE_PROGRAM",);});@@ -353,7 +342,6 @@ test("the final map is quantized once into the selected ProgramSpace", () => {});const basis: SpeechAudioBasis = {...original,- basisDigest: digestOf("fixture:30fps-take"),programSpace,};const map = locateSpeechTiming(narrative, basis, evidence({diff --git a/packages/speech-program/src/speech.ts b/packages/speech-program/src/speech.tsindex b32fe699..186c1f9c 100644--- a/packages/speech-program/src/speech.ts+++ b/packages/speech-program/src/speech.ts@@ -54,8 +54,6 @@ export const speechTakeProjectionFragment = sealGraphFragment({root: operation("project-audio"),semanticInputs: ["take"],affinity: [- { resultPointer: "/basisDigest", source: input("take"), sourcePointer: "/basisDigest" },- { resultPointer: "/narrativeDigest", source: input("take"), sourcePointer: "/narrativeDigest" },{ resultPointer: "/programSpace/digest", source: input("take"), sourcePointer: "/programSpace/digest" },{ resultPointer: "/audio/digest", source: input("take"), sourcePointer: "/audio/digest" },],@@ -67,8 +65,6 @@ export const speechTakeProjectionFragment = sealGraphFragment({root: operation("project-visual"),semanticInputs: ["take"],affinity: [- { resultPointer: "/sources/0/digest", source: input("take"), sourcePointer: "/basisDigest" },- { resultPointer: "/sources/1/digest", source: input("take"), sourcePointer: "/narrativeDigest" },{ resultPointer: "/programSpaceDigest", source: input("take"), sourcePointer: "/programSpace/digest" },],fidelity: "exact",@@ -79,8 +75,6 @@ export const speechTakeProjectionFragment = sealGraphFragment({root: operation("project-audio-track"),semanticInputs: ["take"],affinity: [- { resultPointer: "/sources/0/digest", source: input("take"), sourcePointer: "/basisDigest" },- { resultPointer: "/sources/1/digest", source: input("take"), sourcePointer: "/narrativeDigest" },{ resultPointer: "/programSpaceDigest", source: input("take"), sourcePointer: "/programSpace/digest" },],fidelity: "exact",@@ -132,9 +126,7 @@ export const whisperXSpeechAlignmentFragment = sealGraphFragment({root: operation("request-whisperx"),semanticInputs: ["audio"],affinity: [- { resultPointer: "/basisDigest", source: input("audio"), sourcePointer: "/basisDigest" },- { resultPointer: "/audioArtifactDigest", source: input("audio"), sourcePointer: "/audio/digest" },- { resultPointer: "/evidenceAudioDigest", source: operation("prepare-evidence-audio"), sourcePointer: "/evidenceAudioDigest" },+ { resultPointer: "/audioArtifactDigest", source: operation("prepare-evidence-audio"), sourcePointer: "/artifact/digest" },{ resultPointer: "/programSpaceDigest", source: input("audio"), sourcePointer: "/programSpace/digest" },],fidelity: "exact",@@ -145,8 +137,7 @@ export const whisperXSpeechAlignmentFragment = sealGraphFragment({root: operation("normalize-evidence"),semanticInputs: ["audio"],affinity: [- { resultPointer: "/basisDigest", source: input("audio"), sourcePointer: "/basisDigest" },- { resultPointer: "/audioArtifactDigest", source: input("audio"), sourcePointer: "/audio/digest" },+ { resultPointer: "/audioArtifactDigest", source: operation("prepare-evidence-audio"), sourcePointer: "/artifact/digest" },{ resultPointer: "/programSpaceDigest", source: input("audio"), sourcePointer: "/programSpace/digest" },],fidelity: "exact",@@ -157,12 +148,7 @@ export const whisperXSpeechAlignmentFragment = sealGraphFragment({root: operation("locate-speech"),semanticInputs: ["narrative", "audio"],affinity: [- { resultPointer: "/semanticIndexDigest", source: input("narrative"), sourcePointer: "/semanticIndex/digest" },- { resultPointer: "/basisDigest", source: input("audio"), sourcePointer: "/basisDigest" },- { resultPointer: "/audioArtifactDigest", source: input("audio"), sourcePointer: "/audio/digest" },- { resultPointer: "/programSpaceDigest", source: input("audio"), sourcePointer: "/programSpace/digest" },{ resultPointer: "/programSpace/digest", source: input("audio"), sourcePointer: "/programSpace/digest" },- { resultPointer: "/evidenceDigest", source: operation("normalize-evidence"), sourcePointer: "/evidenceDigest" },],fidelity: "exact",},@@ -187,8 +173,6 @@ export const captionTimingFragment = sealGraphFragment({root: operation("temporalize-caption"),semanticInputs: ["narrative", "map"],affinity: [- { resultPointer: "/semanticIndexDigest", source: input("narrative"), sourcePointer: "/semanticIndex/digest" },- { resultPointer: "/speechTimeMapDigest", source: input("map"), sourcePointer: "/mapDigest" },{ resultPointer: "/programSpace/digest", source: input("map"), sourcePointer: "/programSpace/digest" },],fidelity: "exact",@@ -215,8 +199,6 @@ export const captionTrackFragment = sealGraphFragment({semanticInputs: ["caption", "program"],affinity: [{ resultPointer: "/programSpaceDigest", source: input("caption"), sourcePointer: "/programSpace/digest" },- { resultPointer: "/sources/0/digest", source: input("program"), sourcePointer: "/digest" },- { resultPointer: "/sources/1/digest", source: input("caption"), sourcePointer: "/projectionDigest" },],fidelity: "exact",}],diff --git a/packages/speech-program/test/video-pipeline-fixture.ts b/packages/speech-program/test/video-pipeline-fixture.tsindex cde8fa8e..2cb78501 100644--- a/packages/speech-program/test/video-pipeline-fixture.ts+++ b/packages/speech-program/test/video-pipeline-fixture.ts@@ -152,11 +152,6 @@ export const videoManifest: ModuleManifest = {outputs: [{name: "basis",type: contractTypes.speechBasis,- affinity: [{- resultPointer: "/narrativeDigest",- input: "narrative",- inputPointer: "/semanticIndex/digest",- }],}],needs: [],implementation: {@@ -214,11 +209,6 @@ const speechTakeGenerationFragment = sealGraphFragment({type: contractTypes.speechBasis,root: operation("assemble-take"),semanticInputs: ["narrative", "estimate"],- affinity: [{- resultPointer: "/narrativeDigest",- source: input("narrative"),- sourcePointer: "/semanticIndex/digest",- }],fidelity: "exact",}],});diff --git a/packages/speech-program/test/video-pipeline.test.ts b/packages/speech-program/test/video-pipeline.test.tsindex 334f964c..3d0d4d75 100644--- a/packages/speech-program/test/video-pipeline.test.ts+++ b/packages/speech-program/test/video-pipeline.test.ts@@ -175,7 +175,6 @@ test("the Speech Program pipeline resumes without repeating paid calls", async (const visualDigest = media.visualDigest as SpeechBasis["audio"]["digest"];const basis = sealSpeechBasis({contract: "svml.speech-basis@1",- narrativeDigest: narrative.semanticIndex.digest,programSpace,audio: { digest: audioDigest, size: 1, mediaType: "audio/wav", durationSec },visualTrack: { clips: [{@@ -184,7 +183,7 @@ test("the Speech Program pipeline resumes without repeating paid calls", async (startSec: 0,endSec: durationSec,}] },- segments: [{ segmentId: "line", startSec: 0, endSec: durationSec, sourceArtifactDigest: visualDigest }],+ segments: [{ segmentId: "line", startSec: 0, endSec: durationSec }],});return { outputs: { basis: { kind: "inline", value: basis } }, needs: {} };});@@ -215,8 +214,6 @@ test("the Speech Program pipeline resumes without repeating paid calls", async (const sourceSampleFrames = Math.round(audio.programSpace.durationSec * 48_000);const need: ProjectSpeechEvidenceAudioNeed = {contract: "svml.project-speech-evidence-audio-request@1",- basisDigest: audio.basisDigest,- narrativeDigest: audio.narrativeDigest,programSpaceDigest: audio.programSpace.digest,source: {kind: "blob",@@ -331,8 +328,6 @@ test("the Speech Program pipeline resumes without repeating paid calls", async (return {value: { kind: "inline", value: sealSpeechEvidenceAudio({contract: "svml.speech-evidence-audio@1",- basisDigest: request.basisDigest,- narrativeDigest: request.narrativeDigest,programSpaceDigest: request.programSpaceDigest,sourceAudioArtifactDigest: request.source.digest,artifact: {@@ -368,9 +363,9 @@ test("the Speech Program pipeline resumes without repeating paid calls", async (assert.equal(atWhisperX.blocked[0]?.reason, "missing-endpoint");assert.match(atWhisperX.blocked[0]?.subject ?? "", /WhisperXAlignmentEvidence/u);- const wrongBasisEndpoints = new EndpointRegistry();- wrongBasisEndpoints.registerImmediateEndpoint(- "runtime:wrong-basis-whisperx",+ const wrongMeasurementEndpoints = new EndpointRegistry();+ wrongMeasurementEndpoints.registerImmediateEndpoint(+ "runtime:wrong-measurement-whisperx",whisperXCapabilities.alignment,whisperXTypes.alignmentEvidence,() => ({@@ -379,11 +374,8 @@ test("the Speech Program pipeline resumes without repeating paid calls", async (value: sealWhisperXAlignmentEvidence({contract: "svml.whisperx-alignment-evidence@2",engine: "whisperx",- basisDigest: digestOf("another-project:basis"),audioArtifactDigest: digestOf("another-project:audio"),- evidenceAudioDigest: digestOf("another-project:evidence-audio"),programSpaceDigest: digestOf("another-project:program-space"),- rawEvidenceArtifactDigest: digestOf("another-project:whisperx-json"),durationSec: 1,segments: [{ sourceSegmentId: "line", startSec: 0, endSec: 1, words: [], chars: [] }],}),@@ -395,13 +387,13 @@ test("the Speech Program pipeline resumes without repeating paid calls", async ();const rejectedEvidence = await new NodeDriver({producers: host,- endpoints: wrongBasisEndpoints,+ endpoints: wrongMeasurementEndpoints,validators: validatorRegistry(),}).run(parseBuildState(serializeBuildState(atWhisperX.state)),);assert.equal(rejectedEvidence.status, "paused");- assert.match(rejectedEvidence.journal.at(-1)?.message ?? "", /different SpeechBasis|does not match/u);+ assert.match(rejectedEvidence.journal.at(-1)?.message ?? "", /does not match/u);const rejectedWhisperNeed = rejectedEvidence.state.needs.find((need) =>sameCapability(need.capability, whisperXCapabilities.alignment));assert(rejectedWhisperNeed);@@ -409,7 +401,7 @@ test("the Speech Program pipeline resumes without repeating paid calls", async (rejectedEvidence.state.records.some((record) =>record.id === rejectedWhisperNeed.result),false,- "Evidence for another same-duration audio projection must not enter BuildState",+ "Evidence claiming another measured Artifact must not enter BuildState",);endpoints.registerImmediateEndpoint(@@ -424,11 +416,8 @@ test("the Speech Program pipeline resumes without repeating paid calls", async (value: sealWhisperXAlignmentEvidence({contract: "svml.whisperx-alignment-evidence@2",engine: "whisperx",- basisDigest: request.basisDigest as WhisperXAlignmentEvidence["basisDigest"],- audioArtifactDigest: request.sourceAudioArtifactDigest as WhisperXAlignmentEvidence["audioArtifactDigest"],- evidenceAudioDigest: request.evidenceAudioDigest as WhisperXAlignmentEvidence["evidenceAudioDigest"],+ audioArtifactDigest: (request.audio as { readonly digest: WhisperXAlignmentEvidence["audioArtifactDigest"] }).digest,programSpaceDigest: request.programSpaceDigest as WhisperXAlignmentEvidence["programSpaceDigest"],- rawEvidenceArtifactDigest: digestOf("artifact:whisperx-json"),durationSec: 1,segments: [{sourceSegmentId: "line",@@ -478,6 +467,45 @@ test("the Speech Program pipeline resumes without repeating paid calls", async ([value.text, value.regions[0]?.display, value.regions[0]?.startSec, value.regions[0]?.endSec],["that was insane", "that was insane", 0.1, 0.72],);++ const mapRecordId = selectedRecord(completed.state, videoOutputs.map);+ const mapRecord = completed.state.records.find((record) => record.id === mapRecordId);+ assert.equal(mapRecord?.value.kind, "inline");+ const mapValue = inlineObject(mapRecord?.value.kind === "inline" ? mapRecord.value.value : {});+ for (const forbiddenLineageField of [+ "narrativeDigest",+ "semanticIndexDigest",+ "basisDigest",+ "audioArtifactDigest",+ "evidenceDigest",+ "locatorDigest",+ ]) {+ assert.equal(+ forbiddenLineageField in mapValue,+ false,+ `SemanticMap must not serialize Graph lineage as ${forbiddenLineageField}`,+ );+ }+ assert.equal(mapRecord?.origin.kind, "derived");+ const mapDerivation = completed.state.derivations.find((derivation) =>+ derivation.id === (mapRecord?.origin.kind === "derived" ? mapRecord.origin.derivation : undefined));+ assert(mapDerivation);+ const evidenceInput = mapDerivation.inputs.find((input) => {+ const record = completed.state.records.find((candidate) => candidate.id === input.id);+ return record?.type.name === contractTypes.alignedTranscriptEvidence.name+ && record.type.module.name === contractTypes.alignedTranscriptEvidence.module.name+ && record.type.module.version === contractTypes.alignedTranscriptEvidence.module.version;+ });+ assert(evidenceInput, "the Map fan-in must include the internal normalized Evidence Record");+ assert.deepEqual(+ new Set(mapDerivation.inputs.map((input) => input.id)),+ new Set([+ "narrative:root",+ selectedRecord(completed.state, videoOutputs.audio),+ evidenceInput.id,+ ]),+ "the fan-in belongs to the executed Graph/Derivation, not the SemanticMap payload",+ );});test("Targets prune official Fragments while shared SpeechTake generation stays singular", () => {@@ -525,7 +553,6 @@ test("an Existing SpeechTake cuts generation while a visual substitute cuts theconst visualDigest = digestOf("existing-take:visual");const existingTake = sealSpeechBasis({contract: "svml.speech-basis@1",- narrativeDigest: narrative.semanticIndex.digest,programSpace,audio: {digest: digestOf("existing-take:audio"),@@ -539,7 +566,7 @@ test("an Existing SpeechTake cuts generation while a visual substitute cuts thestartSec: 0,endSec: 1,}] },- segments: [{ segmentId: "line", startSec: 0, endSec: 1, sourceArtifactDigest: visualDigest }],+ segments: [{ segmentId: "line", startSec: 0, endSec: 1 }],});const takeCandidate = createProvidedCandidate({output: videoOutputs.take,@@ -575,10 +602,6 @@ test("an Existing SpeechTake cuts generation while a visual substitute cuts thevisualIr: "svml.hyperframes-visual-ir@1",id: "preview:black",programSpaceDigest: blackProgram.digest,- sources: [- { name: "basis", digest: digestOf("preview:black-basis") },- { name: "narrative", digest: narrative.semanticIndex.digest },- ],presents: [],});const blackValue = { kind: "inline" as const, value: black };diff --git a/packages/speech-take/README.md b/packages/speech-take/README.mdindex 44a879aa..b52fac03 100644--- a/packages/speech-take/README.md+++ b/packages/speech-take/README.md@@ -2,8 +2,9 @@Reference Product/Projection package for an atomic speech take.-`SpeechBasis` is the indivisible Product that binds audio, visual clips, ProgramSpace and-`basisDigest`. Four ordinary deterministic Producers project it into `ProgramSpace`,+`SpeechBasis` is the indivisible Product that binds audio, visual clips and ProgramSpace; its+`basisDigest` is the Product's own content identity, not an upstream lineage token. Four ordinary+deterministic Producers project it into `ProgramSpace`,`SpeechAudioBasis`, `VisualTrack` and `AudioTrack`. Core has no Projection primitive and never treatsthese outputs as ports of one mutable workflow node.diff --git a/packages/speech-take/src/manifest.ts b/packages/speech-take/src/manifest.tsindex be3e3712..0b22e3b0 100644--- a/packages/speech-take/src/manifest.ts+++ b/packages/speech-take/src/manifest.ts@@ -56,8 +56,6 @@ export const speechTakeManifest: ModuleManifest = {name: "audio",type: contractTypes.speechAudioBasis,affinity: [- { resultPointer: "/basisDigest", input: "basis", inputPointer: "/basisDigest" },- { resultPointer: "/narrativeDigest", input: "basis", inputPointer: "/narrativeDigest" },{ resultPointer: "/programSpace/digest", input: "basis", inputPointer: "/programSpace/digest" },{ resultPointer: "/audio/digest", input: "basis", inputPointer: "/audio/digest" },],@@ -76,8 +74,6 @@ export const speechTakeManifest: ModuleManifest = {name: "visual",type: contractTypes.visualTrack,affinity: [- { resultPointer: "/sources/0/digest", input: "basis", inputPointer: "/basisDigest" },- { resultPointer: "/sources/1/digest", input: "basis", inputPointer: "/narrativeDigest" },{ resultPointer: "/programSpaceDigest", input: "basis", inputPointer: "/programSpace/digest" },],}],@@ -95,8 +91,6 @@ export const speechTakeManifest: ModuleManifest = {name: "track",type: contractTypes.audioTrack,affinity: [- { resultPointer: "/sources/0/digest", input: "basis", inputPointer: "/basisDigest" },- { resultPointer: "/sources/1/digest", input: "basis", inputPointer: "/narrativeDigest" },{ resultPointer: "/programSpaceDigest", input: "basis", inputPointer: "/programSpace/digest" },],}],diff --git a/packages/speech-take/src/projection.ts b/packages/speech-take/src/projection.tsindex 340db2c5..35e68e81 100644--- a/packages/speech-take/src/projection.ts+++ b/packages/speech-take/src/projection.ts@@ -39,8 +39,6 @@ export function projectSpeechAudio(basis: SpeechBasis): SpeechAudioBasis {assertSpeechBasisIdentity(basis);return {contract: "svml.speech-audio-basis@1",- basisDigest: basis.basisDigest,- narrativeDigest: basis.narrativeDigest,programSpace: basis.programSpace,audio: basis.audio,segments: basis.segments,@@ -59,10 +57,6 @@ export function projectSpeechVisual(basis: SpeechBasis): VisualTrack {visualIr: "svml.hyperframes-visual-ir@1",id: `speech-visual:${basis.basisDigest}`,programSpaceDigest: basis.programSpace.digest,- sources: [- { name: "basis", digest: basis.basisDigest },- { name: "narrative", digest: basis.narrativeDigest },- ],presents: basis.visualTrack.clips.map((clip, index) => {const startFrame = frameAt(basis, clip.startSec);const endFrameExclusive = Math.min(totalFrames, frameAt(basis, clip.endSec));@@ -99,10 +93,6 @@ export function projectSpeechAudioTrack(basis: SpeechBasis): AudioTrack {contract: "svml.audio-track@1",id: `speech-audio:${basis.basisDigest}`,programSpaceDigest: basis.programSpace.digest,- sources: [- { name: "basis", digest: basis.basisDigest },- { name: "narrative", digest: basis.narrativeDigest },- ],clips: [{id: "speech",span: { startFrame: 0, endFrameExclusive: programSpaceFrameCount(basis.programSpace) },diff --git a/packages/speech-take/test/product.test.ts b/packages/speech-take/test/product.test.tsindex 5b4b299c..204557bc 100644--- a/packages/speech-take/test/product.test.ts+++ b/packages/speech-take/test/product.test.ts@@ -102,7 +102,6 @@ function sampleTake(label = "generated"): SpeechBasis {};return sealSpeechBasis({contract: "svml.speech-basis@1",- narrativeDigest: digestOf("narrative:product-test"),programSpace,audio,visualTrack: {@@ -112,7 +111,6 @@ function sampleTake(label = "generated"): SpeechBasis {segmentId: "opening",startSec: 0,endSec: durationSec,- sourceArtifactDigest: audio.digest,}],});}@@ -164,11 +162,18 @@ function createGraph(program: LinkedProgram): CompiledGraph {primary: "opening.audio.project",candidates: ["opening.audio.project"],semanticInputs: [output("opening.take")],- affinity: [{- resultPointer: "/basisDigest",- source: output("opening.take"),- sourcePointer: "/basisDigest",- }],+ affinity: [+ {+ resultPointer: "/programSpace/digest",+ source: output("opening.take"),+ sourcePointer: "/programSpace/digest",+ },+ {+ resultPointer: "/audio/digest",+ source: output("opening.take"),+ sourcePointer: "/audio/digest",+ },+ ],},{id: "opening.visual",@@ -177,9 +182,9 @@ function createGraph(program: LinkedProgram): CompiledGraph {candidates: ["opening.visual.project", "opening.visual.existing"],semanticInputs: [output("opening.take")],affinity: [{- resultPointer: "/sources/0/digest",+ resultPointer: "/programSpaceDigest",source: output("opening.take"),- sourcePointer: "/basisDigest",+ sourcePointer: "/programSpace/digest",}],},],@@ -311,7 +316,7 @@ test("SpeechBasis projects to peer generic visual and audio Tracks", () => {assert.equal(visual.programSpaceDigest, take.programSpace.digest);assert.equal(audio.programSpaceDigest, take.programSpace.digest);assert.equal(programSpace.digest, take.programSpace.digest);- assert.deepEqual(visual.sources, audio.sources);+ assert.equal(visual.presents[0]?.span.endFrameExclusive, audio.clips[0]?.span.endFrameExclusive);});test("a substitute visual Candidate does not contaminate an independent exact audio path", () => {diff --git a/packages/text-track/src/fragment.ts b/packages/text-track/src/fragment.tsindex 7cac8ef4..91ad2c28 100644--- a/packages/text-track/src/fragment.ts+++ b/packages/text-track/src/fragment.ts@@ -26,7 +26,6 @@ export const textTrackFragment = sealGraphFragment({semanticInputs: ["space", "program"],affinity: [{ resultPointer: "/programSpaceDigest", source: input("space"), sourcePointer: "/digest" },- { resultPointer: "/sources/0/digest", source: input("program"), sourcePointer: "/digest" },],fidelity: "exact",}],diff --git a/packages/text-track/src/manifest.ts b/packages/text-track/src/manifest.tsindex fbd40816..7a394af8 100644--- a/packages/text-track/src/manifest.ts+++ b/packages/text-track/src/manifest.ts@@ -86,7 +86,6 @@ export const textTrackManifest: ModuleManifest = {type: contractTypes.visualTrack,affinity: [{ resultPointer: "/programSpaceDigest", input: "space", inputPointer: "/digest" },- { resultPointer: "/sources/0/digest", input: "program", inputPointer: "/digest" },],}],needs: [],diff --git a/packages/text-track/src/program.ts b/packages/text-track/src/program.tsindex 7e8a4bc9..dd6ee428 100644--- a/packages/text-track/src/program.ts+++ b/packages/text-track/src/program.ts@@ -164,7 +164,6 @@ export function renderTextTrack(programSpace: ProgramSpace, program: TextTrackPrvisualIr: "svml.hyperframes-visual-ir@1",id: program.id,programSpaceDigest: programSpace.digest,- sources: [{ name: "program", digest: program.digest }],presents: program.items.map((item) => ({id: item.id,span: { ...item.span },diff --git a/packages/text-track/test/text-track.test.ts b/packages/text-track/test/text-track.test.tsindex 455e82d9..bc6a8de2 100644--- a/packages/text-track/test/text-track.test.ts+++ b/packages/text-track/test/text-track.test.ts@@ -57,7 +57,6 @@ test("persistent and timed text are ordinary Presents in one VisualTrack", () =>assert.doesNotThrow(() => assertTextTrackProgramIdentity(program, space));const track = renderTextTrack(space, program);assert.deepEqual(track.presents.map((present) => present.id), ["watermark", "callout"]);- assert.equal(track.sources[0]?.digest, program.digest);assert.equal(track.presents[0]?.span.endFrameExclusive, 150);assert.equal(track.presents[1]?.span.endFrameExclusive, 90);@@ -66,7 +65,6 @@ test("persistent and timed text are ordinary Presents in one VisualTrack", () =>visualIr: "svml.hyperframes-visual-ir@1",id: "lower",programSpaceDigest: space.digest,- sources: [{ name: "fixture", digest: digestOf("lower") }],presents: [{id: "lower",span: { startFrame: 0, endFrameExclusive: 150 },diff --git a/packages/text/test/text.test.ts b/packages/text/test/text.test.tsindex 288633c0..6ffcb2ff 100644--- a/packages/text/test/text.test.ts+++ b/packages/text/test/text.test.ts@@ -51,9 +51,11 @@ test("Text learns <script> only from an imported Script Manifest", async () => {scriptContext(),);- assert.equal(result.module.records.length, 1);+ assert.equal(result.module.records.length, 2);assert.equal(result.module.records[0]?.id, "story");assert.equal(result.module.records[0]?.type.name, "Narrative");+ assert.equal(result.module.records[1]?.id, "story.segment.opening");+ assert.equal(result.module.records[1]?.type.name, "NarrativeExcerpt");assert.equal(result.sourceMaps.length, 1);assert.doesNotThrow(() => link(scriptContext().closure, [result.module]));});@@ -83,6 +85,7 @@ test("the same Script meaning has the same authored Record digest across reflow");assert.equal(compact.module.records[0]?.digest, multiline.module.records[0]?.digest);+ assert.equal(compact.module.records[1]?.digest, multiline.module.records[1]?.digest);assert.notEqual(compact.module.records[0]?.origin.kind === "authored" ? compact.module.records[0].origin.sourceDigest : undefined,multiline.module.records[0]?.origin.kind === "authored" ? multiline.module.records[0].origin.sourceDigest : undefined,diff --git a/packages/whisperx/src/evidence.ts b/packages/whisperx/src/evidence.tsindex 3192c83a..89298de4 100644--- a/packages/whisperx/src/evidence.ts+++ b/packages/whisperx/src/evidence.ts@@ -18,11 +18,7 @@ export function whisperXRequestForEvidenceAudio(assertSpeechEvidenceAudioIdentity(basis);return {contract: "svml.whisperx-alignment-request@2",- basisDigest: basis.basisDigest,- narrativeDigest: basis.narrativeDigest,programSpaceDigest: basis.programSpaceDigest,- sourceAudioArtifactDigest: basis.sourceAudioArtifactDigest,- evidenceAudioDigest: basis.evidenceAudioDigest,audio: basis.artifact,sampleFrames: basis.sampleFrames,durationSec: basis.durationSec,@@ -48,7 +44,6 @@ export function normalizeWhisperXAlignment(}const {alignmentDigest: _alignmentDigest,- evidenceAudioDigest: _evidenceAudioDigest,engine: _engine,contract: _contract,...shareddiff --git a/packages/whisperx/src/manifest.ts b/packages/whisperx/src/manifest.tsindex 0207a64c..1b43b090 100644--- a/packages/whisperx/src/manifest.ts+++ b/packages/whisperx/src/manifest.ts@@ -29,7 +29,6 @@ export const whisperXAlignmentEvidenceSchema: ValueSchema = {fields: {contract: { schema: { kind: "literal", value: "svml.whisperx-alignment-evidence@2" } },engine: { schema: { kind: "literal", value: "whisperx" } },- evidenceAudioDigest: { schema: { kind: "string", minLength: 71, maxLength: 71 } },...sharedEvidenceFields,alignmentDigest: { schema: { kind: "string", minLength: 71, maxLength: 71 } },},@@ -59,9 +58,7 @@ export const whisperXManifest: ModuleManifest = {capability: whisperXCapabilities.alignment,returns: whisperXTypes.alignmentEvidence,affinity: [- { resultPointer: "/basisDigest", input: "audio", inputPointer: "/basisDigest" },- { resultPointer: "/audioArtifactDigest", input: "audio", inputPointer: "/sourceAudioArtifactDigest" },- { resultPointer: "/evidenceAudioDigest", input: "audio", inputPointer: "/evidenceAudioDigest" },+ { resultPointer: "/audioArtifactDigest", input: "audio", inputPointer: "/artifact/digest" },{ resultPointer: "/programSpaceDigest", input: "audio", inputPointer: "/programSpaceDigest" },],}],@@ -78,7 +75,6 @@ export const whisperXManifest: ModuleManifest = {name: "evidence",type: contractTypes.alignedTranscriptEvidence,affinity: [- { resultPointer: "/basisDigest", input: "whisperx", inputPointer: "/basisDigest" },{ resultPointer: "/audioArtifactDigest", input: "whisperx", inputPointer: "/audioArtifactDigest" },{ resultPointer: "/programSpaceDigest", input: "whisperx", inputPointer: "/programSpaceDigest" },],diff --git a/packages/whisperx/src/types.ts b/packages/whisperx/src/types.tsindex e3a4fe55..fdd6657a 100644--- a/packages/whisperx/src/types.ts+++ b/packages/whisperx/src/types.ts@@ -8,11 +8,7 @@ import type { Digest } from "@svml/protocol";export type WhisperXAlignmentRequest = {readonly contract: "svml.whisperx-alignment-request@2";- readonly basisDigest: Digest;- readonly narrativeDigest: Digest;readonly programSpaceDigest: Digest;- readonly sourceAudioArtifactDigest: Digest;- readonly evidenceAudioDigest: Digest;readonly audio: SpeechEvidenceAudio["artifact"];readonly sampleFrames: number;readonly durationSec: number;@@ -25,11 +21,9 @@ export type WhisperXAlignmentRequest = {export type WhisperXAlignmentEvidence = {readonly contract: "svml.whisperx-alignment-evidence@2";readonly engine: "whisperx";- readonly basisDigest: Digest;+ /** Exact acoustic Artifact measured by WhisperX. */readonly audioArtifactDigest: Digest;- readonly evidenceAudioDigest: Digest;readonly programSpaceDigest: Digest;- readonly rawEvidenceArtifactDigest: Digest;readonly durationSec: number;readonly segments: readonly AlignedTranscriptSegment[];readonly alignmentDigest: Digest;diff --git a/packages/whisperx/test/whisperx.test.ts b/packages/whisperx/test/whisperx.test.tsindex b84a977b..94ba7a6f 100644--- a/packages/whisperx/test/whisperx.test.ts+++ b/packages/whisperx/test/whisperx.test.ts@@ -26,7 +26,6 @@ function basis() {const visual = digestOf("whisperx-test:visual");return sealSpeechBasis({contract: "svml.speech-basis@1",- narrativeDigest: digestOf("whisperx-test:narrative"),programSpace,audio: { digest: digestOf("whisperx-test:audio"), size: 1, mediaType: "audio/wav", durationSec: 1 },visualTrack: { clips: [{@@ -35,15 +34,13 @@ function basis() {startSec: 0,endSec: 1,}] },- segments: [{ segmentId: "line", startSec: 0, endSec: 1, sourceArtifactDigest: visual }],+ segments: [{ segmentId: "line", startSec: 0, endSec: 1 }],});}function evidenceAudio(basis: SpeechBasis): SpeechEvidenceAudio {return sealSpeechEvidenceAudio({contract: "svml.speech-evidence-audio@1",- basisDigest: basis.basisDigest,- narrativeDigest: basis.narrativeDigest,programSpaceDigest: basis.programSpace.digest,sourceAudioArtifactDigest: basis.audio.digest,artifact: {@@ -73,7 +70,7 @@ function evidenceAudio(basis: SpeechBasis): SpeechEvidenceAudio {test("WhisperX consumes only the canonical 16 kHz evidence projection", () => {const valid = evidenceAudio(basis());- assert.equal(whisperXRequestForEvidenceAudio(valid).basisDigest, valid.basisDigest);+ assert.equal(whisperXRequestForEvidenceAudio(valid).audio.digest, valid.artifact.digest);const tampered = { ...valid, sampleFrames: 16_001 };assert.throws(() => whisperXRequestForEvidenceAudio(tampered), /sample map|digest/u);});@@ -83,11 +80,8 @@ test("WhisperX normalization verifies its model-specific result before loweringconst measured = sealWhisperXAlignmentEvidence({contract: "svml.whisperx-alignment-evidence@2",engine: "whisperx",- basisDigest: source.basisDigest,- audioArtifactDigest: source.audio.digest,- evidenceAudioDigest: evidenceAudio(source).evidenceAudioDigest,+ audioArtifactDigest: evidenceAudio(source).artifact.digest,programSpaceDigest: source.programSpace.digest,- rawEvidenceArtifactDigest: digestOf("whisperx-test:raw"),durationSec: 1,segments: [{sourceSegmentId: "line",@@ -99,7 +93,7 @@ test("WhisperX normalization verifies its model-specific result before lowering});const normalized = normalizeWhisperXAlignment(measured);assert.equal(normalized.contract, "svml.aligned-transcript-evidence@1");- assert.equal(normalized.basisDigest, source.basisDigest);+ assert.equal(normalized.audioArtifactDigest, evidenceAudio(source).artifact.digest);assert.throws(() => normalizeWhisperXAlignment({...measured,diff --git a/pnpm-lock.yaml b/pnpm-lock.yamlindex 69ee8ff0..3003d89a 100644--- a/pnpm-lock.yaml+++ b/pnpm-lock.yaml@@ -268,6 +268,9 @@ importers:'@svml/component-kit':specifier: workspace:*version: link:../component-kit+ '@svml/contracts':+ specifier: workspace:*+ version: link:../contracts'@svml/protocol':specifier: workspace:*version: link:../protocol@@ -401,6 +404,15 @@ importers:specifier: workspace:*version: link:../core+ packages/media:+ dependencies:+ '@svml/contracts':+ specifier: workspace:*+ version: link:../contracts+ '@svml/text':+ specifier: workspace:*+ version: link:../text+packages/media-pipeline:dependencies:'@svml/component-kit':@@ -497,18 +509,27 @@ importers:'@svml/film':specifier: workspace:*version: link:../film+ '@svml/generation':+ specifier: workspace:*+ version: link:../generation'@svml/hyperframes':specifier: workspace:*version: link:../hyperframes'@svml/hyperframes-render':specifier: workspace:*version: link:../hyperframes-render+ '@svml/media':+ specifier: workspace:*+ version: link:../media'@svml/media-pipeline':specifier: workspace:*version: link:../media-pipeline'@svml/script':specifier: workspace:*version: link:../script+ '@svml/seedance':+ specifier: workspace:*+ version: link:../seedance'@svml/speech-align':specifier: workspace:*version: link:../speech-align@@ -595,6 +616,9 @@ importers:'@svml/component-kit':specifier: workspace:*version: link:../component-kit+ '@svml/contracts':+ specifier: workspace:*+ version: link:../contracts'@svml/core':specifier: workspace:*version: link:../core@@ -703,6 +727,12 @@ importers:packages/seedance:dependencies:+ '@svml/contracts':+ specifier: workspace:*+ version: link:../contracts+ '@svml/elaborator':+ specifier: workspace:*+ version: link:../elaborator'@svml/generation':specifier: workspace:*version: link:../generation@@ -712,6 +742,9 @@ importers:'@svml/protocol':specifier: workspace:*version: link:../protocol+ '@svml/text':+ specifier: workspace:*+ version: link:../textpackages/seedream:dependencies:diff --git a/spec/core-kernel-v1.md b/spec/core-kernel-v1.mdindex 9bfa8da0..278415ae 100644--- a/spec/core-kernel-v1.md+++ b/spec/core-kernel-v1.md@@ -53,6 +53,9 @@ external Candidates. None of those reference packages is required by this Kernel12. A BuildPlan is a deterministic, finite derivative of the verified Graph and BuildRequest. ADriver may schedule ready Commands, but cannot redefine Candidate selection or Demand.13. A Build completes only when every Target's selected result exists with an accepted conformance.+14. The Graph is the only dependency truth. A domain Record contains only facts needed to interpret+ that value; Derivation and Receipt contain lineage. Core affinity may compare intrinsic facts on+ directly connected values, but must not require values to copy transitive ancestry.## Boundary@@ -71,3 +74,6 @@ authenticity of arbitrary plugin code. Sandboxing and attestation are Runtime coNeither a package suffix nor a TypeScript class grants Kernel privilege. A domain package can bereleased after Core and participate through manifests, schemas and ordinary Operations without aCore release.++SVML source is one optional author-facing notation that lowers to this graph. The Kernel has no+canonical pipeline direction, privileged terminal output, Film root or single-output Build rule.diff --git a/spec/script-surface-v1.md b/spec/script-surface-v1.mdindex b6f03047..f43a465b 100644--- a/spec/script-surface-v1.md+++ b/spec/script-surface-v1.md@@ -337,7 +337,7 @@ Segment 仍有独立 start/end,即使二者最终重合;任意不同 identitLocator 必须提交覆盖全部 `2M + 2N` identity 的总映射:```text-SemanticAnchorIdentity → ProgramPoint(basisDigest)+SemanticAnchorIdentity → ProgramPoint(ProgramSpace)```完整性与精度正交:每个点都必须存在,同时可以标记为 `estimated`、`derived`diff --git a/spec/track-composition-v1.md b/spec/track-composition-v1.mdindex 652e581d..00f1ad18 100644--- a/spec/track-composition-v1.md+++ b/spec/track-composition-v1.md@@ -29,21 +29,20 @@ duration or becomes a privileged Base.## VisualTrack-A VisualTrack is an author-package ownership and provenance boundary. It explicitly binds the+A VisualTrack is one self-contained render contribution owned by an author package. It explicitly binds the[`svml.hyperframes-visual-ir@1`](./hyperframes-visual-ir-v1.md) terminal language and owns zero ormore frame-exact `VisualPresent` values; every Present owns its own absolute `(order, tieBreak)`stacking key and one self-contained, code-free element tree made from box, text, ordinary media andtyped compositable-Surface primitives. Parent references are Present-local. Media and exact fontfaces enter through content-addressed Artifact references rather than CSS URLs or environment fontnames.-Every Track also carries named semantic source digests. Producer affinity declarations bind those-generic commitments to upstream facts without adding Caption, Speech or B-roll fields to the Track-contract.+Its ProgramSpace identity is intrinsic because the Track cannot be interpreted without a clock.+Which Records produced it is Graph/Derivation truth and is deliberately absent from the Track.Composition flattens Presents across every Track before ordering them. One B-roll package maytherefore own a board at z=30 and an icon at z=80 while a Text Present from another Track sits atz=50. A z change over time is represented by two non-overlapping Presents with different stacking-keys. Track ownership never creates a render stacking context.+keys. Track ownership never creates a render stacking context or a provenance chain.Every element may optionally carry frame-exact local keyframes over opacity, transform, filter orclip-path. Those keyframes operate only on that Present's element tree. A B-roll package may lower adiff --git a/spec/track-expressiveness-v1.md b/spec/track-expressiveness-v1.mdindex 1738662c..61163d8d 100644--- a/spec/track-expressiveness-v1.md+++ b/spec/track-expressiveness-v1.md@@ -71,8 +71,9 @@ dependency collection must deduplicate the shared content digest.### E4 — Independent absolute stackingOne package may emit a board at one absolute stack position and icons or labels at other positions.-A Present from another Track must be able to appear between them. Track identity is ownership and-provenance, never a render stacking context.+A Present from another Track must be able to appear between them. Track identity groups one+self-contained render contribution; provenance lives in the Graph/Derivation and Track never forms+a render stacking context.### E5 — Local motion and handoffdiff --git a/tsconfig.v2.json b/tsconfig.v2.jsonindex 10d98f70..6d2121ea 100644--- a/tsconfig.v2.json+++ b/tsconfig.v2.json@@ -10,6 +10,7 @@"@svml/component-kit": ["packages/component-kit/src/index.ts"],"@svml/endpoint-kit": ["packages/endpoint-kit/src/index.ts"],"@svml/contracts": ["packages/contracts/src/index.ts"],+ "@svml/media": ["packages/media/src/index.ts"],"@svml/driver-node": ["packages/driver-node/src/index.ts"],"@svml/script": ["packages/script/src/index.ts"],"@svml/text": ["packages/text/src/index.ts"],