Skip to content

World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

dashscope: add Layer 3 skill documentation

Yiyabof5cbe1011fff
diff --git a/.agents/skills/dashscope/SKILL.md b/.agents/skills/dashscope/SKILL.md
new file mode 100644
index 00000000..ccffbe6f
--- /dev/null
+++ b/.agents/skills/dashscope/SKILL.md
@@ -0,0 +1,136 @@
+---
+name: dashscope
+description: DashScope (Alibaba Cloud Bailian / 阿里云百炼) integration — image generation (qwen-image-2.0-pro), text-to-speech (qwen3-tts-flash), and ASR with word-level timestamps (qwen3-asr-flash-filetrans). Use when generating images via Qwen-Image, narrating via Qwen-TTS, or transcribing with word-level timestamps via Qwen-ASR.
+---
+
+# DashScope
+
+Requires `DASHSCOPE_API_KEY` in `.env`. Get one at https://dashscope.aliyun.com/.
+
+## Current API
+
+**CRITICAL:** DashScope's `/compatible-mode/v1/` only supports `/chat/completions` and `/embeddings`. Image generation, TTS, and ASR all use **DashScope-native endpoints** — not OpenAI-compatible paths.
+
+All three tools use `Authorization: Bearer $DASHSCOPE_API_KEY`.
+
+### Image Generation
+
+```text
+POST https://dashscope.aliyuncs.com/api/v1/services/aigc/multimodal-generation/generation
+```
+
+- Model: `qwen-image-2.0-pro` (default), `qwen-image-max`, `wan2.7-image`, `z-image-turbo`
+- Body: `{model, input: {messages: [{role: "user", content: [{text: "prompt"}]}]}, parameters: {size: "W*H", n, prompt_extend, watermark}}`
+- **Size format uses asterisk:** `"1024*1024"` not `"1024x1024"`
+- Response: `output.choices[0].message.content[0].image` (URL, valid ~24h) — must download separately
+
+### Text-to-Speech
+
+```text
+POST https://dashscope.aliyuncs.com/api/v1/services/aigc/multimodal-generation/generation
+```
+
+Same endpoint as image gen, different body.
+
+- Model: `qwen3-tts-flash` (default), `qwen3-tts-instruct-flash`, `qwen-tts-2025-05-22`
+- Body: `{model, input: {text, voice: "Cherry", language_type: "Auto"}}`
+- Response: `output.audio.url` (WAV, valid ~24h) — must download separately
+
+### ASR with Word-Level Timestamps
+
+```text
+POST https://dashscope.aliyuncs.com/api/v1/services/audio/asr/transcription
+Header: X-DashScope-Async: enable
+```
+
+- Model: `qwen3-asr-flash-filetrans` (NOT `qwen3-asr-flash` — the sync version has no word timestamps)
+- Body: `{model, input: {file_url: "https://public-url/audio.mp3"}, parameters: {enable_words: true, language_hints: ["zh","en"]}}`
+- Returns `task_id` → poll `GET /api/v1/tasks/{task_id}` until `SUCCEEDED` → download `output.result.transcription_url` → JSON with `transcripts[].sentences[].words[]`
+- Timestamps in `begin_time`/`end_time` are in **milliseconds** — the tool normalizes to seconds
+
+## OpenMontage Usage
+
+### Image via selector
+
+```python
+from tools.graphics.image_selector import ImageSelector
+
+result = ImageSelector().execute({
+ "preferred_provider": "dashscope",
+ "prompt": "一只猫坐在沙发上",
+ "output_path": "projects/my-video/assets/images/cat.png",
+})
+```
+
+### TTS via selector
+
+```python
+from tools.audio.tts_selector import TTSSelector
+
+result = TTSSelector().execute({
+ "preferred_provider": "dashscope",
+ "text": "如果 AI 真的会改变未来,普通人到底该怎么参与?",
+ "voice": "Cherry",
+ "output_path": "projects/my-video/assets/audio/narration.wav",
+})
+```
+
+### ASR directly (word timestamps for subtitles)
+
+```python
+from tools.analysis.dashscope_asr import DashscopeAsr
+
+result = DashscopeAsr().execute({
+ "audio_url": "https://example.com/narration.wav",
+ "output_path": "projects/my-video/assets/audio/transcription.json",
+})
+
+# result.data["words"] is a flat list of {text, begin_time_seconds, end_time_seconds}
+```
+
+## Recommended Workflow
+
+1. **Image:** Generate a sample first. Check `prompt_extend: true` (default) — DashScope rewrites your prompt for better results. Disable if you need literal prompt adherence.
+2. **TTS:** Generate a 10-15 second sample before full narration. Approve voice and pacing before committing to full generation.
+3. **ASR:** Audio must be at a **publicly accessible URL**. Upload to any public host (S3, etc.) first. Local paths are rejected with a clear error.
+4. **Subtitles:** Build from `result.data["words"]` — each word has `begin_time_seconds` and `end_time_seconds`. Group words into caption phrases by language semantics, not fixed character count.
+
+## Parameters
+
+### Image (`dashscope_image`)
+- `prompt` (required): text prompt
+- `model`: default `qwen-image-2.0-pro`
+- `size`: default `"1024*1024"` — **asterisk separator, not "x"**
+- `n`: 1-6 images
+- `negative_prompt`: things to avoid (max 500 chars)
+- `prompt_extend`: default `true` — auto-rewrite prompt for better results
+- `watermark`: default `false`
+- `seed`: for reproducibility
+
+### TTS (`dashscope_tts`)
+- `text` (required): text to synthesize (max 600 chars for qwen3-tts-flash)
+- `model`: default `qwen3-tts-flash`
+- `voice`: default `"Cherry"` — other voices: `"Ethan"`, `"Chelsie"`, etc.
+- `language_type`: default `"Auto"` — `"Chinese"`, `"English"`, `"Japanese"`, `"Korean"`
+- `instructions`: natural language delivery instructions (only for `qwen3-tts-instruct-flash`)
+
+### ASR (`dashscope_asr`)
+- `audio_url` (required): **must be publicly accessible URL**
+- `model`: `qwen3-asr-flash-filetrans` (only model that supports word timestamps)
+- `language_hints`: default `["zh", "en"]`
+- `enable_words`: default `true` — required for word-level timestamps
+- `poll_interval_seconds`: default `5.0`
+- `timeout_seconds`: default `300`
+
+## Troubleshooting
+
+- **Image size error:** Use `"W*H"` with asterisk, not `"WxH"`. Example: `"2048*2048"`.
+- **TTS no audio URL:** Check `output.audio.url` — if empty, the model name or voice may be wrong.
+- **ASR "file not accessible":** `audio_url` must be publicly reachable. DashScope servers fetch the file; local paths and auth-gated URLs don't work.
+- **ASR poll timeout:** Increase `timeout_seconds` (default 300). Long audio files take longer to transcribe.
+- **ASR no word timestamps:** Ensure `enable_words: true` and model is `qwen3-asr-flash-filetrans` (not the sync `qwen3-asr-flash`).
+- **Auth error (401):** Verify `DASHSCOPE_API_KEY` is set. Use `Authorization: Bearer $KEY` header.
+
+## Safety
+
+Never print or write the API key to logs, metadata, patches, or project artifacts. `.env.example` should contain only empty variable names. The tool's `_safe_error()` method redacts the key from error messages.