Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Python asraudiochineseemotion-recognitionfunasrmcp-servermultilingual-asropenai-compatible-apiparaformerpunctuationpytorchreal-time-asrspeaker-diarizationspeech-recognitionspeech-to-textstreaming-asrtranscriptionvllmvoice-activity-detectionwhisper-alternative
docs: add ERes2NetV2, Qwen3-ASR, GLM-ASR usage to tutorial
游雁a4a28fea60bd
diff --git a/docs/tutorial/README.md b/docs/tutorial/README.mdindex 3a3886e55..5588755b0 100644--- a/docs/tutorial/README.md+++ b/docs/tutorial/README.md@@ -189,6 +189,83 @@ print(res)More examples ref to [docs](https://github.com/alibaba-damo-academy/FunASR/tree/main/examples/industrial_data_pretraining)+#### Speaker Verification / Diarization (ERes2NetV2)+```python+from funasr import AutoModel++# Standalone speaker embedding extraction+model = AutoModel(model="iic/speech_eres2netv2_sv_zh-cn_16k-common", device="cuda:0")+res = model.generate(input="audio.wav")+embedding = res[0]["spk_embedding"] # shape: [1, 192]+```++```python+from funasr import AutoModel++# ASR with speaker diarization+model = AutoModel(+ model="paraformer-zh",+ vad_model="fsmn-vad",+ vad_kwargs={"max_single_segment_time": 60000},+ punc_model="ct-punc",+ spk_model="iic/speech_eres2netv2_sv_zh-cn_16k-common",+ device="cuda:0",+)+res = model.generate(input="meeting.wav", batch_size_s=300)+for sentence in res:+ print(f"[Speaker {sentence['spk']}] {sentence['text']}")+```+Notes: `spk_model` can also be `"cam++"` (CAM++ model). ERes2NetV2 provides improved short-duration speaker feature extraction.++#### Multi-language ASR (Qwen3-ASR)+```python+from funasr import AutoModel++# Qwen3-ASR supports 52 languages with auto language detection+# hub="hf" for HuggingFace, default hub="ms" for ModelScope+model = AutoModel(model="Qwen/Qwen3-ASR-1.7B", hub="hf", device="cuda:0")++# With forced language+res = model.generate(input="audio_zh.wav", language="Chinese")+print(res[0]["text"])++# Auto language detection+res = model.generate(input="audio.wav")+print(res[0]["text"], res[0].get("language", ""))+```+Notes: Requires `pip install qwen-asr`. Supports 0.6B and 1.7B model sizes.++#### Multi-language ASR (GLM-ASR)+```python+from funasr import AutoModel++# GLM-ASR-Nano supports 17 languages, optimized for dialects and low-volume speech+# hub="hf" for HuggingFace, default hub="ms" for ModelScope+model = AutoModel(model="zai-org/GLM-ASR-Nano-2512", hub="hf", device="cuda:0")+res = model.generate(input="audio.wav")+print(res[0]["text"])++# ModelScope (Chinese users)+model = AutoModel(model="ZhipuAI/GLM-ASR-Nano-2512", hub="ms", device="cuda:0")+```+Notes: Requires `transformers>=5.0.0` (install from source: `pip install git+https://github.com/huggingface/transformers`).++++#### Speaker Verification / Diarization (ERes2NetV2)++++Notes: can also be (CAM++ model). ERes2NetV2 provides improved short-duration speaker feature extraction.++#### Multi-language ASR (Qwen3-ASR)++Notes: Requires . Supports 0.6B and 1.7B model sizes.++#### Multi-language ASR (GLM-ASR)++Notes: Requires (install from source: ).+<a name="Training"></a>## Model Training and Testingdiff --git a/docs/tutorial/README_zh.md b/docs/tutorial/README_zh.mdindex 8960fd086..7e0ad8f9e 100644--- a/docs/tutorial/README_zh.md+++ b/docs/tutorial/README_zh.md@@ -191,6 +191,69 @@ print(res)```更多([示例](https://github.com/alibaba-damo-academy/FunASR/tree/main/examples/industrial_data_pretraining))+#### 说话人确认/分割 (ERes2NetV2)+```python+from funasr import AutoModel++# 单独提取说话人 embedding+model = AutoModel(model="iic/speech_eres2netv2_sv_zh-cn_16k-common", device="cuda:0")+res = model.generate(input="audio.wav")+embedding = res[0]["spk_embedding"] # shape: [1, 192]+```++```python+from funasr import AutoModel++# ASR + 说话人分割+model = AutoModel(+ model="paraformer-zh",+ vad_model="fsmn-vad",+ vad_kwargs={"max_single_segment_time": 60000},+ punc_model="ct-punc",+ spk_model="iic/speech_eres2netv2_sv_zh-cn_16k-common",+ device="cuda:0",+)+res = model.generate(input="meeting.wav", batch_size_s=300)+for sentence in res:+ print(f"[说话人 {sentence['spk']}] {sentence['text']}")+```+注:`spk_model` 也可以使用 `"cam++"` (CAM++ 模型)。ERes2NetV2 在短时说话人特征提取方面有所改进。++#### 多语言语音识别 (Qwen3-ASR)+```python+from funasr import AutoModel++# Qwen3-ASR 支持52种语言自动语言检测+# hub="hf" 从 HuggingFace 下载,默认 hub="ms" 从 ModelScope 下载+model = AutoModel(model="Qwen/Qwen3-ASR-1.7B", hub="hf", device="cuda:0")++# 指定语言+res = model.generate(input="audio_zh.wav", language="Chinese")+print(res[0]["text"])++# 自动语言检测+res = model.generate(input="audio.wav")+print(res[0]["text"], res[0].get("language", ""))+```+注:需要安装 `pip install qwen-asr`。支持 0.6B 和 1.7B 两种模型规格。++#### 多语言语音识别 (GLM-ASR)+```python+from funasr import AutoModel++# GLM-ASR-Nano 支持17种语言,方言及低音量语音优化+# hub="hf" 从 HuggingFace 下载,默认 hub="ms" 从 ModelScope 下载+model = AutoModel(model="zai-org/GLM-ASR-Nano-2512", hub="hf", device="cuda:0")+res = model.generate(input="audio.wav")+print(res[0]["text"])++# ModelScope(国内用户)+model = AutoModel(model="ZhipuAI/GLM-ASR-Nano-2512", hub="ms", device="cuda:0")+```+注:需要 `transformers>=5.0.0`(从源码安装:`pip install git+https://github.com/huggingface/transformers`)。+++<a name="核心功能"></a>## 模型训练与测试