Skip to content

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

docs: feature OpenMAIC local FunASR integration

LauraGPTfa2bb1c28e3f
diff --git a/docs/community_projects.md b/docs/community_projects.md
index 54c150ed7..45ee4aeae 100644
--- a/docs/community_projects.md
+++ b/docs/community_projects.md
@@ -40,6 +40,7 @@ These integrations are community-maintained. Their release cadence, hardware sup
|---|---|---|
| [Xinference](https://github.com/xorbitsai/inference) | Built-in audio model specifications for SenseVoiceSmall, Fun-ASR-Nano-2512, and Fun-ASR-MLT-Nano-2512 through Xinference's unified inference API. | [Audio model specifications](https://github.com/xorbitsai/inference/blob/main/xinference/model/audio/model_spec.json) and the FunASR 1.3 compatibility update in merged [#5140](https://github.com/xorbitsai/inference/pull/5140). |
| [MLX Audio](https://github.com/Blaizzy/mlx-audio) | Apple Silicon-native Fun-ASR-Nano conversion and transcription through Python, CLI, and the OpenAI-compatible `POST /v1/audio/transcriptions` endpoint, including language hints and hotwords/context. The current public checkpoint path is transcription-only: it emits no timestamps, and VAD or diarization must run separately. | [Fun-ASR-Nano model guide](https://github.com/Blaizzy/mlx-audio/blob/main/docs/models/stt/fun-asr-nano.md), [server guide](https://github.com/Blaizzy/mlx-audio/blob/main/docs/guides/web-ui-api-server.md), and merged hotword support [#885](https://github.com/Blaizzy/mlx-audio/pull/885). |
+| [OpenMAIC](https://github.com/THU-MAIC/OpenMAIC) | A multi-agent interactive classroom with a built-in local FunASR provider. It sends WAV audio to the OpenAI-compatible transcription endpoint, requires no API key, and exposes SenseVoiceSmall, Paraformer, and Fun-ASR-Nano through its model selector. | [FunASR local ASR setup](https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr), configure `ASR_FUNASR_BASE_URL`, and see merged provider [#1044](https://github.com/THU-MAIC/OpenMAIC/pull/1044). |
| [Optimum Intel](https://github.com/huggingface/optimum-intel) | OpenVINO export and inference support for Fun-ASR models through Hugging Face Optimum Intel, including FunASR-specific modeling and ASR/export/quantization coverage. | [FunASR OpenVINO modeling](https://github.com/huggingface/optimum-intel/blob/main/optimum/intel/openvino/modeling_funasr.py), [supported models docs](https://github.com/huggingface/optimum-intel/blob/main/docs/source/openvino/models.mdx), and merged [#1801](https://github.com/huggingface/optimum-intel/pull/1801). |
| [OpenVINO Notebooks](https://github.com/openvinotoolkit/openvino_notebooks) | Official OpenVINO tutorial material for FunASR-Nano, including helper code and NPU device fixes for running the notebook on Intel acceleration paths. | [FunASR-Nano notebook](https://github.com/openvinotoolkit/openvino_notebooks/tree/latest/notebooks/funasr-nano), [OpenVINO FunASR helper](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/funasr-nano/ov_funasr_helper.py), merged [#3497](https://github.com/openvinotoolkit/openvino_notebooks/pull/3497), and NPU fix [#3517](https://github.com/openvinotoolkit/openvino_notebooks/pull/3517). |
| [SGLang Omni](https://github.com/sgl-project/sglang-omni) | A multi-stage pipeline runtime for omni models with built-in Fun-ASR model support, OpenAI-compatible serving, cookbook docs, benchmark tasks, and formatted stream-output tests. | [Fun-ASR cookbook](https://github.com/sgl-project/sglang-omni/blob/main/docs/cookbook/fun_asr.md), [Fun-ASR model runtime](https://github.com/sgl-project/sglang-omni/tree/main/sglang_omni/models/fun_asr), merged [#1078](https://github.com/sgl-project/sglang-omni/pull/1078), and merged review-fix [#1079](https://github.com/sgl-project/sglang-omni/pull/1079). |
diff --git a/docs/community_projects_zh.md b/docs/community_projects_zh.md
index 75356d408..cdf8d24e1 100644
--- a/docs/community_projects_zh.md
+++ b/docs/community_projects_zh.md
@@ -40,6 +40,7 @@
|---|---|---|
| [Xinference](https://github.com/xorbitsai/inference) | 通过 Xinference 统一推理 API 提供 SenseVoiceSmall、Fun-ASR-Nano-2512 和 Fun-ASR-MLT-Nano-2512 内置音频模型规格。 | [音频模型规格](https://github.com/xorbitsai/inference/blob/main/xinference/model/audio/model_spec.json) 和已合并 [#5140](https://github.com/xorbitsai/inference/pull/5140) 中的 FunASR 1.3 兼容性更新。 |
| [MLX Audio](https://github.com/Blaizzy/mlx-audio) | 面向 Apple Silicon 的原生 MLX Fun-ASR-Nano 转换与转写路径,覆盖 Python、CLI 和 OpenAI 兼容的 `POST /v1/audio/transcriptions`,支持语种提示与 hotwords/context。当前公开 checkpoint 路径仅转写、无时间戳;VAD 与说话人分离需要在外部完成。 | [Fun-ASR-Nano 模型指南](https://github.com/Blaizzy/mlx-audio/blob/main/docs/models/stt/fun-asr-nano.md)、[服务端指南](https://github.com/Blaizzy/mlx-audio/blob/main/docs/guides/web-ui-api-server.md) 和 hotword 支持已合并 [#885](https://github.com/Blaizzy/mlx-audio/pull/885)。 |
+| [OpenMAIC](https://github.com/THU-MAIC/OpenMAIC) | 多智能体互动课堂,已内置本地 FunASR provider。它把 WAV 音频发送到 OpenAI 兼容转写端点,无需 API Key,并可在模型选择器中使用 SenseVoiceSmall、Paraformer 和 Fun-ASR-Nano。 | [FunASR 本地 ASR 配置](https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr),设置 `ASR_FUNASR_BASE_URL`,并参见已合并 provider [#1044](https://github.com/THU-MAIC/OpenMAIC/pull/1044)。 |
| [Optimum Intel](https://github.com/huggingface/optimum-intel) | 通过 Hugging Face Optimum Intel 支持 Fun-ASR 模型的 OpenVINO 导出与推理,包括 FunASR 专用 modeling 代码以及 ASR、export、quantization 覆盖。 | [FunASR OpenVINO modeling](https://github.com/huggingface/optimum-intel/blob/main/optimum/intel/openvino/modeling_funasr.py)、[支持模型文档](https://github.com/huggingface/optimum-intel/blob/main/docs/source/openvino/models.mdx) 和已合并 [#1801](https://github.com/huggingface/optimum-intel/pull/1801)。 |
| [OpenVINO Notebooks](https://github.com/openvinotoolkit/openvino_notebooks) | OpenVINO 官方 FunASR-Nano 教程资料,包含 helper 代码和 NPU device 修复,方便用户在 Intel 加速路径上运行 notebook。 | [FunASR-Nano notebook](https://github.com/openvinotoolkit/openvino_notebooks/tree/latest/notebooks/funasr-nano)、[OpenVINO FunASR helper](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/funasr-nano/ov_funasr_helper.py)、已合并 [#3497](https://github.com/openvinotoolkit/openvino_notebooks/pull/3497) 和 NPU 修复 [#3517](https://github.com/openvinotoolkit/openvino_notebooks/pull/3517)。 |
| [SGLang Omni](https://github.com/sgl-project/sglang-omni) | 面向 omni models 的 multi-stage pipeline runtime,已内置 Fun-ASR 模型支持、OpenAI 兼容服务、cookbook 文档、benchmark 任务和格式化后的 stream-output 测试。 | [Fun-ASR cookbook](https://github.com/sgl-project/sglang-omni/blob/main/docs/cookbook/fun_asr.md)、[Fun-ASR 模型 runtime](https://github.com/sgl-project/sglang-omni/tree/main/sglang_omni/models/fun_asr)、已合并 [#1078](https://github.com/sgl-project/sglang-omni/pull/1078) 和 review-fix 已合并 [#1079](https://github.com/sgl-project/sglang-omni/pull/1079)。 |
diff --git a/web-pages/product-site/content/legacy-manifest.json b/web-pages/product-site/content/legacy-manifest.json
index 8a9254718..785c3646e 100644
--- a/web-pages/product-site/content/legacy-manifest.json
+++ b/web-pages/product-site/content/legacy-manifest.json
@@ -39,7 +39,7 @@
"css/index.1682178c.css": "b5f6034ce886c25773928c114e4290d1c491a3d081677b488810198efd76b4e1",
"decoder.js": "f2023a28036b1ff58e5bdabbb72ea427f8faaf60e89acd78ff183c313bdb0a2c",
"donors.html": "eec6b789b29c27d372925ae0ad3e13d4c6e62978b3c38c4da9e3aec129f10934",
- "ecosystem.html": "ae547554ccffe30436109c95313250f908826ee4c51494a5856e4f0dd0cc37aa",
+ "ecosystem.html": "e81f4412ea4af6a838320660809f3a24edbf4cf8fb00445b66b81fe6b7efa1a9",
"en/blog/cantonese-speech-recognition.html": "b9bd146198206f781c37f341c370a690dc83cd7163334e34b4e7f65e69af8ff2",
"en/blog/chinese-speech-recognition.html": "16b68bd2a1122236c580c62275002ae2c0875ca14e32686e88d3b5ccfa9f56ef",
"en/blog/fun-asr-nano-guide.html": "1746c708bd0606188de4266d8255984dd9e14634af33c54ad65a5f05b767be1b",
@@ -71,7 +71,7 @@
"en/blog/voice-activity-detection-python.html": "d12f5d0f4ae07c3434f6188d12f5603b8abb9578413b79133668638d1c5e18a7",
"en/blog/which-funasr-model.html": "1207180aa929a3aa51db136c1098f4edc8f07405e2b56fe033998bf996f8ec7f",
"en/donors.html": "eacb7f9434b1b29e13e9b0175bb9680556ee72ab4dbd155e68f9c912eb0212b1",
- "en/ecosystem.html": "9e761043c8e20fa7d876edb4a83592edd1bb4c74e8a88a6bf58cd19d04624965",
+ "en/ecosystem.html": "d6e8ba697f2c5ea972bfa93e803d40456f6f861e08df103444806bf7f728746f",
"en/index.html": "d86effc3bf4d218eabd465cbbe026f62c98dd50110ddd58251d9d271a64882a2",
"en/llama-cpp.html": "dbfbd125ebbf07f7d923c91b122818f8b09484ce54c1e80eba66a89d22dfb5b4",
"en/models.html": "321a63caace107d5ce6d470948c2f5954f2d8e25306d8227b4a85ec3663ad49e",
diff --git a/web-pages/product-site/legacy/ecosystem.html b/web-pages/product-site/legacy/ecosystem.html
index 6af0ac166..348148298 100644
--- a/web-pages/product-site/legacy/ecosystem.html
+++ b/web-pages/product-site/legacy/ecosystem.html
@@ -360,6 +360,12 @@ footer a{color:#60a5fa}
<div><span class="card-tag">Apple Silicon</span><span class="card-tag">Fun-ASR-Nano</span><span class="card-tag">OpenAI 兼容</span></div>
</div>
<div class="card">
+<div class="card-title"><a href="https://github.com/THU-MAIC/OpenMAIC">OpenMAIC</a></div>
+<div class="card-stars">20.7K+ stars</div>
+<div class="card-desc">多智能体互动课堂,已通过 <a href="https://github.com/THU-MAIC/OpenMAIC/pull/1044">#1044</a> 合并原生本地 FunASR provider。按照 <a href="https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr">配置指南</a> 设置 <code>ASR_FUNASR_BASE_URL</code> 后,可把 WAV 音频发送到 OpenAI 兼容转写端点,并在 SenseVoiceSmall、Paraformer 与 Fun-ASR-Nano 之间选择;无需 API Key。服务端能力与部署边界以 <a href="https://github.com/modelscope/FunASR">FunASR 仓库</a> 为准。</div>
+<div><span class="card-tag">Local ASR</span><span class="card-tag">Multi-agent</span><span class="card-tag">OpenAI 兼容</span></div>
+</div>
+<div class="card">
<div class="card-title"><a href="https://github.com/RapidAI/RapidASR">RapidASR</a></div>
<div class="card-stars">608 stars</div>
<div class="card-desc">跨平台 ASR 推理库,基于 ONNX Runtime 和 FunASR。开箱即用,支持中英文混合识别。</div>
diff --git a/web-pages/product-site/legacy/en/ecosystem.html b/web-pages/product-site/legacy/en/ecosystem.html
index 22bcfb4be..d59ab7350 100644
--- a/web-pages/product-site/legacy/en/ecosystem.html
+++ b/web-pages/product-site/legacy/en/ecosystem.html
@@ -361,6 +361,12 @@ footer a{color:#60a5fa}
<div><span class="card-tag">Apple Silicon</span><span class="card-tag">Fun-ASR-Nano</span><span class="card-tag">OpenAI-compat</span></div>
</div>
<div class="card">
+<div class="card-title"><a href="https://github.com/THU-MAIC/OpenMAIC">OpenMAIC</a></div>
+<div class="card-stars">20.7K+ stars</div>
+<div class="card-desc">A multi-agent interactive classroom with a native local FunASR provider merged in <a href="https://github.com/THU-MAIC/OpenMAIC/pull/1044">#1044</a>. Follow the <a href="https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr">setup guide</a> and set <code>ASR_FUNASR_BASE_URL</code> to send WAV audio to the OpenAI-compatible transcription endpoint and select SenseVoiceSmall, Paraformer, or Fun-ASR-Nano without an API key. See the <a href="https://github.com/modelscope/FunASR">FunASR repository</a> for server capabilities and deployment boundaries.</div>
+<div><span class="card-tag">Local ASR</span><span class="card-tag">Multi-agent</span><span class="card-tag">OpenAI-compat</span></div>
+</div>
+<div class="card">
<div class="card-title"><a href="https://github.com/RapidAI/RapidASR">RapidASR</a></div>
<div class="card-stars">608 stars</div>
<div class="card-desc">Cross-platform ASR inference library based on ONNX Runtime and FunASR. Ready to use, supports Chinese-English mixed recognition.</div>
diff --git a/web-pages/product-site/tests/browser/product-site.spec.ts b/web-pages/product-site/tests/browser/product-site.spec.ts
index 21fbfb25c..977e14c5e 100644
--- a/web-pages/product-site/tests/browser/product-site.spec.ts
+++ b/web-pages/product-site/tests/browser/product-site.spec.ts
@@ -223,6 +223,35 @@ for (const viewport of [
});
}
+for (const viewport of [
+ { name: 'mobile', width: 390, height: 844 },
+ { name: 'desktop', width: 1440, height: 900 },
+]) {
+ test(`OpenMAIC ecosystem entry is stable at ${viewport.name}`, async ({ page }, testInfo) => {
+ await page.setViewportSize(viewport);
+
+ for (const route of ['/ecosystem.html', '/en/ecosystem.html']) {
+ await page.goto(route);
+ const card = page.locator('.card').filter({ hasText: 'OpenMAIC' });
+
+ await expect(card).toHaveCount(1);
+ await expect(card.locator('.card-tag', { hasText: 'Local ASR' })).toBeVisible();
+ await expect(card.locator('a[href="https://github.com/THU-MAIC/OpenMAIC/pull/1044"]')).toBeVisible();
+ await expect(card.locator('a[href="https://github.com/modelscope/FunASR"]')).toBeVisible();
+
+ const layout = await page.evaluate(() => ({
+ overflow: document.documentElement.scrollWidth - document.documentElement.clientWidth,
+ }));
+ expect(layout.overflow).toBeLessThanOrEqual(1);
+ }
+
+ await page.screenshot({
+ path: testInfo.outputPath(`openmaic-ecosystem-${viewport.name}.png`),
+ fullPage: true,
+ });
+ });
+}
+
test('reduced motion disables smooth scrolling', async ({ page }) => {
await page.emulateMedia({ reducedMotion: 'reduce' });
await page.goto('/en/');
diff --git a/web-pages/product-site/tests/test_legacy.py b/web-pages/product-site/tests/test_legacy.py
index 74d0b8ce4..85dc88a87 100644
--- a/web-pages/product-site/tests/test_legacy.py
+++ b/web-pages/product-site/tests/test_legacy.py
@@ -153,6 +153,49 @@ def test_mlx_audio_ecosystem_entry_is_merged_attributed_and_bounded():
assert 'https://github.com/Blaizzy/mlx-audio/pull/885' in text
+def test_openmaic_ecosystem_entry_is_merged_attributed_and_bounded():
+ pages = {
+ 'zh': LEGACY / 'ecosystem.html',
+ 'en': LEGACY / 'en' / 'ecosystem.html',
+ }
+ required_links = {
+ 'https://github.com/THU-MAIC/OpenMAIC',
+ 'https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr',
+ 'https://github.com/THU-MAIC/OpenMAIC/pull/1044',
+ 'https://github.com/modelscope/FunASR',
+ }
+
+ for language, path in pages.items():
+ soup = BeautifulSoup(path.read_text(encoding='utf-8'), 'html.parser')
+ cards = [
+ item
+ for item in soup.select('.card')
+ if item.select_one('.card-title').get_text(' ', strip=True) == 'OpenMAIC'
+ ]
+ assert len(cards) == 1
+
+ text = cards[0].get_text(' ', strip=True)
+ hrefs = {link.get('href') for link in cards[0].select('a[href]')}
+
+ assert required_links <= hrefs
+ assert 'FunASR' in text
+ assert 'SenseVoiceSmall' in text
+ assert 'Paraformer' in text
+ assert 'Fun-ASR-Nano' in text
+ assert 'ASR_FUNASR_BASE_URL' in text
+ assert ('本地' in text) if language == 'zh' else ('local' in text.lower())
+
+ community_docs = {
+ 'en': Path(__file__).resolve().parents[3] / 'docs' / 'community_projects.md',
+ 'zh': Path(__file__).resolve().parents[3] / 'docs' / 'community_projects_zh.md',
+ }
+ for text_path in community_docs.values():
+ text = text_path.read_text(encoding='utf-8')
+ assert '[OpenMAIC](https://github.com/THU-MAIC/OpenMAIC)' in text
+ assert 'ASR_FUNASR_BASE_URL' in text
+ assert 'https://github.com/THU-MAIC/OpenMAIC/pull/1044' in text
+
+
def test_v140_release_pages_are_bilingual_indexed_and_precise():
slug = 'funasr-v1-4-0-pypi-release.html'
pages = {