Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Python asraudiochineseemotion-recognitionfunasrmcp-servermultilingual-asropenai-compatible-apiparaformerpunctuationpytorchreal-time-asrspeaker-diarizationspeech-recognitionspeech-to-textstreaming-asrtranscriptionvllmvoice-activity-detectionwhisper-alternative
docs: feature OpenMAIC local FunASR integration
LauraGPTfa2bb1c28e3f
diff --git a/docs/community_projects.md b/docs/community_projects.mdindex 54c150ed7..45ee4aeae 100644--- a/docs/community_projects.md+++ b/docs/community_projects.md@@ -40,6 +40,7 @@ These integrations are community-maintained. Their release cadence, hardware sup|---|---|---|| [Xinference](https://github.com/xorbitsai/inference) | Built-in audio model specifications for SenseVoiceSmall, Fun-ASR-Nano-2512, and Fun-ASR-MLT-Nano-2512 through Xinference's unified inference API. | [Audio model specifications](https://github.com/xorbitsai/inference/blob/main/xinference/model/audio/model_spec.json) and the FunASR 1.3 compatibility update in merged [#5140](https://github.com/xorbitsai/inference/pull/5140). || [MLX Audio](https://github.com/Blaizzy/mlx-audio) | Apple Silicon-native Fun-ASR-Nano conversion and transcription through Python, CLI, and the OpenAI-compatible `POST /v1/audio/transcriptions` endpoint, including language hints and hotwords/context. The current public checkpoint path is transcription-only: it emits no timestamps, and VAD or diarization must run separately. | [Fun-ASR-Nano model guide](https://github.com/Blaizzy/mlx-audio/blob/main/docs/models/stt/fun-asr-nano.md), [server guide](https://github.com/Blaizzy/mlx-audio/blob/main/docs/guides/web-ui-api-server.md), and merged hotword support [#885](https://github.com/Blaizzy/mlx-audio/pull/885). |+| [OpenMAIC](https://github.com/THU-MAIC/OpenMAIC) | A multi-agent interactive classroom with a built-in local FunASR provider. It sends WAV audio to the OpenAI-compatible transcription endpoint, requires no API key, and exposes SenseVoiceSmall, Paraformer, and Fun-ASR-Nano through its model selector. | [FunASR local ASR setup](https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr), configure `ASR_FUNASR_BASE_URL`, and see merged provider [#1044](https://github.com/THU-MAIC/OpenMAIC/pull/1044). || [Optimum Intel](https://github.com/huggingface/optimum-intel) | OpenVINO export and inference support for Fun-ASR models through Hugging Face Optimum Intel, including FunASR-specific modeling and ASR/export/quantization coverage. | [FunASR OpenVINO modeling](https://github.com/huggingface/optimum-intel/blob/main/optimum/intel/openvino/modeling_funasr.py), [supported models docs](https://github.com/huggingface/optimum-intel/blob/main/docs/source/openvino/models.mdx), and merged [#1801](https://github.com/huggingface/optimum-intel/pull/1801). || [OpenVINO Notebooks](https://github.com/openvinotoolkit/openvino_notebooks) | Official OpenVINO tutorial material for FunASR-Nano, including helper code and NPU device fixes for running the notebook on Intel acceleration paths. | [FunASR-Nano notebook](https://github.com/openvinotoolkit/openvino_notebooks/tree/latest/notebooks/funasr-nano), [OpenVINO FunASR helper](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/funasr-nano/ov_funasr_helper.py), merged [#3497](https://github.com/openvinotoolkit/openvino_notebooks/pull/3497), and NPU fix [#3517](https://github.com/openvinotoolkit/openvino_notebooks/pull/3517). || [SGLang Omni](https://github.com/sgl-project/sglang-omni) | A multi-stage pipeline runtime for omni models with built-in Fun-ASR model support, OpenAI-compatible serving, cookbook docs, benchmark tasks, and formatted stream-output tests. | [Fun-ASR cookbook](https://github.com/sgl-project/sglang-omni/blob/main/docs/cookbook/fun_asr.md), [Fun-ASR model runtime](https://github.com/sgl-project/sglang-omni/tree/main/sglang_omni/models/fun_asr), merged [#1078](https://github.com/sgl-project/sglang-omni/pull/1078), and merged review-fix [#1079](https://github.com/sgl-project/sglang-omni/pull/1079). |diff --git a/docs/community_projects_zh.md b/docs/community_projects_zh.mdindex 75356d408..cdf8d24e1 100644--- a/docs/community_projects_zh.md+++ b/docs/community_projects_zh.md@@ -40,6 +40,7 @@|---|---|---|| [Xinference](https://github.com/xorbitsai/inference) | 通过 Xinference 统一推理 API 提供 SenseVoiceSmall、Fun-ASR-Nano-2512 和 Fun-ASR-MLT-Nano-2512 内置音频模型规格。 | [音频模型规格](https://github.com/xorbitsai/inference/blob/main/xinference/model/audio/model_spec.json) 和已合并 [#5140](https://github.com/xorbitsai/inference/pull/5140) 中的 FunASR 1.3 兼容性更新。 || [MLX Audio](https://github.com/Blaizzy/mlx-audio) | 面向 Apple Silicon 的原生 MLX Fun-ASR-Nano 转换与转写路径,覆盖 Python、CLI 和 OpenAI 兼容的 `POST /v1/audio/transcriptions`,支持语种提示与 hotwords/context。当前公开 checkpoint 路径仅转写、无时间戳;VAD 与说话人分离需要在外部完成。 | [Fun-ASR-Nano 模型指南](https://github.com/Blaizzy/mlx-audio/blob/main/docs/models/stt/fun-asr-nano.md)、[服务端指南](https://github.com/Blaizzy/mlx-audio/blob/main/docs/guides/web-ui-api-server.md) 和 hotword 支持已合并 [#885](https://github.com/Blaizzy/mlx-audio/pull/885)。 |+| [OpenMAIC](https://github.com/THU-MAIC/OpenMAIC) | 多智能体互动课堂,已内置本地 FunASR provider。它把 WAV 音频发送到 OpenAI 兼容转写端点,无需 API Key,并可在模型选择器中使用 SenseVoiceSmall、Paraformer 和 Fun-ASR-Nano。 | [FunASR 本地 ASR 配置](https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr),设置 `ASR_FUNASR_BASE_URL`,并参见已合并 provider [#1044](https://github.com/THU-MAIC/OpenMAIC/pull/1044)。 || [Optimum Intel](https://github.com/huggingface/optimum-intel) | 通过 Hugging Face Optimum Intel 支持 Fun-ASR 模型的 OpenVINO 导出与推理,包括 FunASR 专用 modeling 代码以及 ASR、export、quantization 覆盖。 | [FunASR OpenVINO modeling](https://github.com/huggingface/optimum-intel/blob/main/optimum/intel/openvino/modeling_funasr.py)、[支持模型文档](https://github.com/huggingface/optimum-intel/blob/main/docs/source/openvino/models.mdx) 和已合并 [#1801](https://github.com/huggingface/optimum-intel/pull/1801)。 || [OpenVINO Notebooks](https://github.com/openvinotoolkit/openvino_notebooks) | OpenVINO 官方 FunASR-Nano 教程资料,包含 helper 代码和 NPU device 修复,方便用户在 Intel 加速路径上运行 notebook。 | [FunASR-Nano notebook](https://github.com/openvinotoolkit/openvino_notebooks/tree/latest/notebooks/funasr-nano)、[OpenVINO FunASR helper](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/funasr-nano/ov_funasr_helper.py)、已合并 [#3497](https://github.com/openvinotoolkit/openvino_notebooks/pull/3497) 和 NPU 修复 [#3517](https://github.com/openvinotoolkit/openvino_notebooks/pull/3517)。 || [SGLang Omni](https://github.com/sgl-project/sglang-omni) | 面向 omni models 的 multi-stage pipeline runtime,已内置 Fun-ASR 模型支持、OpenAI 兼容服务、cookbook 文档、benchmark 任务和格式化后的 stream-output 测试。 | [Fun-ASR cookbook](https://github.com/sgl-project/sglang-omni/blob/main/docs/cookbook/fun_asr.md)、[Fun-ASR 模型 runtime](https://github.com/sgl-project/sglang-omni/tree/main/sglang_omni/models/fun_asr)、已合并 [#1078](https://github.com/sgl-project/sglang-omni/pull/1078) 和 review-fix 已合并 [#1079](https://github.com/sgl-project/sglang-omni/pull/1079)。 |diff --git a/web-pages/product-site/content/legacy-manifest.json b/web-pages/product-site/content/legacy-manifest.jsonindex 8a9254718..785c3646e 100644--- a/web-pages/product-site/content/legacy-manifest.json+++ b/web-pages/product-site/content/legacy-manifest.json@@ -39,7 +39,7 @@"css/index.1682178c.css": "b5f6034ce886c25773928c114e4290d1c491a3d081677b488810198efd76b4e1","decoder.js": "f2023a28036b1ff58e5bdabbb72ea427f8faaf60e89acd78ff183c313bdb0a2c","donors.html": "eec6b789b29c27d372925ae0ad3e13d4c6e62978b3c38c4da9e3aec129f10934",- "ecosystem.html": "ae547554ccffe30436109c95313250f908826ee4c51494a5856e4f0dd0cc37aa",+ "ecosystem.html": "e81f4412ea4af6a838320660809f3a24edbf4cf8fb00445b66b81fe6b7efa1a9","en/blog/cantonese-speech-recognition.html": "b9bd146198206f781c37f341c370a690dc83cd7163334e34b4e7f65e69af8ff2","en/blog/chinese-speech-recognition.html": "16b68bd2a1122236c580c62275002ae2c0875ca14e32686e88d3b5ccfa9f56ef","en/blog/fun-asr-nano-guide.html": "1746c708bd0606188de4266d8255984dd9e14634af33c54ad65a5f05b767be1b",@@ -71,7 +71,7 @@"en/blog/voice-activity-detection-python.html": "d12f5d0f4ae07c3434f6188d12f5603b8abb9578413b79133668638d1c5e18a7","en/blog/which-funasr-model.html": "1207180aa929a3aa51db136c1098f4edc8f07405e2b56fe033998bf996f8ec7f","en/donors.html": "eacb7f9434b1b29e13e9b0175bb9680556ee72ab4dbd155e68f9c912eb0212b1",- "en/ecosystem.html": "9e761043c8e20fa7d876edb4a83592edd1bb4c74e8a88a6bf58cd19d04624965",+ "en/ecosystem.html": "d6e8ba697f2c5ea972bfa93e803d40456f6f861e08df103444806bf7f728746f","en/index.html": "d86effc3bf4d218eabd465cbbe026f62c98dd50110ddd58251d9d271a64882a2","en/llama-cpp.html": "dbfbd125ebbf07f7d923c91b122818f8b09484ce54c1e80eba66a89d22dfb5b4","en/models.html": "321a63caace107d5ce6d470948c2f5954f2d8e25306d8227b4a85ec3663ad49e",diff --git a/web-pages/product-site/legacy/ecosystem.html b/web-pages/product-site/legacy/ecosystem.htmlindex 6af0ac166..348148298 100644--- a/web-pages/product-site/legacy/ecosystem.html+++ b/web-pages/product-site/legacy/ecosystem.html@@ -360,6 +360,12 @@ footer a{color:#60a5fa}<div><span class="card-tag">Apple Silicon</span><span class="card-tag">Fun-ASR-Nano</span><span class="card-tag">OpenAI 兼容</span></div></div><div class="card">+<div class="card-title"><a href="https://github.com/THU-MAIC/OpenMAIC">OpenMAIC</a></div>+<div class="card-stars">20.7K+ stars</div>+<div class="card-desc">多智能体互动课堂,已通过 <a href="https://github.com/THU-MAIC/OpenMAIC/pull/1044">#1044</a> 合并原生本地 FunASR provider。按照 <a href="https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr">配置指南</a> 设置 <code>ASR_FUNASR_BASE_URL</code> 后,可把 WAV 音频发送到 OpenAI 兼容转写端点,并在 SenseVoiceSmall、Paraformer 与 Fun-ASR-Nano 之间选择;无需 API Key。服务端能力与部署边界以 <a href="https://github.com/modelscope/FunASR">FunASR 仓库</a> 为准。</div>+<div><span class="card-tag">Local ASR</span><span class="card-tag">Multi-agent</span><span class="card-tag">OpenAI 兼容</span></div>+</div>+<div class="card"><div class="card-title"><a href="https://github.com/RapidAI/RapidASR">RapidASR</a></div><div class="card-stars">608 stars</div><div class="card-desc">跨平台 ASR 推理库,基于 ONNX Runtime 和 FunASR。开箱即用,支持中英文混合识别。</div>diff --git a/web-pages/product-site/legacy/en/ecosystem.html b/web-pages/product-site/legacy/en/ecosystem.htmlindex 22bcfb4be..d59ab7350 100644--- a/web-pages/product-site/legacy/en/ecosystem.html+++ b/web-pages/product-site/legacy/en/ecosystem.html@@ -361,6 +361,12 @@ footer a{color:#60a5fa}<div><span class="card-tag">Apple Silicon</span><span class="card-tag">Fun-ASR-Nano</span><span class="card-tag">OpenAI-compat</span></div></div><div class="card">+<div class="card-title"><a href="https://github.com/THU-MAIC/OpenMAIC">OpenMAIC</a></div>+<div class="card-stars">20.7K+ stars</div>+<div class="card-desc">A multi-agent interactive classroom with a native local FunASR provider merged in <a href="https://github.com/THU-MAIC/OpenMAIC/pull/1044">#1044</a>. Follow the <a href="https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr">setup guide</a> and set <code>ASR_FUNASR_BASE_URL</code> to send WAV audio to the OpenAI-compatible transcription endpoint and select SenseVoiceSmall, Paraformer, or Fun-ASR-Nano without an API key. See the <a href="https://github.com/modelscope/FunASR">FunASR repository</a> for server capabilities and deployment boundaries.</div>+<div><span class="card-tag">Local ASR</span><span class="card-tag">Multi-agent</span><span class="card-tag">OpenAI-compat</span></div>+</div>+<div class="card"><div class="card-title"><a href="https://github.com/RapidAI/RapidASR">RapidASR</a></div><div class="card-stars">608 stars</div><div class="card-desc">Cross-platform ASR inference library based on ONNX Runtime and FunASR. Ready to use, supports Chinese-English mixed recognition.</div>diff --git a/web-pages/product-site/tests/browser/product-site.spec.ts b/web-pages/product-site/tests/browser/product-site.spec.tsindex 21fbfb25c..977e14c5e 100644--- a/web-pages/product-site/tests/browser/product-site.spec.ts+++ b/web-pages/product-site/tests/browser/product-site.spec.ts@@ -223,6 +223,35 @@ for (const viewport of [});}+for (const viewport of [+ { name: 'mobile', width: 390, height: 844 },+ { name: 'desktop', width: 1440, height: 900 },+]) {+ test(`OpenMAIC ecosystem entry is stable at ${viewport.name}`, async ({ page }, testInfo) => {+ await page.setViewportSize(viewport);++ for (const route of ['/ecosystem.html', '/en/ecosystem.html']) {+ await page.goto(route);+ const card = page.locator('.card').filter({ hasText: 'OpenMAIC' });++ await expect(card).toHaveCount(1);+ await expect(card.locator('.card-tag', { hasText: 'Local ASR' })).toBeVisible();+ await expect(card.locator('a[href="https://github.com/THU-MAIC/OpenMAIC/pull/1044"]')).toBeVisible();+ await expect(card.locator('a[href="https://github.com/modelscope/FunASR"]')).toBeVisible();++ const layout = await page.evaluate(() => ({+ overflow: document.documentElement.scrollWidth - document.documentElement.clientWidth,+ }));+ expect(layout.overflow).toBeLessThanOrEqual(1);+ }++ await page.screenshot({+ path: testInfo.outputPath(`openmaic-ecosystem-${viewport.name}.png`),+ fullPage: true,+ });+ });+}+test('reduced motion disables smooth scrolling', async ({ page }) => {await page.emulateMedia({ reducedMotion: 'reduce' });await page.goto('/en/');diff --git a/web-pages/product-site/tests/test_legacy.py b/web-pages/product-site/tests/test_legacy.pyindex 74d0b8ce4..85dc88a87 100644--- a/web-pages/product-site/tests/test_legacy.py+++ b/web-pages/product-site/tests/test_legacy.py@@ -153,6 +153,49 @@ def test_mlx_audio_ecosystem_entry_is_merged_attributed_and_bounded():assert 'https://github.com/Blaizzy/mlx-audio/pull/885' in text+def test_openmaic_ecosystem_entry_is_merged_attributed_and_bounded():+ pages = {+ 'zh': LEGACY / 'ecosystem.html',+ 'en': LEGACY / 'en' / 'ecosystem.html',+ }+ required_links = {+ 'https://github.com/THU-MAIC/OpenMAIC',+ 'https://github.com/THU-MAIC/OpenMAIC#funasr-local-asr',+ 'https://github.com/THU-MAIC/OpenMAIC/pull/1044',+ 'https://github.com/modelscope/FunASR',+ }++ for language, path in pages.items():+ soup = BeautifulSoup(path.read_text(encoding='utf-8'), 'html.parser')+ cards = [+ item+ for item in soup.select('.card')+ if item.select_one('.card-title').get_text(' ', strip=True) == 'OpenMAIC'+ ]+ assert len(cards) == 1++ text = cards[0].get_text(' ', strip=True)+ hrefs = {link.get('href') for link in cards[0].select('a[href]')}++ assert required_links <= hrefs+ assert 'FunASR' in text+ assert 'SenseVoiceSmall' in text+ assert 'Paraformer' in text+ assert 'Fun-ASR-Nano' in text+ assert 'ASR_FUNASR_BASE_URL' in text+ assert ('本地' in text) if language == 'zh' else ('local' in text.lower())++ community_docs = {+ 'en': Path(__file__).resolve().parents[3] / 'docs' / 'community_projects.md',+ 'zh': Path(__file__).resolve().parents[3] / 'docs' / 'community_projects_zh.md',+ }+ for text_path in community_docs.values():+ text = text_path.read_text(encoding='utf-8')+ assert '[OpenMAIC](https://github.com/THU-MAIC/OpenMAIC)' in text+ assert 'ASR_FUNASR_BASE_URL' in text+ assert 'https://github.com/THU-MAIC/OpenMAIC/pull/1044' in text++def test_v140_release_pages_are_bilingual_indexed_and_precise():slug = 'funasr-v1-4-0-pypi-release.html'pages = {