Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Python asraudiochineseemotion-recognitionfunasrmcp-servermultilingual-asropenai-compatible-apiparaformerpunctuationpytorchreal-time-asrspeaker-diarizationspeech-recognitionspeech-to-textstreaming-asrtranscriptionvllmvoice-activity-detectionwhisper-alternative
update docs
雾聪585a4d3e5ff8
diff --git a/README.md b/README.mdindex 507306f37..970c5ebd0 100644--- a/README.md+++ b/README.md@@ -28,7 +28,7 @@<a name="whats-new"></a>## What's new:- 2024/03/05:Added support for the Whisper-large-v3 model, a multitasking model that can perform multilingual speech recognition, speech translation, and language identification. It can be downloaded from the[modelscope](https://www.modelscope.cn/models/iic/Whisper-large-v3/summary), and [openai](https://github.com/alibaba-damo-academy/FunASR/tree/main/examples/industrial_data_pretraining/whisper).-- 2024/03/03: Offline File Transcription Service 4.4, Offline File Transcription Service of English 1.5,Real-time Transcription Service 1.9 released,Docker image supports ARM64 platform;([docs](runtime/readme.md))+- 2024/03/05: Offline File Transcription Service 4.4, Offline File Transcription Service of English 1.5,Real-time Transcription Service 1.9 released,docker image supports ARM64 platform, update modelscope;([docs](runtime/readme.md))- 2024/01/30:funasr-1.0 has been released ([docs](https://github.com/alibaba-damo-academy/FunASR/discussions/1319))- 2024/01/30:emotion recognition models are new supported. [model link](https://www.modelscope.cn/models/iic/emotion2vec_base_finetuned/summary), modified from [repo](https://github.com/ddlBoJack/emotion2vec).- 2024/01/25: Offline File Transcription Service 4.2, Offline File Transcription Service of English 1.3 released,optimized the VAD (Voice Activity Detection) data processing method, significantly reducing peak memory usage, memory leak optimization; Real-time Transcription Service 1.7 released,optimizatized the client-side;([docs](runtime/readme.md))diff --git a/README_zh.md b/README_zh.mdindex a6e1ac752..e6a106022 100644--- a/README_zh.md+++ b/README_zh.md@@ -30,7 +30,7 @@ FunASR希望在语音识别的学术研究和工业应用之间架起一座桥<a name="最新动态"></a>## 最新动态- 2024/03/05:新增加Whisper-large-v3模型支持,多语言语音识别/翻译/语种识别,支持从[modelscope](https://www.modelscope.cn/models/iic/Whisper-large-v3/summary)仓库下载,也支持从[openai](https://github.com/alibaba-damo-academy/FunASR/tree/main/examples/industrial_data_pretraining/whisper)仓库下载模型。-- 2024/03/03: 中文离线文件转写服务 4.4、英文离线文件转写服务 1.5、中文实时语音听写服务 1.9 发布,docker镜像支持arm64平台;详细信息参阅([部署文档](runtime/readme_cn.md))+- 2024/03/05: 中文离线文件转写服务 4.4、英文离线文件转写服务 1.5、中文实时语音听写服务 1.9 发布,docker镜像支持arm64平台,升级modelscope版本;详细信息参阅([部署文档](runtime/readme_cn.md))- 2024/01/30:funasr-1.0发布,更新说明[文档](https://github.com/alibaba-damo-academy/FunASR/discussions/1319)- 2024/01/30:新增加情感识别 [模型链接](https://www.modelscope.cn/models/iic/emotion2vec_base_finetuned/summary),原始模型 [repo](https://github.com/ddlBoJack/emotion2vec).- 2024/01/25: 中文离线文件转写服务 4.2、英文离线文件转写服务 1.3,优化vad数据处理方式,大幅降低峰值内存占用,内存泄漏优化;中文实时语音听写服务 1.7 发布,客户端优化;详细信息参阅([部署文档](runtime/readme_cn.md))diff --git a/runtime/docs/SDK_advanced_guide_offline.md b/runtime/docs/SDK_advanced_guide_offline.mdindex 6c3f24679..d975b53d9 100644--- a/runtime/docs/SDK_advanced_guide_offline.md+++ b/runtime/docs/SDK_advanced_guide_offline.md@@ -12,7 +12,7 @@ This document serves as a development guide for the FunASR offline file transcri| TIME | INFO | IMAGE VERSION | IMAGE ID ||------------|----------------------------------------------------------------------------------------------------------------------------------|------------------------------|--------------|-| 2024.03.03 | Docker image supports ARM64 platform | funasr-runtime-sdk-cpu-0.4.4 | 404811e713be |+| 2024.03.05 | docker image supports ARM64 platform, update modelscope | funasr-runtime-sdk-cpu-0.4.4 | 2dc87b86dc49 || 2024.01.25 | Optimized the VAD (Voice Activity Detection) data processing method, significantly reducing peak memory usage; memory leak optimization| funasr-runtime-sdk-cpu-0.4.2 | befdc7b179ed || 2024.01.08 | optimized format sentence-level timestamps | funasr-runtime-sdk-cpu-0.4.1 | 0250f8ef981b || 2024.01.03 | Added support for 8k models, optimized timestamp mismatch issues and added sentence-level timestamps, improved the effectiveness of English word FST hotwords, supported automated configuration of thread parameters, and fixed known crash issues as well as memory leak problems. | funasr-runtime-sdk-cpu-0.4.0 | c4483ee08f04 |diff --git a/runtime/docs/SDK_advanced_guide_offline_en.md b/runtime/docs/SDK_advanced_guide_offline_en.mdindex 0a2aefb49..eca9f7bb3 100644--- a/runtime/docs/SDK_advanced_guide_offline_en.md+++ b/runtime/docs/SDK_advanced_guide_offline_en.md@@ -6,7 +6,7 @@ This document serves as a development guide for the FunASR offline file transcri| TIME | INFO | IMAGE VERSION | IMAGE ID ||------------|-----------------------------------------|---------------------------------|--------------|-| 2024.03.03 | Docker image supports ARM64 platform | funasr-runtime-sdk-en-cpu-0.1.5 | cd51bfef91eb |+| 2024.03.05 | docker image supports ARM64 platform, update modelscope | funasr-runtime-sdk-en-cpu-0.1.5 | 7cca2abc5901 || 2024.01.25 | Optimized the VAD (Voice Activity Detection) data processing method, significantly reducing peak memory usage; memory leak optimization| funasr-runtime-sdk-en-cpu-0.1.3 | c00f9ce7a195 || 2024.01.03 | fixed known crash issues as well as memory leak problems | funasr-runtime-sdk-en-cpu-0.1.2 | 0cdd9f4a4bb5 || 2023.11.08 | Adaptation to runtime structure changes | funasr-runtime-sdk-en-cpu-0.1.1 | 27017f70f72a |diff --git a/runtime/docs/SDK_advanced_guide_offline_en_zh.md b/runtime/docs/SDK_advanced_guide_offline_en_zh.mdindex 4f2811386..1fddc9ead 100644--- a/runtime/docs/SDK_advanced_guide_offline_en_zh.md+++ b/runtime/docs/SDK_advanced_guide_offline_en_zh.md@@ -6,7 +6,7 @@ FunASR提供可一键本地或者云端服务器部署的英文离线文件转| 时间 | 详情 | 镜像版本 | 镜像ID ||------------|---------------|---------------------------------|--------------|-| 2024.03.03 | docker镜像支持arm64平台 | funasr-runtime-sdk-en-cpu-0.1.5 | cd51bfef91eb |+| 2024.03.05 | docker镜像支持arm64平台,升级modelscope版本 | funasr-runtime-sdk-en-cpu-0.1.5 | 7cca2abc5901 || 2024.01.25 | 优化vad数据处理方式,大幅降低峰值内存占用;内存泄漏优化 | funasr-runtime-sdk-en-cpu-0.1.3 | c00f9ce7a195 || 2024.01.03 | 修复已知的crash问题及内存泄漏问题 | funasr-runtime-sdk-en-cpu-0.1.2 | 0cdd9f4a4bb5 || 2023.11.08 | runtime结构变化适配 | funasr-runtime-sdk-en-cpu-0.1.1 | 27017f70f72a |diff --git a/runtime/docs/SDK_advanced_guide_offline_zh.md b/runtime/docs/SDK_advanced_guide_offline_zh.mdindex 6cb5474ed..ef4cfd23e 100644--- a/runtime/docs/SDK_advanced_guide_offline_zh.md+++ b/runtime/docs/SDK_advanced_guide_offline_zh.md@@ -10,7 +10,7 @@ FunASR离线文件转写软件包,提供了一款功能强大的语音离线| 时间 | 详情 | 镜像版本 | 镜像ID ||------------|---------------------------------------------------|------------------------------|--------------|-| 2024.03.03 | docker镜像支持arm64平台 | funasr-runtime-sdk-cpu-0.4.4 | 404811e713be |+| 2024.03.05 | docker镜像支持arm64平台,升级modelscope版本 | funasr-runtime-sdk-cpu-0.4.4 | 2dc87b86dc49 || 2024.01.25 | 优化vad数据处理方式,大幅降低峰值内存占用;内存泄漏优化| funasr-runtime-sdk-cpu-0.4.2 | befdc7b179ed || 2024.01.08 | 优化句子级时间戳json格式 | funasr-runtime-sdk-cpu-0.4.1 | 0250f8ef981b || 2024.01.03 | 新增支持8k模型、优化时间戳不匹配问题及增加句子级别时间戳、优化英文单词fst热词效果、支持自动化配置线程参数,同时修复已知的crash问题及内存泄漏问题 | funasr-runtime-sdk-cpu-0.4.0 | c4483ee08f04 |diff --git a/runtime/docs/SDK_advanced_guide_online.md b/runtime/docs/SDK_advanced_guide_online.mdindex 2f0048e5c..e9ec6e90f 100644--- a/runtime/docs/SDK_advanced_guide_online.md+++ b/runtime/docs/SDK_advanced_guide_online.md@@ -8,7 +8,7 @@ FunASR Real-time Speech Recognition Software Package integrates real-time versio| TIME | INFO | IMAGE VERSION | IMAGE ID ||------------|-------------------------------------------------------------------------------------|-------------------------------------|--------------|-| 2024.03.03 | Docker image supports ARM64 platform | funasr-runtime-sdk-online-cpu-0.1.9 | 6da1b9598885 |+| 2024.03.05 | docker image supports ARM64 platform, update modelscope | funasr-runtime-sdk-online-cpu-0.1.9 | 4a875e08c7a2 || 2024.01.25 | Optimization of the client-side | funasr-runtime-sdk-online-cpu-0.1.7 | 2aa23805572e || 2024.01.03 | The 2pass-offline mode supports Ngram language model decoding and WFST hotwords, while also addressing known crash issues and memory leak problems | funasr-runtime-sdk-online-cpu-0.1.6 | f99925110d27 || 2023.11.09 | fix bug: without online results | funasr-runtime-sdk-online-cpu-0.1.5 | b16584b6d38b |diff --git a/runtime/docs/SDK_advanced_guide_online_zh.md b/runtime/docs/SDK_advanced_guide_online_zh.mdindex 80eb3e7ae..5567513e0 100644--- a/runtime/docs/SDK_advanced_guide_online_zh.md+++ b/runtime/docs/SDK_advanced_guide_online_zh.md@@ -12,7 +12,7 @@ FunASR实时语音听写软件包,集成了实时版本的语音端点检测| 时间 | 详情 | 镜像版本 | 镜像ID ||:-----------|:----------------------------------|--------------------------------------|--------------|-| 2024.03.03 | docker镜像支持arm64平台 | funasr-runtime-sdk-online-cpu-0.1.9 | 6da1b9598885 |+| 2024.03.05 | docker镜像支持arm64平台,升级modelscope版本 | funasr-runtime-sdk-online-cpu-0.1.9 | 4a875e08c7a2 || 2024.01.25 | 客户端优化| funasr-runtime-sdk-online-cpu-0.1.7 | 2aa23805572e || 2024.01.03 | 2pass-offline模式支持Ngram语言模型解码、wfst热词,同时修复已知的crash问题及内存泄漏问题 | funasr-runtime-sdk-online-cpu-0.1.6 | f99925110d27 || 2023.11.09 | 修复无实时结果问题 | funasr-runtime-sdk-online-cpu-0.1.5 | b16584b6d38b |diff --git a/runtime/readme.md b/runtime/readme.mdindex 8d56f7899..2f6546b32 100644--- a/runtime/readme.md+++ b/runtime/readme.md@@ -17,7 +17,7 @@ Currently, the FunASR runtime-SDK supports the deployment of file transcriptionTo meet the needs of different users, we have prepared different tutorials with text and images for both novice and advanced developers.### Whats-new-- 2024/03/03: Docker image supports ARM64 platform, docker image version funasr-runtime-sdk-en-cpu-0.1.5 (cd51bfef91eb).+- 2024/03/05: docker image supports ARM64 platform, update modelscope, docker image version funasr-runtime-sdk-en-cpu-0.1.5 (7cca2abc5901).- 2024/01/25: Optimized the VAD (Voice Activity Detection) data processing method,significantly reducing peak memory usage,memory leak optimization, docker image version funasr-runtime-sdk-en-cpu-0.1.3 (c00f9ce7a195).- 2024/01/03: Fixed known crash issues as well as memory leak problems, docker image version funasr-runtime-sdk-en-cpu-0.1.2 (0cdd9f4a4bb5).- 2023/11/08: Adaptation to runtime structure changes (FunASR/funasr/runtime -> FunASR/runtime), docker image version funasr-runtime-sdk-en-cpu-0.1.1 (27017f70f72a).@@ -42,7 +42,7 @@ The FunASR real-time speech-to-text service software package not only performs rIn order to meet the needs of different users for different scenarios, different tutorials are prepared:### Whats-new-- 2024/03/03: Real-time Transcription Service 1.9 released,Docker image supports ARM64 platform, docker image version funasr-runtime-sdk-online-cpu-0.1.9 (6da1b9598885)+- 2024/03/05: Real-time Transcription Service 1.9 released,docker image supports ARM64 platform, update modelscope, docker image version funasr-runtime-sdk-online-cpu-0.1.9 (4a875e08c7a2)- 2024/01/25: Real-time Transcription Service 1.7 released,optimization of the client-side, docker image version funasr-runtime-sdk-online-cpu-0.1.7 (2aa23805572e)- 2024/01/03: Real-time Transcription Service 1.6 released,The 2pass-offline mode supports Ngram language model decoding and WFST hotwords, while also addressing known crash issues and memory leak problems, docker image version funasr-runtime-sdk-online-cpu-0.1.6 (f99925110d27)- 2023/11/09: Real-time Transcription Service 1.5 released,fix bug: without online results, docker image version funasr-runtime-sdk-online-cpu-0.1.5 (b16584b6d38b)@@ -72,7 +72,7 @@ Currently, the FunASR runtime-SDK supports the deployment of file transcriptionTo meet the needs of different users, we have prepared different tutorials with text and images for both novice and advanced developers.### Whats-new-- 2024/03/03: File Transcription Service 4.4 released, Docker image supports ARM64 platform, docker image version funasr-runtime-sdk-cpu-0.4.4 (404811e713be)+- 2024/03/05: File Transcription Service 4.4 released, docker image supports ARM64 platform, update modelscope, docker image version funasr-runtime-sdk-cpu-0.4.4 (2dc87b86dc49)- 2024/01/25: File Transcription Service 4.2 released, optimized the VAD (Voice Activity Detection) data processing method, significantly reducing peak memory usage, memory leak optimization, docker image version funasr-runtime-sdk-cpu-0.4.2 (befdc7b179ed)- 2024/01/08: File Transcription Service 4.1 released, optimized format sentence-level timestamps, docker image version funasr-runtime-sdk-cpu-0.4.1 (0250f8ef981b)- 2024/01/03: File Transcription Service 4.0 released, Added support for 8k models, optimized timestamp mismatch issues and added sentence-level timestamps, improved the effectiveness of English word FST hotwords, supported automated configuration of thread parameters, and fixed known crash issues as well as memory leak problems, docker image version funasr-runtime-sdk-cpu-0.4.0 (c4483ee08f04)diff --git a/runtime/readme_cn.md b/runtime/readme_cn.mdindex 78e026744..13cd8eb4f 100644--- a/runtime/readme_cn.md+++ b/runtime/readme_cn.md@@ -19,7 +19,7 @@ FunASR是由阿里巴巴通义实验室语音团队开源的一款语音识别为了支持不同用户的需求,针对不同场景,准备了不同的图文教程:### 最新动态-- 2024/03/03: 英文离线文件转写服务 1.5 发布,docker镜像支持arm64平台,dokcer镜像版本funasr-runtime-sdk-en-cpu-0.1.5 (cd51bfef91eb)+- 2024/03/05: 英文离线文件转写服务 1.5 发布,docker镜像支持arm64平台,升级modelscope版本,dokcer镜像版本funasr-runtime-sdk-en-cpu-0.1.5 (7cca2abc5901)- 2024/01/25: 英文离线文件转写服务 1.3 发布,优化vad数据处理方式,大幅降低峰值内存占用,内存泄漏优化,dokcer镜像版本funasr-runtime-sdk-en-cpu-0.1.3 (c00f9ce7a195)- 2024/01/03: 英文离线文件转写服务 1.2 发布,修复已知的crash问题及内存泄漏问题,dokcer镜像版本funasr-runtime-sdk-en-cpu-0.1.2 (0cdd9f4a4bb5)- 2023/11/08: 英文离线文件转写服务 1.1 发布,runtime结构变化适配(FunASR/funasr/runtime->FunASR/runtime),dokcer镜像版本funasr-runtime-sdk-en-cpu-0.1.1 (27017f70f72a)@@ -36,7 +36,7 @@ FunASR实时语音听写服务软件包,既可以实时地进行语音转文为了支持不同用户的需求,针对不同场景,准备了不同的图文教程:### 最新动态-- 2024/03/03: 中文实时语音听写服务 1.9 发布,docker镜像支持arm64平台,dokcer镜像版本funasr-runtime-sdk-online-cpu-0.1.9 (6da1b9598885)+- 2024/03/05: 中文实时语音听写服务 1.9 发布,docker镜像支持arm64平台,升级modelscope版本,dokcer镜像版本funasr-runtime-sdk-online-cpu-0.1.9 (4a875e08c7a2)- 2024/01/25: 中文实时语音听写服务 1.7 发布,客户端优化,dokcer镜像版本funasr-runtime-sdk-online-cpu-0.1.7 (2aa23805572e)- 2024/01/03: 中文实时语音听写服务 1.6 发布,2pass-offline模式支持Ngram语言模型解码、wfst热词,同时修复已知的crash问题及内存泄漏问题,dokcer镜像版本funasr-runtime-sdk-online-cpu-0.1.6 (f99925110d27)- 2023/11/09: 中文实时语音听写服务 1.5 发布,修复无实时结果的问题,dokcer镜像版本funasr-runtime-sdk-online-cpu-0.1.5 (b16584b6d38b)@@ -58,7 +58,7 @@ FunASR实时语音听写服务软件包,既可以实时地进行语音转文为了支持不同用户的需求,针对不同场景,准备了不同的图文教程:### 最新动态-- 2024/03/03: 中文离线文件转写服务 4.4 发布,docker镜像支持arm64平台,dokcer镜像版本funasr-runtime-sdk-cpu-0.4.4 (404811e713be)+- 2024/03/05: 中文离线文件转写服务 4.4 发布,docker镜像支持arm64平台,升级modelscope版本,dokcer镜像版本funasr-runtime-sdk-cpu-0.4.4 (2dc87b86dc49)- 2024/01/25: 中文离线文件转写服务 4.2 发布,优化vad数据处理方式,大幅降低峰值内存占用,内存泄漏优化,dokcer镜像版本funasr-runtime-sdk-cpu-0.4.2 (befdc7b179ed)- 2024/01/08: 中文离线文件转写服务 4.1 发布,优化句子级时间戳json格式,dokcer镜像版本funasr-runtime-sdk-cpu-0.4.1 (0250f8ef981b)- 2024/01/03: 中文离线文件转写服务 4.0 发布,新增支持8k模型、优化时间戳不匹配问题及增加句子级别时间戳、优化英文单词fst热词效果、支持自动化配置线程参数,同时修复已知的crash问题及内存泄漏问题,dokcer镜像版本funasr-runtime-sdk-cpu-0.4.0 (c4483ee08f04)