Skip to content

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

1.9 KB
Raw Blame

Speech Applications

Choose the application first, then select its model and serving contract. The use-case guide and community integrations provide the maintained recipes.

Audio Cut

Use FunClip for transcript-driven audio and video clipping. For speaker-attributed recordings, start with MOSS-Transcribe-Diarize: it produces transcription, timestamps and anonymous speaker labels without an external VAD/speaker pipeline. These labels are not verified real-world identities. Check the chosen FunClip release and backend before assuming every ASR option has the same output fields.

Realtime Speech Recognition

Start with the deployment matrix and C++ WebSocket protocol. Python vLLM preview sessions and native C++ streaming services use different messages and state transitions; their clients are not interchangeable. Use the realtime benchmark methodology to measure end-to-end latency under your traffic pattern.

MOSS is a long-form transcription/diarization option, not a replacement for a native low-latency streaming model. Receiving an upload in chunks does not make the underlying model a streaming recognizer.

Audio Chat

For file or utterance transcription in an agent workflow, follow the Python HTTP service and its workflow integration guide. FunASR supplies recognition; dialogue generation, speech synthesis, turn-taking and interruption handling are separate application components. Validate their combined latency and privacy requirements before deployment.

Next: model selection, HTTP security, and troubleshooting.