Voxtral-Mini-4B-Realtime-Arabic

模型发布 Hugging Face 模型 · mistralai 原文语言:中文

官方机构模型仓库创建于 2026-10-08。仓库创建时间不等于正式发布日期。任务类型:automatic-speech-recognition

全文

Voxtral Mini 4B Realtime Arabic

[!Note] See a space live demo directly in your browser here powered by this ONNX checkpoint. Many thanks to the ONNX community.

Voxtral Mini 4B Realtime Arabic is a streaming speech-to-text model for Arabic dialects and Modern Standard Arabic. It is designed to handle challenging real-world audio and code-switching, where speakers alternate between languages within the same conversation.

This model is fine-tuned from Voxtral-Mini-4B-Realtime-2602 and has approximately 4.4 billion parameters, with weights in BF16 precision. It processes 16 kHz audio through a causal audio encoder and language decoder, producing text as audio arrives. Its configurable transcription delay supports applications such as live captions and voice interfaces.

At a configured transcription delay of 480 ms, the model achieves an average Character Error Rate (CER) of 8.82% across seven Arabic benchmarks. It outperforms several open-source and proprietary offline models and comes within 0.91 percentage points of Voxtral Transcribe Arabic’s 7.91% CER.

The model is co-developed with the Ministère de la Transition Numérique et de la Réforme Administrative (MTNRA) under the umbrella of the strategic partnership signed between Mistral and Morocco in January 2026 as a sovereign AI asset.

Usage

vLLM

Use vLLM with Voxtral Realtime support and mistral-common audio dependencies.

Stream audio over WebSocket to /v1/realtime by adapting this example.

Transformers

Starting with transformers >= 5.2.0, Voxtral Realtime runs natively in Transformers. See the Transformers documentation for details.

Example

Benchmarks

We report Character Error Rate (CER) on established Arabic benchmarks and two new benchmarks, ISMA and Darija in the Wild, co-developed with Morocco’s *Ministère de la Transition Numérique et de la Réforme Administrative* (MTNRA). Lower CER is better.

All evaluations use temperature 0.0; the realtime model uses a configured transcription delay of 480 ms. CER is computed with normalization co-developed with MTNRA, covering Arabic dialect-specific spelling, clitics, loanwords, and spoken numbers. The code is available in normalization.py. Scores may differ under other normalization methods.

Example of usage:

*Note: Gemini’s safety filters block transcription of some FLEURS audio samples.*

Emerging capabilities

Training focused on Arabic code-switching. We also observe improvements in code-switching involving languages outside the training focus.

Limitations

The model targets Arabic transcription. For other languages, use the original Voxtral Mini 4B Realtime.

License

This model is licensed under the Apache 2.0 License.

*You must not use this model in a manner that infringes, misappropriates, or otherwise violates any third party’s rights, including intellectual property rights.*

正文以来源语言显示。

参考来源

← 返回每日简报