IBM 发布 Granite Speech 5.0 系列语音模型
Granite Speech 5.0: Transcribe, Translate, and Attribute more Accurately and Faster
IBM 在 Hugging Face 发布 granite-speech-5.0-2b、granite-speech-5.0-470m-turboctc 和更新版 granite-speech-4.1-2b-plus 三款语音模型,均以 Apache 2.0 许可开源。granite-speech-5.0-2b 支持英语、法语、德语、西班牙语、葡萄牙语和日语的转写,并可在这些语言与英语之间互译,另支持英语译成意大利语和中文,训练数据含 39 万小时公开音频;Turbo CTC 版本扩展到七种语言并原生输出标点与大小写,在 Open ASR Leaderboard 上达到 19,870 RTFx,约为发布时的 1.6 倍;4.1-2b-plus 侧重多说话人长音频,说话人分离 WDER 与 cpWER 均下降 7%,长语音 WER 下降 24%。
推荐理由
AI 评分 58
原文列出三款语音模型各自的能力与适用场景,并给出 WER、RTFx 等指标,便于按需求选型。
主题
正文
当前显示原文,中文全文译文尚未就绪。
Granite Speech 5.0 2B: more accurate, more robust, more control
granite-speech-5.0-2b is the successor to granite-speech-4.1-2b at the same parameter count. It transcribes English, French, German, Spanish, Portuguese, and Japanese, and translates to and from English in those languages, plus English to Italian and Mandarin. It was trained on 390,000 hours of public audio, plus synthetic data built for Japanese ASR, keyword biasing, and translation.
What's new compared with 4.1 2B Speech:
More accurate, more robust English ASR: Higher accuracy on English short-form benchmarks, and better handling of noise, reverberation, and distant-microphone speech.
Language ID prompting: Name the input language in the prompt to steer multilingual transcription.
Better long-form and conversational translation: Translation holds up for longer with more natural speech, not just short read sentences.
Keyword lists up to 2,000 terms: Bias transcription and translation toward product names, people, and acronyms, in every supported language.
Punctuation and capitalization on request: Ask for formatted output in the prompt; capitalization F1 ranges from 89.7 to 99.5 across our test sets.
The model ships under Apache 2.0 with support in Transformers, vLLM, llama.cpp, and mlx-audio for Apple Silicon.
Chart 1: granite-speech-5.0-2b ranks #2 among top open-weight ASR models on average English WER (5.06%). Lower is better. Results are unofficial, as of 15 October 2026, and averaged over the Open ASR Leaderboard’s public English short-form test sets.
Granite Speech 5.0 Turbo CTC: now multilingual, more robust, and even faster
When we introduced Turbo CTC in August , it was an English-only, 470M-parameter encoder built for speed. This revision keeps that footprint and adds the three things users asked for most:
Multilingual transcription: English, Japanese, Spanish, German, French, Italian, and Portuguese.
Native punctuation and capitalization: Transcripts come out ready to read, with no separate punctuation or truecasing step.
More robust in difficult acoustics: Training that explicitly targets reverberant audio makes Turbo CTC more robust in echoey rooms and far-field recordings.
It's also faster. By compiling a single Conformer block and reusing its graph across the stack, we cut warmup time and pushed Turbo CTC to 19,870 RTFx on the Open ASR Leaderboard, up from roughly 12,600 RTFx at launch: about 1.6x faster, at the same accuracy level.
Chart 2: Average WER vs. RTFx on the Open ASR Leaderboard (English short-form, 9 public test sets, as of October 2026). Lower WER and higher RTFx are better; RTFx is on a log scale.
Granite Speech 4.1 2B Plus: better at who said what, and when
The updated granite-speech-4.1-2b-plus is tuned for the recordings enterprises actually have: meetings, support calls, and interviews with several speakers running long. It keeps the 4.1 name because the architecture, prompt format, and API are unchanged, so it's a drop-in replacement for the current model with improved weights. This revision improves four areas:
Speaker attribution: More accurate labeling of who is speaking. Word diarization error rate (WDER) drops 7%, and speaker-attributed WER (cpWER) drops 7% overall.
Timestamps: Average timestamp shift (AAS) is cut by more than half, yielding tighter timing in captions, search, and review.
Long-speech performance: WER on long-form test sets drops 24%.
Keyword biasing: Errors on biased keywords fall 45% with 20-term keyword lists.
Table 1: All metrics are error rates, so lower is better. For more detailed results, see the model card .
Not sure which model to pick? Start here:
Need high transcription accuracy, translation, or keyword biasing? Use granite-speech-5.0-2b .
Need raw speed or on-device transcription? Use granite-speech-5.0-470m-turboctc , and try it in the browser with our WebGPU streaming demo .
Working with meetings or multi-speaker calls? Use granite-speech-4.1-2b-plus .
These models are all released under an Apache 2.0 license with native support in Transformers. Full evaluation results, architecture details, training data, and usage examples are on each model card. We recommend pairing them with Granite Guardian for production deployments that need additional risk detection.
Give them a try and let us know what you think!
Models mentioned in this article 3
ibm-granite/granite-speech-4.1-2b-plus
ibm-granite/granite-speech-5.0-2b
ibm-granite/granite-speech-5.0-470m-turboctc
Collections mentioned in this article 1
Granite Guardian
More from this author
Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
Granite 4.2 LLMs: How They're Built
Models mentioned in this article 3
ibm-granite/granite-speech-4.1-2b-plus
ibm-granite/granite-speech-5.0-2b
ibm-granite/granite-speech-5.0-470m-turboctc
Collections mentioned in this article 1
Granite Guardian