Rumble-2-Flash Released: An Open-Source 0.5B Speech Model Supporting 40+ Languages
Rumble-2-Flash is an open-source 0.5B speech model supporting 40+ languages. Built on the Qwen3-ASR architecture, it can run with Transformers and vLLM. On the Open ASR Leaderboard, it achieves an average error rate of 6.96% on the multilingual track and an average WER of 6.6% on the English track, while throughput exceeds 7,000 RTFx with sufficiently large batches. The model weights have been released on the Hugging Face Hub at Reson8/Rumble-2-Flash, and the model is also available via API.
Why read this
SelectedAI score 71
The article also reports results for multilingual recognition, real-world calls, and throughput, enabling comparisons of the accuracy and deployment efficiency of small speech models.
Topics
Body
Quickstart
audio accepts a local path, a URL, a NumPy array, or a list of these.
How it's built
Rumble-2-Flash uses the Qwen3-ASR architecture for day-0 support. If your stack runs Transformers or vLLM, it runs Rumble-2-Flash, with no forked runtime or trust_remote_code .
To find out how small a model could get before accuracy dropped off, we distilled Rumble-2, our larger production model, into it with on-policy distillation. The student doesn't train on transcripts the teacher wrote. It transcribes the audio itself, and the teacher grades that transcript token by token: at every position, it gives its own probability for what should come next, and the student learns to match it. Because the student learns from its own outputs, it gets corrected on exactly the mistakes it makes, with feedback on every token instead of one score per clip.
On-policy distillation normally requires teacher and student to share a tokenizer, and ours don't: choosing Qwen3-ASR meant taking its vocabulary too. GOLD removes that restriction. It merges tokens where the two tokenizers split the text differently, so both models are compared over the same text. Tokens that exist in both vocabularies are compared directly, and the rest by their sorted probabilities.
Results
Accuracy for its size
On the Open ASR Leaderboard multilingual track, Rumble-2-Flash averages a 6.96% error rate across Chinese, German, French, Italian, Spanish, Portuguese, Hindi, Dutch and English. That's better than Meta's omniASR-LLM 7B, a model 15x larger, and ahead of Whisper large-v3. On the English track it averages 6.6% WER .
Speed
Rumble-2-Flash is also fast. Its throughput depends on how full the batches are: on the larger datasets in HF's Open ASR Leaderboard, where batches stay full, it reaches over 7,000 RTFx . That's an hour of audio in about half a second.
Real phone calls
Clean audio is easy. Phone calls are compressed and noisy, and often have speakers with very different accents. On AppTek's call-centre benchmark (302 hours of helpline calls, 14 English accents, scored with AppTek's own script), Rumble-2-Flash reaches 7.86% WER , on par with NVIDIA's Nemotron 3.5 Transcribe (30B) at 7.78%. That's well ahead of Qwen3-ASR 0.6B (8.7%), from the same model family, and close to Qwen3-ASR 1.7B (7.4%), the only model in the comparison that does better.
Try it
The weights are on the Hub at Reson8/Rumble-2-Flash . It's also available through our API .
We're very curious what you'll build with it. Tell us in the Discussions tab what you've made, what you like, and what you'd like to see changed in a next version.
Models mentioned in this article 1
Reson8/Rumble-2-Flash
Datasets mentioned in this article 1
apptek-com/apptek_callcenter_dialogues
Spaces mentioned in this article 2
Explore on‑policy distillation visualizations for any model
Open ASR Leaderboard
Explore and compare speech‑to‑text model benchmarks
More Articles from our Blog
Introducing AnySpeechRecognizer and AnyDecisionModel: Open Models for Speech and Decisions on Apple Platforms
Egyptian and Nigerian English join the Open ASR Leaderboard
Models mentioned in this article 1
Reson8/Rumble-2-Flash
Datasets mentioned in this article 1
apptek-com/apptek_callcenter_dialogues
Spaces mentioned in this article 2
Explore on‑policy distillation visualizations for any model
Open ASR Leaderboard
Explore and compare speech‑to‑text model benchmarks
AI Trends