Voxtral Mini Transcribe 3 ranks second on the Voice Arena speaker diarization leaderboard

🚀 Mistral AI’s Voxtral Mini Transcribe 3 ranks #2 out of 9 models by DER on Voice Arena’s Diarization + ASR leaderboard, outperforming its larger counterpart. Following the launch of Mistral’s new Voxtral 3 family, we evaluated its Mini and Small transcription models on Voice Arena’s Diarization Bench. 🥈 Voxtral Mini Transcribe 3: 40.4% DER (#2) Voxtral Small Transcribe 3: 41.1% DER (#4) Both models were tested on 139 held-out conversations under identical conditions, using human-verified references, a strict 0 ms collar, and no predefined speaker counts or audio cleanup. Mini leads on in-person conversations (40.6% vs. 41.5%), while Small performs slightly better on online calls (39.1% vs. 39.5%). Overlapping speech remains the biggest challenge. Missed speech accounts for 82% of Mini's total DER. Both models correctly identify the exact number of speakers in 83.5% of sessions. Congratulations to @MistralAI on the release ! 👏 View complete track & condition breakdown: https://t.co/sLGwgH3EWt

View original

🚀 Mistral AI’s Voxtral Mini Transcribe 3 ranks #2 out of 9 models by DER on Voice Arena’s Diarization + ASR leaderboard, outperforming its larger counterpart. Following the launch of Mistral’s new Voxtral 3 family, we evaluated its Mini and Small transcription models on Voice Arena’s Diarization Bench. 🥈 Voxtral Mini Transcribe 3: 40.4% DER (#2) Voxtral Small Transcribe 3: 41.1% DER (#4) Both models were tested on 139 held-out conversations under identical conditions, using human-verified references, a strict 0 ms collar, and no predefined speaker counts or audio cleanup. Mini leads on in-person conversations (40.6% vs. 41.5%), while Small performs slightly better on online calls (39.1% vs. 39.5%). Overlapping speech remains the biggest challenge. Missed speech accounts for 82% of Mini's total DER. Both models correctly identify the exact number of speakers in 83.5% of sessions. Congratulations to @MistralAI on the release ! 👏 View complete track & condition breakdown: https://t.co/sLGwgH3EWt