Voice Arena TTS leaderboard adds five languages, ElevenLabs tops all
Voice Arena's TTS leaderboard has added five languages: French, German, Indonesian, Tagalog, and Indian English. ElevenLabs ranks first on all five leaderboards, leading the best models from other vendors by 11 to 26 Elo points. Eleven v4 Turbo tops four of the leaderboards, while on the Indonesian leaderboard Eleven v4 ranks first and Eleven v4 Turbo second. The leaderboard uses audited native-speaker blind listening to two audio clips for voting, then converts to rankings using Bradley-Terry.
View original postIntroducing five new languages on the Voice Arena TTS leaderboard. Models from @ElevenLabs rank #1 on all five of the new Voice Arena TTS leaderboards: French 🇫🇷, German 🇩🇪, Bahasa 🇮🇩, Tagalog 🇵🇭 and Indian English 🇮🇳. Eleven v4 Turbo takes the top position on four of the five boards. On Bahasa, ElevenLabs holds both #1 and #2, with Eleven v4 first and Eleven v4 Turbo second. Across five languages spanning Europe, Southeast Asia and South Asia, each judged only by native listeners, ElevenLabs finishes first on every board, ahead of the next-best model from another provider by 11 to 26 Elo points. Voice Arena ranks models through blind, head-to-head votes by vetted native speakers, scored with Bradley-Terry Elo. Board-by-board results below 🧵
View original
Introducing five new languages on the Voice Arena TTS leaderboard. Models from @ElevenLabs rank #1 on all five of the new Voice Arena TTS leaderboards: French 🇫🇷, German 🇩🇪, Bahasa 🇮🇩, Tagalog 🇵🇭 and Indian English 🇮🇳. Eleven v4 Turbo takes the top position on four of the five boards. On Bahasa, ElevenLabs holds both #1 and #2, with Eleven v4 first and Eleven v4 Turbo second. Across five languages spanning Europe, Southeast Asia and South Asia, each judged only by native listeners, ElevenLabs finishes first on every board, ahead of the next-best model from another provider by 11 to 26 Elo points. Voice Arena ranks models through blind, head-to-head votes by vetted native speakers, scored with Bradley-Terry Elo. Board-by-board results below 🧵
Body
On this benchmark by @voicearena_ai, speech models (TTS) are ranked much the way you’d test a voice with a friend: play two clips, ask which one sounds right.
And now Voice Arena ranks TTS models using only Native-speaker-only voting. So e.g. Indian English now has its own TTS leaderboard, judged by people who speak it every day.
They score it the same way as its other language boards: vetted native listeners vote blind between two clips, and Bradley-Terry turns those votes into a ranking.
They have also added French, German, Tagalog and Bahasa to its TTS leaderboard, and ElevenLabs ranks first on all 5 boards.