ElevenLabs releases the Eleven Realtime v1 speech-to-speech model

Zhi Dongxi

ElevenLabs Releases Eleven Realtime Real-Time Voice Model, Hands-On Test of Voice-Built Agent

On October 20, ElevenLabs released the Eleven Realtime series of real-time voice models, including v1 Mini for natural conversation and v1 Max for customer service and multi-step tasks, supporting more than 90 languages and 17,000 voices. According to Artificial Analysis testing, Max achieved 98.8% accuracy on the Big Bench Audio voice reasoning benchmark, ranking third, with an average first audio response time of 0.57 seconds, while Mini was 0.62 seconds. Both models can be used through the ElevenAgents platform or the Realtime API compatible with the OpenAI Realtime specification, and currently only support WebSocket connections; Zhi Dongxi's hands-on test found that its Architect building assistant can modify Agent settings by voice, but the Chinese accent is noticeable, responses tend to be long, and latency is relatively high.

Phoenix Technology

ElevenLabs Releases Eleven Realtime v1 Mini and Max Real-Time Speech Models

On October 20, ElevenLabs released the Eleven Realtime series of real-time speech models, including v1 Mini for natural conversation and v1 Max for customer service and multi-step tasks, both supporting more than 90 languages and 17,000 voices. According to Artificial Analysis testing, Max achieved 98.8% accuracy on the Big Bench Audio speech reasoning benchmark, ranking third, with an average time to first audio response of 0.57 seconds, while Mini achieved 75.9% accuracy and 0.62-second response time. Both models can be used through the ElevenAgents platform or the Realtime API compatible with the OpenAI Realtime specification, and currently only support WebSocket connections; in the author's hands-on test, when building an assistant with Architect, the Chinese accent was noticeable, responses tended to be long, and latency was relatively high.

testingcatalog

English translation is being prepared.

testingcatalog

English translation is being prepared.

analytics_india_magazine

English translation is being prepared.

The Decoder

ElevenLabs Releases Two Real-Time Speech-to-Speech Models, Eleven Realtime

ElevenLabs has released two speech-to-speech models, Eleven Realtime, among which v1 Max scores 98.8% on Big Bench Audio with a response time of 0.57 seconds. The smaller v1 Mini targets low-cost natural conversation and can tell whether the other party has finished speaking or only said "mm-hmm," while v1 Max targets more complex tasks such as customer service. Both models are available through the ElevenAgents platform and the OpenAI-compatible Realtime API, billed per minute plus tokens, with v1 Max priced higher than v1 Mini.

The New Stack

ElevenLabs Launches Eleven Realtime Hosted Voice Agents, Requiring Developers to Give Up Control of the Underlying Model

ElevenLabs has released Eleven Realtime, offering two hosted voice agent models, Mini and Max, which integrate speech recognition, reasoning, turn-taking, and speech generation, but developers cannot individually select or configure the underlying models. Data from external testing organization Artificial Analysis shows that Max scored 98.8% on Big Bench Audio, while Mini scored 75.9%; for tool-calling task completion, Max reached 87.1% and Mini 60.3%, while Mini slightly outperformed Max on Full-Duplex-Bench with 95.8% versus 94.1%. The interface follows the OpenAI Realtime API protocol and WebSocket transport, but only supports WebSocket; WebRTC applications must first switch transport methods and handle the capture and playback of 24kHz PCM16 audio themselves.

elevenlabs_blogFirst-partySelected

English translation is being prepared.