Search “Speech”

ElevenLabs launches Eleven Realtime Translation real-time speech translation model

ElevenLabs releases the real-time speech translation model Eleven Realtime Translation, currently available in alpha form to ElevenAPI enterprise customers. The model uses the low-latency speech model Eleven v4 Turbo by default, supports more than 90 languages and automatic language detection, keeps the same voice consistent across languages, and can be selected from a library of more than 17,500 voices or custom voice clones. Teams can adjust the translation startup speed, trading off between high-quality translation and low latency on complex calls; Deutsche Telekom has already built new call features based on ElevenLabs in its Magenta AI Call Assistant.

English translation is being prepared.

English translation is being prepared.

English translation is being prepared.

Mistral's Voxtral 3 launches on OpenRouter, including two speech transcription models and one speech synthesis model

OpenRouter announced that Mistral's Voxtral 3 is now available. The series includes two new speech transcription models and one new speech synthesis model, covering more than 50 languages. Mistral officially states that Voxtral 3's Transcribe and Speech models power its new voice agents API.

English translation is being prepared.

Mistral Releases Voxtral 3 Speech Model with Real-Time Speaker Diarization and Turn Detection

Mistral has released Voxtral 3, comprising the Transcribe and Speech models, to power its new voice agents API. Co-founder Arthur Mensch added that Voxtral can perform speaker diarization and end-of-turn detection on the fly, and can be deployed either on your own infrastructure or via Mistral's cloud service.

HeyGen Professional Voice Clone: Trained on 30 Minutes to 2 Hours of Audio

HeyGen's Professional Voice Clone is trained on 30 minutes to 2 hours of recorded audio, preserving breaths, pauses, laughter, accents, and vowel pronunciation. The author believes this amount of data is key: short reference clips cannot capture the rhythm of a breath before a long sentence or the accent features that emerge when speech speeds up, and these subtle irregularities are exactly what listeners use to judge whether a voice belongs to a real person. HeyGen claims no one can tell the clone apart from you.

Mistral releases the Voxtral 3 speech model series, including TTS and three transcription models

Mistral releases the Voxtral 3 speech model series, including one text-to-speech model and three speech-to-text models (Small Transcribe 3, Mini Transcribe 3, Mini Transcribe Realtime 3). Artificial Analysis evaluations show that Voxtral Small Transcribe 3 ranks 3rd on the speech-to-text leaderboard with a 2.1% AA-WER Index, ahead of ElevenLabs Scribe v2 at 2.2% and Grok Voice Transcribe 2.0 at 2.3%; Voxtral 3 TTS ranks 12th (out of 98) on the Provider Voice leaderboard with an Elo of 1,218, priced at $13/1M characters.

ElevenLabs Launches Eleven Realtime Hosted Voice Agents, Requiring Developers to Give Up Control of the Underlying Model

ElevenLabs has released Eleven Realtime, offering two hosted voice agent models, Mini and Max, which integrate speech recognition, reasoning, turn-taking, and speech generation, but developers cannot individually select or configure the underlying models. Data from external testing organization Artificial Analysis shows that Max scored 98.8% on Big Bench Audio, while Mini scored 75.9%; for tool-calling task completion, Max reached 87.1% and Mini 60.3%, while Mini slightly outperformed Max on Full-Duplex-Bench with 95.8% versus 94.1%. The interface follows the OpenAI Realtime API protocol and WebSocket transport, but only supports WebSocket; WebRTC applications must first switch transport methods and handle the capture and playback of 24kHz PCM16 audio themselves.

English translation is being prepared.

ElevenLabs Releases Two Real-Time Speech-to-Speech Models, Eleven Realtime

ElevenLabs has released two speech-to-speech models, Eleven Realtime, among which v1 Max scores 98.8% on Big Bench Audio with a response time of 0.57 seconds. The smaller v1 Mini targets low-cost natural conversation and can tell whether the other party has finished speaking or only said "mm-hmm," while v1 Max targets more complex tasks such as customer service. Both models are available through the ElevenAgents platform and the OpenAI-compatible Realtime API, billed per minute plus tokens, with v1 Max priced higher than v1 Mini.

Mistral releases Voxtral 3 transcription and speech models, powering the speech agent API

Mistral releases Voxtral 3, comprising two model types, Transcribe and Speech, which the company calls the current state of the art. These two model types are used to power Mistral's new speech agent API.

Mistral Releases the Voxtral 3 Speech Model Series, Including TTS and Three Transcription Models

Mistral has released the Voxtral 3 series, including one text-to-speech model and three speech-to-text models (Small Transcribe 3, Mini Transcribe 3, and Mini Transcribe Realtime 3). Artificial Analysis evaluations show that Voxtral Small Transcribe 3 ranks 3rd on the speech-to-text leaderboard with a 2.1% AA-WER Index, ahead of ElevenLabs Scribe v2 at 2.2% and Grok Voice Transcribe 2.0 at 2.3%; Voxtral Mini Transcribe 3 ranks 5th at 2.2%. Voxtral 3 TTS has an Elo of 1,218 in the provider voice arena, ranking 12th among 98 models, with pricing at $13/1M characters.

Vapi Hosts Fleet Week Yacht Event: Voice AI Builders Discuss GPT Live and Natural Interaction

On October 8, Vapi chartered a yacht in San Francisco Bay to host a Fleet Week event, with more than 30 voice AI builders in attendance; Deepgram, Kouper Health, and Coval led fireside chats and technical workshops. The most talked-about topic on board was GPT Live: skipping traditional transcription/synthesis can reduce latency and make conversational turn-taking smoother, but it comes at the cost of fine-grained control over key terms and scripts. The focus of discussion has shifted from "whether voice AI can converse" to "how to make conversation more natural," specifically including backchanneling, perceived latency, and measuring naturalness.

English translation is being prepared.

English translation is being prepared.

English translation is being prepared.

English translation is being prepared.

Scaled Cognition Launches Customer Service Voice Model Voice

Scaled Cognition has released Voice, a text-to-speech model that supports more than 25 languages and voice cloning, and can be accessed via API or deployed self-hosted. It focuses on accurately reading aloud details such as account numbers and addresses. Managed API pricing is $9 per million characters, while self-hosting costs $1 per million characters (excluding infrastructure). The company says that at a scale of 5 million characters, including infrastructure, the cost is about $13 per million characters, and it claims a speech generation latency of 70 milliseconds. Voice's Smart Pronunciation capability first determines the meaning of abbreviations and numbers before generating audio—for example, reading "Pay 1/2 by 1/2" as "pay half by January second"—and it can run without relying on APT or other large language models.