Baseten 上线 Gradium TTS:TTFA 快于人类语音响应
Gradium TTS 已在 Baseten Model Library 以专用部署形式上线,面向实时语音智能体,其 TTFA 快于人类语音响应时间。在 Coval TTS 基准(截至 2026 年 9 月)上,Gradium TTS 中位 TTFA 为 214 ms。该模型采用 Kyutai 的 Delayed Streams Modeling 架构,以 80 ms 帧对齐文本与音频流,并通过 kernel fusion 与 CUDA Graphs 优化 GPU,官方基准显示启用 CUDA Graphs 后小批量下中位 TTFA 降低超过 2.5 倍。

pike. Autoscaling resolves this, but a new replica can't serve calls until its model weights are loaded into GPU memory. Weights are typically pulled from upstream sources such as Hugging Face or S3, where rate limits and cross-region latency stretch cold starts further, especially when many replicas request the same files at once. The Baseten Delivery Network (BDN) reduces cold start time in three ways: Push-time mirroring: At deploy time, BDN copies the model's weights into Baseten-managed sto
匹配字段正文
