←新闻详情

Rohan Paul更新于 10月30日 14:30

Joy 发布 10 万小时双轨真实对话数据集,覆盖 10 种语言

Unscripted calls are hard to collect at scale.

AI 导读

Shobhit Banga 发布双轨对话数据集 Joy,包含 10 万小时真实、非脚本化的双人对话,每人在独立音轨,覆盖 5 万名说话人和 10 种语言。Rohan Paul 指出,当前语音 AI 主要用 LLM 编写、TTS 朗读的虚假对话训练,听不到人们互相抢话,他对这些对话如何维持 10 到 20 分钟感到好奇。

推荐理由

AI 评分 58

语音模型长期依赖合成对话训练,这个数据集用真实双人对话补上了重叠说话等场景的缺口。

主题

标签

引用

Shobhit Banga

@shobhitbanga

第 1/15 期:隆重推出 Joy,一个双声道对话数据集。 两个人之间真实、非脚本化的对话,每人各占一条音轨。旨在教会语音模型人们实际是如何交谈的:何时倾听、何时插话、何时说“嗯”。 10 万小时。 5 万名说话人。 10 种语言。

查看原文

Drop 1/15: Introducing Joy, a dual-channel conversational dataset. Real, unscripted conversations between two people, each on their own track. Built to teach voice models how people actually talk: when to listen, when to jump in, when to say “hmm”. 100,000 hours. 50,000 speakers. 10 languages.

查看原帖

正文

Unscripted calls are hard to collect at scale. Voice AI today mostly learns from fake dialogue written by LLMs and read aloud by TTS, so it never hears people talking over each other;

Really curious how they kept the conversations going for 10 to 20 minutes.

They released Joy, a 100,000 hours of unscripted, two-person conversation across 10 languages

https://t.co/KFRib2aMI6

来源

Rohan Paul