Google DeepMind 发布 SL2T 手语转文本模型,率先落地 Gboard 与 Live Transcribe
Google DeepMind 发布多语种手语转文本模型 SL2T,并在 Pixel 11 的 Gboard 和 Live Transcribe 中上线手语听写功能,首批支持美国手语(ASL)转英文。该模型基于超过 50 种手语、逾 10 万小时数据训练,其中约四分之一为 ASL 数据,在 FLEURS-ASL(sd-test)上取得 70 BLEURT 的零样本成绩。为保护隐私,模型只接收 MediaPipe Holistic 在端侧提取的姿态关键点坐标,原始视频随即丢弃,并跳过 gloss 标注直接翻译为文本。
anslates complex ASL into fluent English. Occasional errors remain in rare signs, rapid fingerspelling ("prey" → "grey"), passive constructions, classifier depictions (dropping "claws"), and tense without context ("kicked off" → "start"). We believe in building with the Deaf community, not just for it. Deaf perspectives have shaped every stage of this project — from conceptualization by Sam Sepah, a Deaf Googler, to data collection with Deaf partners, evaluation in Deaf user studies, and impact
匹配字段正文





