Blogger plans to run Ming-3.0-tts locally as a reading and dubbing assistant
English text is being prepared.
The blogger plans to run the 0.5B Ming-3.0-tts voice synthesis and cloning model locally, to make a book-reading assistant for his son and German dubbing for videos. The reading assistant supports reading through the whole text and giving prompts at pauses or in specified areas; the dubbing solution combines ASR and multimodal video understanding to generate German dubbing and synchronize it with the visuals. He plans to put it into daily use in a week and open-source it.
View original postHave you guys seen Tan Tan Traffic? This show is hilarious, but honestly, a lot of the dialogue in it is hard to understand, like the one where a Fujian driver is looking for a hospital. I've always wanted to know what this Fujian guy is actually saying, and whether his friend's translation is correct. Now it's sorted: the Ming-3.0 speech series models are here and solved my problem. You can try them too! https://t.co/8Uy7ByTFmk
View original
看过谭谭交通么兄弟们，这个节目很搞笑，但是说话实说里边很多对话不是很能听懂，比如福建司机找医院这个。我一直想知道，这个福建人，到底说的是什么，他朋友的翻译到底对不对。现在好了，Ming-3.0语音系列模型来了，解决了我的问题，你们也可以去试试！ https://t.co/8Uy7ByTFmk
Body
Ming-3.0-tts 这个 0.5B 的声音合成和克隆模型，我想试试，因为它够小，我想本地跑！
最近在给我儿子的学习做一些 AI 辅助，前面开源的打字游戏算是第一步（看我置顶帖）： https://t.co/B18Nghv5fI
接下来想做一些书籍阅读和视频配音的尝试，他现在已经从绘本来到了文字书籍的阅读阶段，听力语感和发音都很好，不过有些词它不认识，我想给它做一个书籍阅读助手，可以全篇通读、也可以在停顿时或指定区域阅读提示。
视频配音是因为平时看的视频多数都是英文视频，他在学德语时的资源就比较有限，有些他想看的视频如果有德语就好了，现在有这种可以本地跑的 TTS，结合 ASR、多模态模型的视频理解等能力，就可以把配音生成为德语，再和画面进行匹配同步了。
说干就干，立个 Flag，一周后投入日常学习，到时老规矩，开源出来！