FireRedTeam 开源 LLM 驱动的 TTS 基础系统 FireRedTTS

FireRedTeam; FireRedTTS

Repository navigation

NotificationsYou must be signed in to change notification settings; Fork86 (86); Star923 (923)You must be signed in to star a repository

Repository files navigation

⚠️ Note: The current branch is FireRedtts-1s. To access FireRedtts-1, please switch to the FireRedtts-1 branch

[2025/05/26] 🔥 We add flow-mathing decoder and update the technical report; [2025/03/25] 🔥 We release the technical report and project page

Roadmap

2025/04

Release the pre-trained checkpoints and inference code

Download the required model files from Model_Lists and place them in the folder pretrained_models

Basic Usage

Tips

The reference audio should not be too long or too short; a duration of 3 to 10 seconds is recommended; The reference audio should be smooth and natural, and the accompanying text must be accurate to enhance the stability and naturalness of the synthesized audio

Acknowledgements

Tortoise-tts and XTTS-v2 offer invaluable insights for constructing an autoregressive-style system; We referred to fish-speech text tokenizer solution; We referred to BigCodec speech codec solution; We referred to Encodec causal convolution solution; We referred to SpeechBrain ECAPA-TDNN solution; We referred to ChineseSpeechPretrain HuBERT model

⚠️ Usage Disclaimer ❗️❗️❗️❗️❗️❗️

The project incorporates zero-shot voice cloning functionality; Please note that this capability is intended solely for academic research purposes; DO NOT use this model for ANY illegal activities❗️❗️❗️❗️❗️❗️; The developers assume no liability for any misuse of this model; If you identify any instances of abuse, misuse, or fraudulent activities related to this project, please report them to our team immediately