Repository files navigation

This repository is forked fromReal-Time-Voice-Cloning which only support English.

English |中文

🌍Chinese supported mandarin and tested with multiple datasets: aidatatang_200zh, magicdata

🤩PyTorch worked for pytorch, tested in version of 1.9.0(latest in August 2021), with GPU Tesla T4 and GTX 2060

🌍Windows + Linux tested in both Windows OS and linux OS after fixing nits

🤩Easy & Awesome effect with only newly-trained synthesizer, by reusing the pretrained encoder/vocoder

Follow the original repo to test if you got all environment ready.**Python 3.7 or higher ** is needed to run the toolbox.

• InstallPyTorch.

If you get anERROR: Could not find a version that satisfies the requirement torch==1.9.0+cu102 (from versions: 0.1.2, 0.1.2.post1, 0.1.2.post2 ) This error is probably due to a low version of python, try using 3.9 and it will install successfully

• Installffmpeg.
• Runpip install -r requirements.txt to install the remaining necessary packages.

Note that we are using the pretrained encoder/vocoder but synthesizer, since the original model is incompatible with the Chinese sympols. It means the demo_cli is not working at this moment.

• Download aidatatang_200zh or SLR68 dataset and unzip: make sure you can access all .wav intrain folder

• Preprocess with the audios and the mel spectrograms:python synthesizer_preprocess_audio.py <datasets_root>Allow parameter--dataset {dataset} to support adatatang_200zh, magicdata

• Preprocess the embeddings:python synthesizer_preprocess_embeds.py <datasets_root>/SV2TTS/synthesizer

• Train the synthesizer:python synthesizer_train.py mandarin <datasets_root>/SV2TTS/synthesizer

• Go to next step when you see attention line show and loss meet your need in training foldersynthesizer/saved_models/.

FYI, my attention came after 18k steps and loss became lower than 0.4 after 50k steps.

Thanks to the community, some models will be shared:

A link to my early trained model:Baidu YunCode：aid4

You can then try the toolbox:

python demo_toolbox.py -d <datasets_root>
or
python demo_toolbox.py

Good news🤩: Chinese Characters are supported

• Add demo video
• Add support for more dataset
• Upload pretrained model
• Support parallel tacotron
• Service orianted and docterize
• 🙏 Welcome to add more