From 76c9cb239d486615d5de9b9f45380befa5012565 Mon Sep 17 00:00:00 2001 From: Songting <112609742+Plachtaa@users.noreply.github.com> Date: Tue, 13 Jun 2023 02:49:02 +0800 Subject: [PATCH 1/2] Update LOCAL.md --- LOCAL.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/LOCAL.md b/LOCAL.md index 3008ebe..309629b 100644 --- a/LOCAL.md +++ b/LOCAL.md @@ -24,7 +24,7 @@ ``` 6. Download auxiliary data for training ``` - !mkdir pretrained_models + mkdir pretrained_models # download data for fine-tuning wget https://huggingface.co/datasets/Plachta/sampled_audio4ft/resolve/main/sampled_audio4ft_v2.zip unzip sampled_audio4ft_v2.zip @@ -103,4 +103,4 @@ 13. To clear all audio data, run: ``` rm -rf ./custom_character_voice/* ./video_data/* ./raw_audio/* ./denoised_audio/* ./segmented_character_voice/* long_character_anno.txt short_character_anno.txt - ``` \ No newline at end of file + ``` From e97b185188cfc764fc8a29dd73bfa8b07a94a494 Mon Sep 17 00:00:00 2001 From: Songting <112609742+Plachtaa@users.noreply.github.com> Date: Tue, 13 Jun 2023 02:52:15 +0800 Subject: [PATCH 2/2] Update LOCAL.md --- LOCAL.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/LOCAL.md b/LOCAL.md index 309629b..d955289 100644 --- a/LOCAL.md +++ b/LOCAL.md @@ -94,10 +94,10 @@ If not, run `python3.8 preprocess_v2.py --languages "{PRETRAINED_MODEL}"` Do replace `"{PRETRAINED_MODEL}"` with one of `{CJ, CJE, C}` according to your previous model choice. 11. Start Training. - Run `python finetune_speaker_v2.py -m "./OUTPUT_MODEL" --max_epochs "{Maximum_epochs}" --drop_speaker_embed True` + Run `python finetune_speaker_v2.py -m ./OUTPUT_MODEL --max_epochs "{Maximum_epochs}" --drop_speaker_embed True` Do replace `{Maximum_epochs}` with your desired number of epochs. Empirically, 100 or more is recommended. - To continue training on previous checkpoint, change the training command to: `python finetune_speaker_v2.py -m "./OUTPUT_MODEL" --max_epochs "{Maximum_epochs}" --drop_speaker_embed True --cont True`. Before you do this, make sure you have previous `G_latest.pth` and `D_latest.pth` under `./OUTPUT_MODEL/` directory. - To view training progress, open a new terminal and `cd` to the project root directory, run `tensorboard --logdir="./OUTPUT_MODEL"`, then visit `localhost:6006` with your web browser. + To continue training on previous checkpoint, change the training command to: `python finetune_speaker_v2.py -m ./OUTPUT_MODEL --max_epochs "{Maximum_epochs}" --drop_speaker_embed True --cont True`. Before you do this, make sure you have previous `G_latest.pth` and `D_latest.pth` under `./OUTPUT_MODEL/` directory. + To view training progress, open a new terminal and `cd` to the project root directory, run `tensorboard --logdir=./OUTPUT_MODEL`, then visit `localhost:6006` with your web browser. 12. After training is completed, you can use your model by running: `python VC_inference.py --model_dir ./OUTPUT_MODEL/G_latest.pth --share True` 13. To clear all audio data, run: