GMM training result after 200 epoch looks worse than the pretrain model

[thotd21]

I add some new cloth and do training step 1 (using your provided data pairs dataset/data_pair.txt) with the following cmd: python train.py --train_mode gmm .
After 200 epochs, I used generated model at the path below: net_model/gmm_checkpoint/generator/checkpoint_G_epoch_199.tar as input value for "--resume_gmm" option when run demo.py.
I got the following result:

(The bottom 2 rows are for the new clothes I added)
The red circled area has different results than the pretrain model

So I have some questions:

1. This is right way to use new-train GMM model?
2. Which train options should I use to re-produce the result as mentioned in the paper?
3. How many epochs did you run on each training step (GMM, Parsing, Appearance) ?
4. Did I have any mistake on GMM training?

[AIprogrammer]

1. I didn't find something wrong from your description.
2. You can directly retrain the model following the guidance in the train.sh step by step.
3. The default training epoch is 200, but emperically GMM model optimizes more quickly. The difference in the red circle is mainly caused by GMM and parsing transformation part. You can train this part for more iterations to find out if it can be better.
4. Our training procedure of GMM is similar to VITON and CPVTON, which your can refer to for more details of this part.

[iamrishab]

Hi @AIprogrammer
Thank you for sharing this great work!
Can you please confirm one thing that after we train individual components in the model before end-to-end step as mentioned in the paper, do we need to move the previous checkpoints to the pretrained directory or we just need to run the train.sh, and it does what's all required? tia.
Also which checkpoints to use after running the train.sh?

[iamrishab]

Never-mind. I figured it out. Thanks!

[jlakhan1010]

@iamrishab , I am facinng same issue. Actually I am trying for downcloths. I trained model on sample dataset (40 images) and changes --resume checkpoints as:
resume_gmm = "pretrained_checkpoint/step_009000.pth"
resume_G_parse = '/content/drive/MyDrive/Down-to-the-Last-Detail-Virtual-Try-on-with-Detail-Carving/net_model/parsing_checkpoint/generator/checkpoint_G_epoch_12_loss_3.80623_pth.tar'
resume_G_app_cpvton = '/content/drive/MyDrive/Down-to-the-Last-Detail-Virtual-Try-on-with-Detail-Carving/net_model/joint_checkpoint/generator_appearance/checkpoint_G_epoch_12_loss_4.16898_pth.tar'
resume_G_face = '/content/drive/MyDrive/Down-to-the-Last-Detail-Virtual-Try-on-with-Detail-Carving/net_model/face_checkpoint/generator/checkpoint_G_epoch_12_loss_1.54948_pth.tar'

But My results are completly blank.

Please help me.
Thanks in advance