is this good?

Want to understand the training process better? Got tips for which model to use and when? This is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved with Training a Faceswap model.

If you have found a bug are having issues with the Training process not working, then you should post in the Training Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
siliconunit
Posts: 8
Joined: Sun Feb 16, 2020 11:26 am
Has thanked: 1 time

is this good?

Post by siliconunit »

Hello,

I was wondering if this looks like it's converging correctly... I'm using villain, around 40k iterations... is the blurriness reasonable or it should be 100% sharp? Thanks!

faceswp.jpg
faceswp.jpg (93.7 KiB) Viewed 7458 times
by bryanlyon » Tue Feb 18, 2020 9:20 pm

Blurriness at 40k is perfectly normal. Especially with Villain. You'll want to keep training. My only suggestion is that due to one side being black and white, and the other side being partial, you're going to see some color leakage. Not a problem if you're aware of it. You could always turn the whole B set B&W if you want to keep it black and white.

Go to full post
User avatar
bryanlyon
Site Admin
Posts: 793
Joined: Fri Jul 12, 2019 12:49 am
Answers: 44
Location: San Francisco
Has thanked: 4 times
Been thanked: 218 times
Contact:

Re: is this good?

Post by bryanlyon »

Blurriness at 40k is perfectly normal. Especially with Villain. You'll want to keep training. My only suggestion is that due to one side being black and white, and the other side being partial, you're going to see some color leakage. Not a problem if you're aware of it. You could always turn the whole B set B&W if you want to keep it black and white.

User avatar
siliconunit
Posts: 8
Joined: Sun Feb 16, 2020 11:26 am
Has thanked: 1 time

Re: is this good?

Post by siliconunit »

Thanks for the info!, do you reckon Villain is the way to go for max quality? around how many iterations?

SU

User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: is this good?

Post by torzdf »

I would say so.

It took me 10 days to train a Villain model to convergence on a GTX 1080

My word is final

User avatar
bryanlyon
Site Admin
Posts: 793
Joined: Fri Jul 12, 2019 12:49 am
Answers: 44
Location: San Francisco
Has thanked: 4 times
Been thanked: 218 times
Contact:

Re: is this good?

Post by bryanlyon »

Depending on your data and needs, Villain starts to converge somewhere around 300k-500k.

User avatar
siliconunit
Posts: 8
Joined: Sun Feb 16, 2020 11:26 am
Has thanked: 1 time

Re: is this good?

Post by siliconunit »

faceswp2.jpg
faceswp2.jpg (142.48 KiB) Viewed 7448 times

Any anomaly?

User avatar
bryanlyon
Site Admin
Posts: 793
Joined: Fri Jul 12, 2019 12:49 am
Answers: 44
Location: San Francisco
Has thanked: 4 times
Been thanked: 218 times
Contact:

Re: is this good?

Post by bryanlyon »

Nope. All good.

User avatar
siliconunit
Posts: 8
Joined: Sun Feb 16, 2020 11:26 am
Has thanked: 1 time

Re: is this good?

Post by siliconunit »

Oh I see! so multi days stuff :) fair enough!

User avatar
siliconunit
Posts: 8
Joined: Sun Feb 16, 2020 11:26 am
Has thanked: 1 time

Re: is this good?

Post by siliconunit »

One thing I noticed is that when I start training I get a red message:
Setting Faceswap backend to NVIDIA
02/18/2020 22:11:56 INFO Log level set to: INFO
Using TensorFlow backend. -> in red.
my EGs/s are around 6...
I've got 1070gtx.

User avatar
SwarmTogether
Posts: 12
Joined: Sat Nov 30, 2019 2:28 pm
Has thanked: 8 times
Been thanked: 1 time

Re: is this good?

Post by SwarmTogether »

I've read that Villain favors B so:
during Training I exchange the Faces: Input A and Alignment A for Input B and Alignment B and then,
during Conversion set all inputs as your intended goal but scroll down and select the Swap Model checkbox.

I can start Villain on batches of 10, but after a few hundred iterations I bump the batches up to 14.

I start on an extended mask training at 100% Face Coverage for about 50k iterations, if I like the previews. Then I might bump the Face Coverage slider down to 95% for another 50k iterations, 90% for 50k.

After that I might decrease the Optimizer Learning rate by half a decimal once or twice, to 4.5e-5 then later to 4e-5 as I also continue to tighten the Face Coverage percentage.

I get good enough results from YouTube videos for hobbyist fun!

User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: is this good?

Post by torzdf »

siliconunit wrote: Tue Feb 18, 2020 10:15 pm

One thing I noticed is that when I start training I get a red message:
Setting Faceswap backend to NVIDIA
02/18/2020 22:11:56 INFO Log level set to: INFO
Using TensorFlow backend. -> in red.
my EGs/s are around 6...
I've got 1070gtx.

That Red is fine. It's just because Keras outputs the backend information to stderr, which the GUI auto formats as red.

My word is final

User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: is this good?

Post by torzdf »

SwarmTogether wrote: Sun Feb 23, 2020 12:32 pm

I've read that Villain favors B so:
during Training I exchange the Faces: Input A and Alignment A for Input B and Alignment B and then,
during Conversion set all inputs as your intended goal but scroll down and select the Swap Model checkbox.

Villain is a balanced model, so has no bias towards A or B. These steps are not necessary.

SwarmTogether wrote: Sun Feb 23, 2020 12:32 pm

I start on an extended mask training at 100% Face Coverage for about 50k iterations, if I like the previews. Then I might bump the Face Coverage slider down to 95% for another 50k iterations, 90% for 50k.

If you aren't deleting your model and starting again, then this will have no effect. Coverage is fixed when the model is created.

My word is final

User avatar
SwarmTogether
Posts: 12
Joined: Sat Nov 30, 2019 2:28 pm
Has thanked: 8 times
Been thanked: 1 time

Re: is this good?

Post by SwarmTogether »

torzdf wrote: Sun Feb 23, 2020 1:03 pm
SwarmTogether wrote: Sun Feb 23, 2020 12:32 pm

I've read that Villain favors B so:
during Training I exchange the Faces: Input A and Alignment A for Input B and Alignment B and then,
during Conversion set all inputs as your intended goal but scroll down and select the Swap Model checkbox.

Villain is a balanced model, so has no bias towards A or B. These steps are not necessary.

SwarmTogether wrote: Sun Feb 23, 2020 12:32 pm

I start on an extended mask training at 100% Face Coverage for about 50k iterations, if I like the previews. Then I might bump the Face Coverage slider down to 95% for another 50k iterations, 90% for 50k.

If you aren't deleting your model and starting again, then this will have no effect. Coverage is fixed when the model is created.

Thank you! Don't know where I read about those pointless practices, thanks for the correction!

Locked