Page 1 of 1

how to use pretraining?

Posted: Tue Jun 02, 2020 3:13 pm
by park

Hello,

I'm a student studying faceswap.
Through [Tip] Training best practices, I learned about pretraining/model.

I want to know about pretraining,
but nobody uses it, do there is no guide.

So if you are okay,
can you tell me how to use pretraining?


Re: how to use pretraining?

Posted: Wed Jun 03, 2020 9:21 am
by torzdf

I'm personally of the opinion that pre-training offers little to no benefit.

The basic concept is to start training a model on lots of random faces so it learns what a face is, prior to moving over to your actual training set.


Re: how to use pretraining?

Posted: Wed Jun 03, 2020 9:30 am
by park

I know from your post that this method is not good.

But I just want to know about various methods for pretraining.


Re: how to use pretraining?

Posted: Wed Jun 03, 2020 9:45 am
by torzdf

Unfortunately I'm not the person to ask. Hopefully [mention]bryanlyon[/mention], or someone who uses it will be along to offer some tips.


Re: how to use pretraining?

Posted: Wed Jun 03, 2020 6:46 pm
by bryanlyon

Pretraining is where you train the model with other faces before you try to train it for your original and swap faces. That's all pretraining is, however, we do not recommend it since it damages the model's ability to focus on a single identity swap.