Swap is smiling when A source video is straight faced

Want to understand the training process better? Got tips for which model to use and when? This is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved with Training a Faceswap model.

If you have found a bug are having issues with the Training process not working, then you should post in the Training Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
CProdDigital
Posts: 14
Joined: Fri Nov 04, 2022 4:22 pm
Has thanked: 1 time

Swap is smiling when A source video is straight faced

Post by CProdDigital »

The swapped video has B face with a big toothy smile when A face is deadpan. Alot of the pictures for B Face are smiling, but there is reference of them with a straight face from multiple angles. How can I tell the AI no thats incorrect, this is the correct face?

User avatar
torzdf
Posts: 2672
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 131 times
Been thanked: 625 times

Re: Swap is smiling when A source video is straight faced

Post by torzdf »

You can only control how the AI learns through data. If you give the AI lots of smiling faces for one side (particularly problematic when the source is a lot of posed photographs) then this is what the AI will learn.

I feel I'm repeating myself here, but data variety is key.

reminder:
Image

My word is final

Locked