Faceswap putting open eyes over closed eyes when target blinks

Training your model
Forum rules
Read the FAQs and search the forum before posting a new topic.

Please mark any answers that fixed your problems so others can find the solutions.
Post Reply
User avatar
Nightwatch
Posts: 2
Joined: Wed May 06, 2020 2:38 pm

Faceswap putting open eyes over closed eyes when target blinks

Post by Nightwatch » Sun May 24, 2020 4:36 am

While training I've noticed the program keeps trying to put the open eyes of the face I'm using over the closed eyes of the body I'm swapping it onto when the person blinks......Which is odd because both source face & source body are videos in which both subjects are blinking.

It's like it can't ..... Sync' the blink...

Is it just a case of .. Just let it go & it will eventually correct its self or is there something I can do ??

User avatar
bryanlyon
Site Admin
Posts: 274
Joined: Fri Jul 12, 2019 12:49 am
Answers: 20
Location: San Francisco
Has thanked: 3 times
Been thanked: 77 times
Contact:

Re: Faceswap putting open eyes over closed eyes when target blinks

Post by bryanlyon » Sun May 24, 2020 6:40 am

If you want to get the blinks you can. Just find a few blinks for your A and B sets, and extract just the blinks at EEN=1 and do a fit train with those. That'll teach the model how to blink. After that, you can probably go back to standard training but might want to leave the blink faces in to make sure that stays learned.

Post Reply