Page 1 of 1

Faceswap putting open eyes over closed eyes when target blinks

Posted: Sun May 24, 2020 4:36 am
by Nightwatch

While training I've noticed the program keeps trying to put the open eyes of the face I'm using over the closed eyes of the body I'm swapping it onto when the person blinks......Which is odd because both source face & source body are videos in which both subjects are blinking.

It's like it can't ..... Sync' the blink...

Is it just a case of .. Just let it go & it will eventually correct its self or is there something I can do ??


Re: Faceswap putting open eyes over closed eyes when target blinks

Posted: Sun May 24, 2020 6:40 am
by bryanlyon

If you want to get the blinks you can. Just find a few blinks for your A and B sets, and extract just the blinks at EEN=1 and do a fit train with those. That'll teach the model how to blink. After that, you can probably go back to standard training but might want to leave the blink faces in to make sure that stays learned.


Re: Faceswap putting open eyes over closed eyes when target blinks

Posted: Sun May 31, 2020 2:30 pm
by Nightwatch

O.k. ... Did as you suggested and it seemed to work....All the eyes closed shots actually had closed eyes....Then I re-added all the frames & faces with the closed eyes back into their respective extracted images folders & resumed training.......IT WENT BACKWARDS .... It seems to have literally re-opened all the eyes ??


Re: Faceswap putting open eyes over closed eyes when target blinks

Posted: Mon Jun 01, 2020 5:24 am
by bryanlyon

Yeah, sounds like it's not enough closed eyes in your source data. Keep that in mind for the end of your training when you do your fit training.