Page 1 of 1

Question about the conversion process - alignments versus pixels - need to understand

Posted: Thu Nov 10, 2022 11:02 pm
by martinf

Does the alignment file simply tell the model where to find the face, then the model analyzes the pixels for the swap... or are the alignments playing a larger role in the swap process? Ie., Does the model look to the alignments for the face generation or only to the underlying video... after the alignments tell it where to find faces?

I ask because there are clearly nuances in facial expressions that are not part of the alignments, leading me to believe that the alignments only serve as a direction as to where to find a face. Or is it a combination?


Re: Question about the conversion process - alignments versus pixels - need to understand

Posted: Fri Nov 11, 2022 9:34 am
by torzdf

It's more complicated than you are saying, but yes the alignments file tells the process where the faces are,

It specifically uses the landmarks to do some complicated mathematics to crop the faces from each image and align them before processing through the model, then reversing the process to put the swapped face back in the frame.