Got questions or tips about the Conversion process? This is the place to discuss them.
Read the FAQs and search the forum before posting a new topic.
This forum is for discussing tips and understanding the process involved with Converting faces from your trained model.
If you are having issues with the Convert process not working as you would expect, then you should post in the Convert Support forum.
Please mark any answers that fixed your problems so others can find the solutions.
- Posts: 27
- Joined: Thu Sep 29, 2022 7:58 pm
- Been thanked: 2 times
Does the alignment file simply tell the model where to find the face, then the model analyzes the pixels for the swap... or are the alignments playing a larger role in the swap process? Ie., Does the model look to the alignments for the face generation or only to the underlying video... after the alignments tell it where to find faces?
I ask because there are clearly nuances in facial expressions that are not part of the alignments, leading me to believe that the alignments only serve as a direction as to where to find a face. Or is it a combination?
- Posts: 2112
- Joined: Fri Jul 12, 2019 12:53 am
- Has thanked: 101 times
- Been thanked: 476 times
It's more complicated than you are saying, but yes the alignments file tells the process where the faces are,
It specifically uses the landmarks to do some complicated mathematics to crop the faces from each image and align them before processing through the model, then reversing the process to put the swapped face back in the frame.