What to do with partial faces (cut off by frame edge)?

Want to know about the Faceswap's Face Extraction process? Got tips, ideas or just want to learn about how it all works? Then this is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved for Extracting and preparing face sets for training a model in Faceswap.

If you have found a bug are having issues with the Extraction process not working, then you should post in the Extract Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
Replicon
Posts: 50
Joined: Mon Mar 22, 2021 4:24 pm
Been thanked: 2 times

What to do with partial faces (cut off by frame edge)?

Post by Replicon »

Some clips might have faces going partially out of frame, where maybe only the bottom half of the face is visible for a little while.

Are those frames still usable for anything?

If I had to guess: Usable for convert (it can still generate the face and map it, and it ought to show up properly in the final product), but not usable for training (unless it knows to ignore the landmarks that are out of the frame and can still use the partial face to train the model, as long as there are full faces in there too).

I figure this is different from obstructions, since "out-of-frame landmark" doesn't require state-of-the-art NN technology to figure out, like with obstructions. :)

So... for the A video, is it worth at least sliding a bounding box around until the in-frame landmarks are aligned? If so, should I be including those in the alignments used for training, or excluding them, to avoid muddying the waters?

User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: What to do with partial faces (cut off by frame edge)?

Post by torzdf »

I tend to keep any in which crop above the eyes, but discard others. As long as there aren't too many of them, it shouldn't matter too much.

My word is final

Locked