Landmark accuracy

Want to know about the Faceswap's Face Extraction process? Got tips, ideas or just want to learn about how it all works? Then this is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved for Extracting and preparing face sets for training a model in Faceswap.

If you have found a bug are having issues with the Extraction process not working, then you should post in the Extract Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
gravitation
Posts: 15
Joined: Fri May 07, 2021 6:14 am
Has thanked: 10 times
Been thanked: 1 time

Landmark accuracy

Post by gravitation »

Am I correct to assume that for faces with obstructions, the landmark points “behind” the obstruction are completely irrelevant? This is all assuming that your mask is setup to ignore that area. So I don’t need to bother about setting up the points to represent what the structure of the face looks like behind obstructions?

User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: Landmark accuracy

Post by torzdf »

No they are not. The extracted face is "aligned" based on the position of the face landmarks. Ideally the landmarks will appear in the correct position as if the face were to be fully visible.

My word is final

User avatar
ProducerV
Posts: 3
Joined: Sun Aug 08, 2021 1:36 pm
Has thanked: 7 times

Re: Landmark accuracy

Post by ProducerV »

How then can we handle landmarks that are thrown off by an arm moving in front of the face?

Generally when you move the landmark box around, tighten the points to the temples and chin, the FAN aligner does a really good job of finding a face. But when an obstruction moves in, the alignment points go all crazy - and you end up with the mouth alignments randomly shooting all over the place.

This is also the case when a face is in profile: sometimes it will find an eye brow, maybe an eye, but generally the whole things just goes nuts.

  • It would be create if there was a way to delete certain landmarks - thus telling the system to not worry about that part of the face.

Anyways, any suggestions would be appreciated!

User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: Landmark accuracy

Post by torzdf »

Yeah, it doesn't deal with obstructions well. Normally copying alignments from previous or next face and then moving the extract box is enough to remedy this.

My word is final

Locked