Can faceswap be used to swap specific features such as ONLY eyes/nose/mouth?

Discussions about research, Faceswapping and things that don't fit in the other categories here.


Locked
User avatar
deathb4honor
Posts: 4
Joined: Sat Mar 27, 2021 10:14 pm

Can faceswap be used to swap specific features such as ONLY eyes/nose/mouth?

Post by deathb4honor »

As title. Can faceswap be used to swap specific features such as ONLY eyes/nose/mouth?

As in, still train it to learn the whole face, but swap only parts of it to create a composite face? If not, is there plans for this feature? There seems to be filters out there that does this to a limited degree.

User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Can faceswap be used to swap specific features such as ONLY eyes/nose/mouth?

Post by torzdf »

Sure it can, but it's going to require work on your part, and is not a feature we are likely to ever build in.

Ultimately, it is a masking problem. You have access to the 68 point face landmarks, so you can create "sub-masks" for any area of the face from that, and use those for conversion.

My word is final

User avatar
theimagera
Posts: 7
Joined: Sat Aug 29, 2020 3:35 pm

Re: Can faceswap be used to swap specific features such as ONLY eyes/nose/mouth?

Post by theimagera »

You could.

If you take the time to make an actual model and then give it a video it needs to deepfake, you can take the output video and the video you inputted to deepfake into an editing software and mask out certain features.
This is the only thing I can think of now because no one currently is just going to deepfake someone's nose.

Locked