Thesis: Facial scar faceswap

Talk about AI and Deep Learning


Locked
User avatar
Eline
Posts: 1
Joined: Thu Dec 23, 2021 4:49 pm
Has thanked: 1 time

Thesis: Facial scar faceswap

Post by Eline »

Hello
For me last year Digital art & Entertainment I am doing a thesis and case study about face swapping with a scar. I would love to know some information about how achievable this is, if it is achievable. So if anyone has tested this before, I would love to hear about the results.

I was thinking about face swapping a person with no sfx scar make up at first, with that same person with sfx scar make up. Is this software capable of transferring unusual bumps on the face, or would it transfer as flat? If it does tranfer flat, what would you suggest as an alternative. As reference I picked out this image:
Image

Thank you & warm regards,
Eline

User avatar
bryanlyon
Site Admin
Posts: 793
Joined: Fri Jul 12, 2019 12:49 am
Answers: 44
Location: San Francisco
Has thanked: 4 times
Been thanked: 218 times
Contact:

Re: Thesis: Facial scar faceswap

Post by bryanlyon »

Should be feasible. Though you'll need to take resolution limits into account. Makeup has been done in the past successfully.

User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: Thesis: Facial scar faceswap

Post by torzdf »

Hmmm, I'm going to take an opposing view and say I'm not sure this would work how you would want. The model would never have seen scarring for the target face, so at best it would have to imagine what the decodings it has received means, at worst it will be a total mess.

Faceswapping trys to keep face details from your target face. For example if your target has a mole, then you would want the mole on the final face. If the original face has a mole, you would not want that on the final face. I would imagine scarring would work in much the same way.

At the very least, I would guess that you would want to train the original face with images that both have and do not have scarring so that the model learns that the scarring is not intrinsic to the face.

This is all pure speculation though.

My word is final

Locked