Putting markers on face

Discussions about research, Faceswapping and things that don't fit in the other categories here.


Locked
User avatar
alyssacanu
Posts: 1
Joined: Sun May 07, 2023 1:14 am

Putting markers on face

Post by alyssacanu »

Can anything be done to the face before filming to get better detection, alignments etc? For example, wearing lipstick or drawing a line along my jawline (or wherever). Like a motion capture marker type idea. Not on the donor face obviously.

Also unrelated but I remember reading somewhere that faceswapping with AI-generated faces doesn't work (I think they were discussing faceswapping a faceswap?) Is this true, and if so, why?

Just started and having a great time so thanks for all of this!

User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Putting markers on face

Post by torzdf »

The neural net is trained on real faces, so artificially annotating the face prior to extraction will hinder more than it helps.

You can train with AI generated data, but it is generally not recommended (particularly with AI upscaled images). The reason being that AI upscaling introduces artefacts which may not be obviously visible to you, but will be seen by the Autoencoder, and can lead to a poor final product.

My word is final

Locked