Putting markers on face

Discussions about research, Faceswapping and things that don't fit in the other categories here.

Post Reply
User avatar
Posts: 1
Joined: Sun May 07, 2023 1:14 am

Putting markers on face

Post by alyssacanu »

Can anything be done to the face before filming to get better detection, alignments etc? For example, wearing lipstick or drawing a line along my jawline (or wherever). Like a motion capture marker type idea. Not on the donor face obviously.

Also unrelated but I remember reading somewhere that faceswapping with AI-generated faces doesn't work (I think they were discussing faceswapping a faceswap?) Is this true, and if so, why?

Just started and having a great time so thanks for all of this!

User avatar
Posts: 2373
Joined: Fri Jul 12, 2019 12:53 am
Answers: 146
Has thanked: 116 times
Been thanked: 538 times

Re: Putting markers on face

Post by torzdf »

The neural net is trained on real faces, so artificially annotating the face prior to extraction will hinder more than it helps.

You can train with AI generated data, but it is generally not recommended (particularly with AI upscaled images). The reason being that AI upscaling introduces artefacts which may not be obviously visible to you, but will be seen by the Autoencoder, and can lead to a poor final product.

My word is final

Post Reply