Faceswap Forum

The mask and alignment for both sides are almost perfect. When using the manual tool to look at the frames, the mask and alignments cover up the face correctly. But as I’m training, side b doesn’t cover the full face on side A causes a halo effect when converting. I tried changing a bunch of the convert settings and it doesn’t work. e.g. Box blend, Mask blend, color, etc. Only changing “erosion” has very little effect but it takes too much of the face away and doesn’t completely overlay the face you are trying to replace. I have tried with multiple sources and it does the same thing. I don’t notice a difference when training longer. Mask type and color adjustment doesn’t make any difference either. The training set for both sides is 1024x1024. It wouldn't be too bad if I could blend the halo effect into the face, but nothing is doing that. Is there anything I’m missing or need to change?
I am using Phaze-A. RTX3060

You wont find a fix for this in the model settings.

In the case of vastly different face shape you're going to need to do manual compositing to get good results. To do that, change the "writer" to OpenCV or Pillow and enable "draw Transparent" to get just the model output. You can then manually blend it back into the original image.

bryanlyon wrote: ↑Mon Jan 03, 2022 4:31 pm

You wont find a fix for this in the model settings.

In the case of vastly different face shape you're going to need to do manual compositing to get good results. To do that, change the "writer" to OpenCV or Pillow and enable "draw Transparent" to get just the model output. You can then manually blend it back into the original image.

Thank you for the reply. I changed the writer to pillow and enable "draw Transparent". I have the output. But I don't know what you mean by "manually blend it back into the original image". What do you mean and/or is there a guide to that?

Thank you

He means using an external tool (e,g. After Effects/Premiere/many other video editing suites) to load in the frames and composite there. I have no experience of this, so would need to leave to others to advise.