Comparing Alignments and spacial+temporal smoothing with examples

Got questions or tips about the Conversion process? This is the place to discuss them.


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved with Converting faces from your trained model.

If you are having issues with the Convert process not working as you would expect, then you should post in the Convert Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
abigflea
Posts: 182
Joined: Sat Feb 22, 2020 10:59 pm
Answers: 2
Has thanked: 20 times
Been thanked: 62 times

Comparing Alignments and spacial+temporal smoothing with examples

Post by abigflea »

I was asked to do a example of alignments and smoothing.
I chose a clip, a full screen face, to amplify the differences.
All were done with a model trained at 192px, converted with the extended mask.
You may need to make them full screen to see the differences, mainly in the jitter of the eyes and around the edges of the face.

No adjustments at all.

Spatial and temporal smoothing of alignments.

Manual adjustments, by hand with bounding box.

Manual adjustment, then Spacial and temporal smoothing.

:o I dunno what I'm doing :shock:
2X RTX 3090 : RTX 3080 : RTX: 2060 : 2x RTX 2080 Super : Ghetto 1060

User avatar
xieydd
Posts: 1
Joined: Mon Aug 24, 2020 7:58 am

Re: Comparing Alignments and spacial+temporal smoothing with examples

Post by xieydd »

Hey, i also have faceswap jitter problem, can you post the function you use in above? Thanks a lot.

User avatar
abigflea
Posts: 182
Joined: Sat Feb 22, 2020 10:59 pm
Answers: 2
Has thanked: 20 times
Been thanked: 62 times

Re: Comparing Alignments and spacial+temporal smoothing with examples

Post by abigflea »

The jitter went away with using the Spacial (+temporal) tool for alignments on the video to convert.
Training the model a little bit longer after I thought it was good enough seemed to help to a degree.
So the AI does a little bit better during the swap process. Sure that has diminishing returns.

:o I dunno what I'm doing :shock:
2X RTX 3090 : RTX 3080 : RTX: 2060 : 2x RTX 2080 Super : Ghetto 1060

Locked