Comparing Alignments and spacial+temporal smoothing with examples

Converting source frames into swapped frames
Forum rules
Read the FAQs and search the forum before posting a new topic.

Please mark any answers that fixed your problems so others can find the solutions.
Post Reply
User avatar
abigflea
Posts: 126
Joined: Sat Feb 22, 2020 10:59 pm
Answers: 1
Has thanked: 11 times
Been thanked: 32 times

Comparing Alignments and spacial+temporal smoothing with examples

Post by abigflea »

I was asked to do a example of alignments and smoothing.
I chose a clip, a full screen face, to amplify the differences.
All were done with a model trained at 192px, converted with the extended mask.
You may need to make them full screen to see the differences, mainly in the jitter of the eyes and around the edges of the face.

No adjustments at all.

Spatial and temporal smoothing of alignments.

Manual adjustments, by hand with bounding box.

Manual adjustment, then Spacial and temporal smoothing.

:o I dunno what I'm doing :shock:
RTX 2070 x2 : GTX 1070 x2 : Ghetto 1060

User avatar
xieydd
Posts: 1
Joined: Mon Aug 24, 2020 7:58 am

Re: Comparing Alignments and spacial+temporal smoothing with examples

Post by xieydd »

Hey, i also have faceswap jitter problem, can you post the function you use in above? Thanks a lot.

User avatar
abigflea
Posts: 126
Joined: Sat Feb 22, 2020 10:59 pm
Answers: 1
Has thanked: 11 times
Been thanked: 32 times

Re: Comparing Alignments and spacial+temporal smoothing with examples

Post by abigflea »

The jitter went away with using the Spacial (+temporal) tool for alignments on the video to convert.
Training the model a little bit longer after I thought it was good enough seemed to help to a degree.
So the AI does a little bit better during the swap process. Sure that has diminishing returns.
:o I dunno what I'm doing :shock:
RTX 2070 x2 : GTX 1070 x2 : Ghetto 1060

Post Reply