Comparing Alignments and spacial+temporal smoothing with examples
Posted: Thu Jul 16, 2020 11:45 pm
by abigflea
I was asked to do a example of alignments and smoothing.
I chose a clip, a full screen face, to amplify the differences.
All were done with a model trained at 192px, converted with the extended mask.
You may need to make them full screen to see the differences, mainly in the jitter of the eyes and around the edges of the face.
No adjustments at all.
Spatial and temporal smoothing of alignments.
Manual adjustments, by hand with bounding box.
Manual adjustment, then Spacial and temporal smoothing.
Re: Comparing Alignments and spacial+temporal smoothing with examples
Posted: Mon Aug 24, 2020 8:00 am
by xieydd
Hey, i also have faceswap jitter problem, can you post the function you use in above? Thanks a lot.
Re: Comparing Alignments and spacial+temporal smoothing with examples
Posted: Mon Aug 24, 2020 8:07 pm
by abigflea
The jitter went away with using the Spacial (+temporal) tool for alignments on the video to convert.
Training the model a little bit longer after I thought it was good enough seemed to help to a degree.
So the AI does a little bit better during the swap process. Sure that has diminishing returns.