Page 1 of 1

Is it possible to lip sync ?

Posted: Tue Dec 08, 2020 9:21 am
by gseinstein

I have a person talking in english (person 1) and a person talking in german (person 2). Both clips are of same duration is there any way to make person 1 taking german using faceswap ??


Re: Is it possible to lip sync ?

Posted: Tue Dec 08, 2020 2:27 pm
by torzdf

That sounds like a pretty standard faceswap to me.

'A' would be the person 2, 'B' would be person 1.


Re: Is it possible to lip sync ?

Posted: Thu Dec 10, 2020 7:27 am
by gseinstein
torzdf wrote: Tue Dec 08, 2020 2:27 pm

That sounds like a pretty standard faceswap to me.

'A' would be the person 2, 'B' would be person 1.

But I do not want to change the face. only lip movement


Re: Is it possible to lip sync ?

Posted: Thu Dec 10, 2020 6:05 pm
by bryanlyon

That is not what FaceSwap does. We just swap faces, not animate others. You could try doing a faceswap then using other tools to move the lips back, but I don't think that'd be the easiest way. You may want to check out other programs such as wav2lip or first order model.