How portable are well-trained models to other videos of the same faces?

Want to understand the training process better? Got tips for which model to use and when? This is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved with Training a Faceswap model.

If you have found a bug are having issues with the Training process not working, then you should post in the Training Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
Replicon
Posts: 50
Joined: Mon Mar 22, 2021 4:24 pm
Been thanked: 2 times

How portable are well-trained models to other videos of the same faces?

Post by Replicon »

Suppose I have three videos:

  • A1: Good collection of expressions/angles/lighting, for face A

  • B: Good collection of expressions/angles/lighting, for face B

  • A2: Some other video of face A, similar quality to A1

If I train a model to swap B's face onto A1, can I then use that same model to swap B's face onto A2, with okay-ish results?

I figure, assuming A1 and A2 are similar enough in quality and angles, that it ought to work, seeing as there's talk of extracting alignments "for convert" and "for training" (i.e. alignment data for training is a subset of alignment data used for convert, and will have to render faces it's never seen before when converting).

User avatar
Replicon
Posts: 50
Joined: Mon Mar 22, 2021 4:24 pm
Been thanked: 2 times

Re: How portable are well-trained models to other videos of the same faces?

Post by Replicon »

Don't mind me, I found my answer in the best practices guide. That Harrison Ford/Nick Cage example with pulling from multiple movies is exactly my example.

Locked