Swapping long videos

Want to understand the training process better? Got tips for which model to use and when? This is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved with Training a Faceswap model.

If you have found a bug are having issues with the Training process not working, then you should post in the Training Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
jcarl
Posts: 13
Joined: Sun Nov 13, 2022 6:41 am
Has thanked: 4 times
Been thanked: 1 time

Swapping long videos

Post by jcarl »

If swapping the same A and B a 30 minute show... or an entire season of 30 minute shows, should I reuse a single model, or create multiple models?

Would each episode have to be split into smaller scenes (assuming 50k+ A-Faces per episode), or just trained all at the same time?

If using the same model, would I just replace the entire A-side of faces when training a new scene, or episode?

If using separate models, would load/freeze weights be used?

User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 623 times

Re: Swapping long videos

Post by torzdf »

I would use a single model for this. You train to swap the faces of 2 identities. You don't train to swap for specific scenes.

You would train your A side on faces taken from all scenes (and any other sources you can obtain).

You would create and clean an alignments file for each episode you wish to convert.

Then you would just run convert on each of these episodes with your 1 trained model

My word is final

User avatar
jcarl
Posts: 13
Joined: Sun Nov 13, 2022 6:41 am
Has thanked: 4 times
Been thanked: 1 time

Re: Swapping long videos

Post by jcarl »

Thank you for the reply.

Are there any negative repercussions or hard limits of how many images to with at one time (50,000-500,000 faces)?

I remember the FAQ recommending 500-5,000 faces per side. I was concerned about trying to train with 10-100x the number.

When a new season of a show is released after the model is well trained, is it better to add the new season faces to the existing data set, or replace the old with the new?

User avatar
bryanlyon
Site Admin
Posts: 793
Joined: Fri Jul 12, 2019 12:49 am
Answers: 44
Location: San Francisco
Has thanked: 4 times
Been thanked: 218 times
Contact:

Re: Swapping long videos

Post by bryanlyon »

I don't recommend training with such large datasets. Not for hard reasons, just it's a huge pain to clean.

I also don't recommend converting whole TV episodes all at once. Much better to do it scene-by-scene. Then you can ensure that the quality level is high for each scene before moving on. There are a lot of tools that can split your video by scene/cut/transition that can assist with that.

Locked