Page 1 of 1
Is it possible to train on two faces in a video? Can your replace them both?
Posted: Sat Feb 04, 2023 2:11 pm
by unkempt
If they were the same face (twins), would that make a difference? Bottom line, is it possible to train on two faces either separately or at once to convert multiple faces in one go?
Re: Is it possible to train on two faces in a video? Can your replace them both?
Posted: Sun Feb 05, 2023 3:02 pm
by torzdf
In this hypothetical, if they were identical twins, with no obvious differentiating features, then they would be to all intents and purposes the same face.
The process for swapping multiple faces in the frame is, at a high level, as follows (we'll call our identities 'Bob' and 'Sue')
Extract
- Extract from the source video
- Clean the alignments files for all misaligns and identities that are not 'Bob' or 'Sue'
- Copy the alignments file
- On version 1 of the alignments file delete all the 'Sue' faces and clean the file. This is now your 'Bob' alignments
- On version 2 of the alignments file delete all the 'Bob' faces and clean the file. This is now your 'Sue' alignments
Train
- Train 2 models, one for Bob, one for Sue
Convert
- Run convert against the 'Bob' alignments with the 'Bob' model.
- Use the converted video to run convert again against the 'Sue' alignments with the 'Sue' model.