Number of Images required for extraction (Split from Extaction guide)

Want to know about the Faceswap's Face Extraction process? Got tips, ideas or just want to learn about how it all works? Then this is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved for Extracting and preparing face sets for training a model in Faceswap.

If you have found a bug are having issues with the Extraction process not working, then you should post in the Extract Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
Sangui
Posts: 7
Joined: Mon Aug 19, 2019 11:28 am
Has thanked: 1 time

Number of Images required for extraction (Split from Extaction guide)

Post by Sangui »

During the step "Extracting a training set from an alignments file"
I went from around 600 extracted images to 30. Is that normal ?
Is 30 enough to train my model ? (I put the Batch Size of the training to 16) If not, should I use some of my 600 extracted images ? Or I should only use extracted training sets from alignement files ?

User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: [Guide] Extraction - A Workflow

Post by torzdf »

You will need to gather more images for training.

30 is not enough for training. 600 at c.30fps will be too similar/not have enough variation

My word is final

User avatar
Sangui
Posts: 7
Joined: Mon Aug 19, 2019 11:28 am
Has thanked: 1 time

Re: [Guide] Extraction - A Workflow

Post by Sangui »

Okay so I record myself in every angles for 20 seconds, that gave me 600 extracted faces. And with the process to "extract a training set" that reduce it to 30. (I don't really understand this step by the way, is it to delete similar faces that can't be used in the training set?). So should I record myself for a longer time ? In different environments / lights also ? To get more faces for training set ?

User avatar
bryanlyon
Site Admin
Posts: 793
Joined: Fri Jul 12, 2019 12:49 am
Answers: 44
Location: San Francisco
Has thanked: 4 times
Been thanked: 218 times
Contact:

Re: [Guide] Extraction - A Workflow

Post by bryanlyon »

20 seconds at about 1 frame per second wouldn't give nearly enough data, either in variety or expression. You'll either need to greatly increase the extraction rate or record more data. I'm betting that a single 20 second video will never be sufficient and instead you'll want at least a couple minutes in a variety of lighting and pose conditions. Selfie style videos will almost never give appropriate data.

User avatar
Andrea
Posts: 1
Joined: Sat Nov 02, 2019 5:32 pm

Re: Number of Images required for extraction (Split from Extaction guide)

Post by Andrea »

Hello everyone

I have a beginners question, which I think belongs to the topic.

So far extraction went fine, thanks to the guide. While sorting extracted faces I saw a few upside down ones, which is the same position the actor is in the scene.

My question is: do upside down extracted faces matter for training and converting? And while I'm at it, do extracted images where the actor is mirrored matter? Like if he sees himself in a mirror and the extractor rightly extracts a face.

Cheers

User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: Number of Images required for extraction (Split from Extaction guide)

Post by torzdf »

Upside down faces do matter. All extracted faces are aligned to be orientated upright, so if you see upside down faces in your extracted faceset, then these have been 'misaligned' and require fixing

Mirrored is fine. The training process actually randomly flips faces left to right anyway.

My word is final

Locked