[Guide] Extraction - A Workflow

Extracting faces for training and converting
Forum rules
Read the FAQs and search the forum before posting a new topic.

Please mark any answers that fixed your problems so others can find the solutions.
User avatar
torzdf
Posts: 948
Joined: Fri Jul 12, 2019 12:53 am
Answers: 126
Has thanked: 26 times
Been thanked: 184 times

Re: [Guide] Extraction - A Workflow

Post by torzdf »

korrupt78 wrote: Wed Feb 12, 2020 6:59 pm

I'm confused: What's the purpose of merging alignment files when merging training sets given that alignment files aren't actually used during training?

If you're training with a mask or using Warp to Landmarks, then you need an alignments file, as stated here:
viewtopic.php?f=5&t=27#why

My word is final


Tags:

User avatar
korrupt78
Posts: 49
Joined: Wed Jan 29, 2020 1:34 am
Has thanked: 2 times
Been thanked: 1 time

Re: [Guide] Extraction - A Workflow

Post by korrupt78 »

torzdf wrote: Wed Feb 12, 2020 10:03 pm

If you're training with a mask or using Warp to Landmarks, then you need an alignments file, as stated here:
viewtopic.php?f=5&t=27#why

Great, that helps. I'm just getting into learning the Manual tool now, and made a decision to figure out masks and landmarks after I get the basics of the Manual tool, so I haven't actually looked into them yet. I'll postpone further comments on this question until I do.


User avatar
230V
Posts: 13
Joined: Sun Jan 19, 2020 6:20 pm
Answers: 1
Has thanked: 6 times

Re: [Guide] Extraction - A Workflow

Post by 230V »

thx for the guide!

but how to resize "Frame" windows so i can see the entire picture?
footage is 4k, display not..

best regards


User avatar
torzdf
Posts: 948
Joined: Fri Jul 12, 2019 12:53 am
Answers: 126
Has thanked: 26 times
Been thanked: 184 times

Re: [Guide] Extraction - A Workflow

Post by torzdf »

My word is final


User avatar
Kevin_Z
Posts: 11
Joined: Tue Apr 28, 2020 2:36 am
Has thanked: 1 time
Been thanked: 1 time

Re: [Guide] Extraction - A Workflow

Post by Kevin_Z »

The extraction procedure is working on CPU or GPU? It is kind of slow, when I ran it on AMD 3950x, and CPU was all FULL.


User avatar
torzdf
Posts: 948
Joined: Fri Jul 12, 2019 12:53 am
Answers: 126
Has thanked: 26 times
Been thanked: 184 times

Re: [Guide] Extraction - A Workflow

Post by torzdf »

It uses both, fairly extensively

My word is final


User avatar
AaronLaw
Posts: 6
Joined: Mon May 11, 2020 10:42 am
Has thanked: 4 times

Re: [Guide] Extraction - A Workflow

Post by AaronLaw »

Dear facewap:

Thanks to facewap for providing such a magical application, when I learned to extract according to the guide, I found that there are some abnormal situations, I don't know if other friends have encountered:

  1. Extract the face in the video, the face in several frames of the picture is rotated at an angle, which will cause the face position to be misaligned in the subsequent training;

  2. Among the extracted results, there are still pictures that are not faces. Can I directly delete them manually, and then use the “Clean the Alignments File” in the guide to process?

Image

Image

I would like to consult how to solve this situation.

       Thanks ~ ···


User avatar
torzdf
Posts: 948
Joined: Fri Jul 12, 2019 12:53 am
Answers: 126
Has thanked: 26 times
Been thanked: 184 times

Re: [Guide] Extraction - A Workflow

Post by torzdf »

AaronLaw wrote: Mon May 11, 2020 11:44 am
  1. Among the extracted results, there are still pictures that are not faces. Can I directly delete them manually, and then use the “Clean the Alignments File” in the guide to process?

Yes.

The slightly misaligned faces can be fixed with the manual alignments tool.

My word is final


User avatar
meDaniel
Posts: 2
Joined: Thu Aug 06, 2020 6:58 am

Re: [Guide] Extraction - A Workflow

Post by meDaniel »

deephomage wrote: Thu Jan 23, 2020 6:47 pm To train a model, you need to extract both pairs of faces from video clips, to make a face set. For example, to swap Keanu Reeves and Nic Cage, you would extract Keanu and Nic faces from a variety of sources, to make a training set for each. If the video clips also contain unwanted faces, just delete the unwanted faces.
HI, regarding this, I have a few source videos of myself.

As you mentioned, I should extract my faces from these source; but do I output them to the same folder?
Example:

Code: Select all

/Output Pic/Myself
And same for whoever I want to swap my face with?
Example:

Code: Select all

/Output Pic/Whoever
Just verifying and trying to understand whether I am on the right path.

User avatar
bryanlyon
Site Admin
Posts: 468
Joined: Fri Jul 12, 2019 12:49 am
Answers: 39
Location: San Francisco
Has thanked: 3 times
Been thanked: 114 times
Contact:

Re: [Guide] Extraction - A Workflow

Post by bryanlyon »

[mention]meDaniel[/mention] Yes, you can do that. You'll just need to follow the merging instructions in the guide to merge your alignments files after you finish extracting. Personally, I extract to different folders, then merge, but that's just a personal choice.

User avatar
torzdf
Posts: 948
Joined: Fri Jul 12, 2019 12:53 am
Answers: 126
Has thanked: 26 times
Been thanked: 184 times

Re: [Guide] Extraction - A Workflow

Post by torzdf »

You definitely should be outputting to different folders, and then looking to fix up the alignments for each extract run prior to merging.

Once the files are merged, you won't be able to use the Manual tool to fix up any issues.

My word is final


User avatar
meDaniel
Posts: 2
Joined: Thu Aug 06, 2020 6:58 am

Re: [Guide] Extraction - A Workflow

Post by meDaniel »

Thanks for both the tips.

I will redo my extraction again. Because I extracted my own face from two source into the same folder.

Will try the method with the least issue =D

Guess I will be staring in some movies soon.

User avatar
FuorissimoX
Posts: 47
Joined: Mon Sep 21, 2020 6:49 am
Location: Italy
Has thanked: 10 times

Re: [Guide] Extraction - A Workflow

Post by FuorissimoX »

Hi, I'm trying the "Manually Fixing" function but I'm having trouble understanding what is right and what is wrong. Can you post photos? It would be easier. Thank you

Post Reply