Faceswap Forum

unkempt

Ok, so if I wanted to train on a combined set of faces, all I really need to do is make sure that I properly extract, fix alignments, fix masks, make sure the updates are extracted to the pngs in a folder for each source and then I can literally copy the PNG files all into one folder for training an...

unkempt

Let's say I have 5 or so videos but they're short so not a lot of frame or face position variety. I also have maybe 50 photos. I can do extraction on a folder of photos, and each of the videos, but I end up with several alignment files which does me no good when it's time to train or convert. I want...

unkempt

Ok, so you're saying you would actually: extract all frames from a source file (that have faces anyway) Fix all alignments in the manual tool Mask tool to add masks to alignments file Fix all masks in the manual tool Use the alignments tool to extract a certain number of frames (like every 15 for 30...

unkempt

Also, why the "remove faces" step? If you use the manual tool and delete the faces you don't want, isn't that the same thing?

unkempt

On a side-note, what is the point of only doing a handful of faces for training? If you're going to end up extracting every frame and manually fixing them at some point, why not before the training step?

unkempt

First: you are my hero. Thank you so much for the detailed walkthrough! That was a lot of effort on your part and you answered SO MANY QUESTIONS! The manual tool tip helps SO much! I was wasting a lot of time with jawline things, but I'll focus more on the other features going forward. I'll try your...

unkempt

Using the above, I can see the masks not being applied to the trainer. In another thread, someone said to extract using the alignments tool so I'm deleting the faces for the 4th time to extract with that tool isntead to see if it makes a difference.

Narrator: It made no difference.

unkempt

Ok, no worries. I already knew the mask was destroyed in a single FRAME when adjusting alignments. 1000% it's my fault I'm sure. I'm going to start over again using this process: 1) Extract "to be replaced" faces from video at a skip level of 12 or so. S3Fd, Fan, no mask, Hist, Realign, Id...

unkempt

I've been having the most luck with the mask tool not getting confused with obstructions with unetdfl. You're saying that Bisnet-fp will work ok for that? Like if someone is resting their head on their fist and the fist is partially covering their face.

unkempt

Hold up. If I fix alignment on ONE frame, ALL the masks for that face are destroyed? I'm guessing that's not what you meant. Either way, I tried to update alignments and mask for hundreds of face and then extracted them with the manual tool after I was done and trained on it, but the mask adjustment...

unkempt

Well my masks are all gone. they've been reset somehow... I'll have to start over again :( Hopefully I figure this out eventually. It's a lot of work when you get something wrong. I don't suppose there's an idea out there to update the software to warn if any action you're taking would overwrite the...

unkempt

Ok, I definitely missed a few things in there. For example, after cleaning all the masks and alignments, I didn't use the alignments tool to get faces. And I always used exactly one of the warping options, not both. Let me try again...

Also, thank you!

unkempt

When you edit masks in the manual tool, you need to re-extract the faces for training so that the updated masks get stored in the PNG Header data. With the mask tool, if you select the 'missing' option, it will only update masks where a mask does not pre-exist so your edits should be safe. Ok. That...

unkempt

Scenario: Subject is the person who's face I want to be able to put on videos of other people. I gather source videos and photos of them that clearly show their face from various angles. Using the extraction guide, I let faceswap pull faces from the folder, sort out the bad ones, and am left with fa...

unkempt

Oh bummer. so 125k training iteration s down the drain

But thanks! Now I know.

unkempt

I made several adjustments to the alignment file including hundreds of manual mask updates on frames. I saved it, but noticed that it didn't seem to use the mask in the training phase. I assumed it would sort itself out later but when I try to convert, it says there are exactly 2514 components and 2...

unkempt

Fair enough (and matches my experimentation thus far). I'm going to try training on most/each of the varients on the same input to see which does better for the scenario I'm trying to do. Wish me luck (so far, H128 seems best).

unkempt

So I answered part of the question. Adding a different trainer just created new files in the same folder with the name of the trainer. It seems to be starting over so we'll see what happens. I'll try converting with one and then the other (if it gives me the choice). Otherwise maybe conversion blend...

unkempt

And if you do, do you choose which to use for conversion or does it figure that out on its own?

unkempt

There really isn't a high cadence of responses here are there :P I just started playing with this stuff and I noticed that I was getting some pretty bad blur until I used the "Wrap to landmarks" checkbox in the Augmentation section of the trainer. That might not help you, but it did help me.

Faceswap Forum

Search found 81 matches

Re: I want to use a few videos and a folder of photos as my "source" face. How do I combine all that for trainin/convers

I want to use a few videos and a folder of photos as my "source" face. How do I combine all that for trainin/conversion?

Re: Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Re: Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Re: Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Re: Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Re: Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Re: Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Re: Here's the quick and dirty bullet list of the entire process, start to finish as I understand it (am I missing anyth

Re: Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Re: Here's the quick and dirty bullet list of the entire process, start to finish as I understand it (am I missing anyth

Re: Here's the quick and dirty bullet list of the entire process, start to finish as I understand it (am I missing anyth

Re: Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Here's the quick and dirty bullet list of the entire process, start to finish as I understand it (am I missing anything?

Re: Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Adjusted masks during manual adjustment - didn't seem to work with training - error on conversion.

Re: If you want to try multiple trainers, do you use a different model dir or the same one? Do they help each other?

Re: If you want to try multiple trainers, do you use a different model dir or the same one? Do they help each other?

If you want to try multiple trainers, do you use a different model dir or the same one? Do they help each other?

Re: Output blurry even after 800,000 iterations?