Warp To Landmark = Googly Eyes

Want to understand the training process better? Got tips for which model to use and when? This is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved with Training a Faceswap model.

If you have found a bug are having issues with the Training process not working, then you should post in the Training Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
MaxHunter
Posts: 193
Joined: Thu May 26, 2022 6:02 am
Has thanked: 176 times
Been thanked: 13 times

Warp To Landmark = Googly Eyes

Post by MaxHunter »

I'm curious if anyone has noticed if Warp-to-Landmark is more susceptible to "googley eyes."

I recently used Warp To Landmark on a new model and noticed the eyes are way more googley than usual. This is the second time I've used it so not a lot of experience on this, but it would make sense in my pea-brain because if your eye landmarks are off even a little (which is easy to do,) and the program is directly aiming towards those landmarks (rather than random) it's going to be more susceptible to learn the model wrong.

At first I thought this could be caused by bad data because I added more B-faces which appeared to have wonky eyes (because of weird angles of the face.) But that seems unlikely because out of 6,000+ faces the wonky ones are maybe 25-ish. This made me wonder about the possibility it could be Warp-to-Landmark.

Has anyone else noticed this?

Last edited by MaxHunter on Mon Feb 13, 2023 11:43 pm, edited 2 times in total.
User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Warp To Landmark = Googly Eyes

Post by torzdf »

I personally don't put much stock in warp-to-landmarks, but your mileage may vary. IMHO it artificially limits the amount of data you are training on, so I have never looked into it beyond making sure that it is working as intended.

My word is final

User avatar
MaxHunter
Posts: 193
Joined: Thu May 26, 2022 6:02 am
Has thanked: 176 times
Been thanked: 13 times

Re: Warp To Landmark = Googly Eyes

Post by MaxHunter »

I was just about to edit this post when I saw your reply.

I noticed that I for some reason had "Split G-Block" ticked off on this model(I usually don't use it.) I'm thinking that's the culprit for the googly-eyes. I'm glad I noticed as I was just about to upload my settings for a "Stojo-512." Otherwise this model turned out fantastic in around 700k I.t.s/1.5M e.g.s W/efficienetv2 L

Last edited by MaxHunter on Tue Feb 14, 2023 1:07 am, edited 2 times in total.
Locked