What is most important in lighting data? Shadows? Resolution?

Want to understand the training process better? Got tips for which model to use and when? This is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved with Training a Faceswap model.

If you have found a bug are having issues with the Training process not working, then you should post in the Training Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
rolnor
Posts: 78
Joined: Tue Feb 23, 2021 10:09 am
Has thanked: 2 times
Been thanked: 4 times

What is most important in lighting data? Shadows? Resolution?

Post by rolnor »

I am filming klipps that I extract. I wonder what is most important when setting up lighting. I have 4K resolution and very good fokus. However I use a greenscreen and to avoid shadows on the background I use very soft lighting with softbox. I have done some training with data obtained this way and I think it would be better with lighting that gives higlights shadows that more clearly shows the shapes of the face rather than uniform light in the face. So, maybe use a good general lighting and add a smaller lightsource as well to give the images more dynamic? I can see that loss when training is generally poorer with my data then data obtained from a DVD that from what I can see often has more dynamic in the way the face is lit.

User avatar
bryanlyon
Site Admin
Posts: 793
Joined: Fri Jul 12, 2019 12:49 am
Answers: 44
Location: San Francisco
Has thanked: 4 times
Been thanked: 218 times
Contact:

Re: What is most important in lighting data? Shadows? Resolution?

Post by bryanlyon »

Loss is a poor measure, especially if you control one side of the data.

I'd say that the most important thing is Variety. Variety is key because the model can learn all the different types of lighting itself.

I'd suggest trying to move a light across the face to get different angles. Getting some filming outside and in all the different lighting conditions can really help too.

User avatar
rolnor
Posts: 78
Joined: Tue Feb 23, 2021 10:09 am
Has thanked: 2 times
Been thanked: 4 times

Re: What is most important in lighting data? Shadows? Resolution?

Post by rolnor »

Thanx, yes I know loss is a poor way to measure but if I run several similar training sessions I still get some feel for what it means specially if I combine this with the actuall converted result. I imagine that resolution must be important if you want to get a really realistic result, when you even get a feel for the skin texture? I do have many angles in my klipps but I can se that faces from DVD often has more highlights and shadows in the faces.

User avatar
rolnor
Posts: 78
Joined: Tue Feb 23, 2021 10:09 am
Has thanked: 2 times
Been thanked: 4 times

Re: What is most important in lighting data? Shadows? Resolution?

Post by rolnor »

I have filmed now with all possible angles of my face and it looks very mutch better, training is also much faster, thanx!

Locked