Increases in loss after training restart.

Want to understand the training process better? Got tips for which model to use and when? This is the place for you


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for discussing tips and understanding the process involved with Training a Faceswap model.

If you have found a bug are having issues with the Training process not working, then you should post in the Training Support forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
abigflea
Posts: 182
Joined: Sat Feb 22, 2020 10:59 pm
Answers: 2
Has thanked: 20 times
Been thanked: 62 times

Increases in loss after training restart.

Post by abigflea »

This question is not related to the visual results really.
Seems that after restarting training, I see the loss factor going up sharply, then coming down after a few hundred iterations. Same model, dame data.
Curious to why this is.
Would it be similar to walking away from a task, and coming back with "new eyes"? A bit of randomness when loading up the data in the beginning?

:o I dunno what I'm doing :shock:
2X RTX 3090 : RTX 3080 : RTX: 2060 : 2x RTX 2080 Super : Ghetto 1060

Locked