Not enough VRAM after ~3 hours of training.

If training is failing to start, and you are not receiving an error message telling you what to do, tell us about it here


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for reporting errors with the Training process. If you want to get tips, or better understand the Training process, then you should look in the Training Discussion forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
cross_dante_666
Posts: 1
Joined: Wed Jan 19, 2022 7:10 pm

Not enough VRAM after ~3 hours of training.

Post by cross_dante_666 »

Hi Guys.

Code: Select all

I have an Nvidia 1650

After achieving some decent results following the tutorial to the letter, i tried my first train with Dlight. I tried with a batch-size of 12 and it crashed after about 3 hours due to not enough VRAM. I had no other program running.
After that, i tried with a batch-size of 10, in the same conditions, but the same thing is happening.
I am running the nvidia-smi and during the batch-size 10 training it shows a constant 2886 MiB out of 4096 MiB.

Am i doing something wrong?

User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Not enough VRAM after ~3 hours of training.

Post by torzdf »

The amount of VRAM that faceswap requires will not change over time. Most likely something else (Google chrome/game/desktop etc) is stealing VRAM which is causing FS to fail.

My word is final

Locked