Page 1 of 1

256 High Batch Size Progress

Posted: Wed Nov 13, 2019 2:43 pm
by EXHYST

Hey

I have been trainning at the max batch size of 256 for more than 1 day.

Did not have any crashes.

But I read that " there are slight quality degradations at very large batch sizes".. So should I reduce it? And reduce it to what?

Image

After about 60hours and 90k iterations my faceswap looks like this:

If I continue will it improve much more?

I dont see much progress in the last 10 hours of trainning.

Thanks


Re: 256 High Batch Size Progress

Posted: Wed Nov 13, 2019 11:29 pm
by torzdf

If you haven't already, you should read the training guide, as it talks about selecting the batch size
viewtopic.php?f=6&t=146

The Best Practice tips also offer some pointers for eeking out more quality:
viewtopic.php?f=6&t=74


Re: 256 High Batch Size Progress

Posted: Mon Nov 18, 2019 9:03 pm
by bryanlyon

More specifically, you can feel free to change the batch size as you train. Lowering the BS to 64 near the end of training makes sense if you want to see the differences of a smaller BS. It wont hurt to try different values if you want to see how it affects your results.