I have been trainning at the max batch size of 256 for more than 1 day.
Did not have any crashes.
But I read that " there are slight quality degradations at very large batch sizes".. So should I reduce it? And reduce it to what?
After about 60hours and 90k iterations my faceswap looks like this:
If I continue will it improve much more?
I dont see much progress in the last 10 hours of trainning.
Thanks
Re: 256 High Batch Size Progress
Posted: Wed Nov 13, 2019 11:29 pm
by torzdf
If you haven't already, you should read the training guide, as it talks about selecting the batch size viewtopic.php?f=6&t=146
The Best Practice tips also offer some pointers for eeking out more quality: viewtopic.php?f=6&t=74
Re: 256 High Batch Size Progress
Posted: Mon Nov 18, 2019 9:03 pm
by bryanlyon
More specifically, you can feel free to change the batch size as you train. Lowering the BS to 64 near the end of training makes sense if you want to see the differences of a smaller BS. It wont hurt to try different values if you want to see how it affects your results.