Page 1 of 1

Batch Size advice

Posted: Wed Jun 02, 2021 9:01 pm
by dheinz70

Is there any benefit to stepping down the batch size as the model learns? My general recipe is run at max batch size for a few days, cut that batch size in 1/2 for a few more. Then remove warping and cut that batch size in 1/2 again and run for a day.

What do you find works best? Thanks in advance.


Re: Batch Size advice

Posted: Thu Jun 03, 2021 9:56 am
by torzdf

The general working theory is that bigger batches generalize better, smaller batches are better at catching differences between images.