Batch Size advice
Posted: Wed Jun 02, 2021 9:01 pm
Is there any benefit to stepping down the batch size as the model learns? My general recipe is run at max batch size for a few days, cut that batch size in 1/2 for a few more. Then remove warping and cut that batch size in 1/2 again and run for a day.
What do you find works best? Thanks in advance.