Hi everyone, I'm a little confused about the importance of iterations, batch size and Eg / s.
For example I noticed that if I set (model: Original) for example BS = 64 I have 3,000 iterations per hour and 230 Eg / s. If I set BS = 32 I have 6,000 iterations per hour and about 210 Eg / s.
Is it better to do many iterations with fewer BSs or the other way around? Or the important thing is the total of Eg / s X minutes elapsed? Because at first glance, nothing changes. If I have BS = 32 I carry out at the same time twice the iterations that I would have with Bs = 64 and approximately Eg / s equal (but with BS = 64 reaching the same number of iterations requires more time and therefore we obtain a greater number of Eg / s).
In summary, the best choice is:
1) have a total of Eg as high as possible?
2) have many iterations?
I just don't understand what changes between doing 100,000 iterations in one hour with BS = 1 or doing 100,000 iterations with BS = 64
Perhaps stopping the program after X iterations is a misleading parameter. Maybe it would be more useful to think in processed Eg?
We need a tool that calculates the ideal parameters according to the available HW