Page 1 of 1
Input size vs Output size - Which one causes more VRAM usage?
Posted: Thu Aug 25, 2022 12:15 pm
by vichitra5587
While training a model, which one is the main cause of VRAM usage -> Input size or Output size?
For eg: I am willing to train a RealFace model, so which of the following case will use more VRAM :-
Case A) Input size = 64px Output size = 128px
Case B) Input size = 128px Output size = 64px
And is this thing same or different for other models.
Re: Input size vs Output size - Which one causes more VRAM usage?
Posted: Thu Aug 25, 2022 3:49 pm
by torzdf
Unfortunately the answer to your question is "neither"
What dictates VRAM usage (more than anything else) is the complexity of the various models.
In your example below, option B would not make a lot of sense (not from a VRAM perspective), just that learning encodings for an input that is larger than the desired output wouldn't be very useful.