[GPU] I need to train 1024x1024 model What GPU should I have?

Talk about Hardware used for Deep Learning


Locked
User avatar
Alde
Posts: 1
Joined: Wed Jan 11, 2023 11:37 am

[GPU] I need to train 1024x1024 model What GPU should I have?

Post by Alde »

Let's say money is no issue. Wil be fine to buy RTX A6000 48 gb or I need go with A100 80GB?
Thank you for your answers.

User avatar
torzdf
Posts: 2671
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 131 times
Been thanked: 625 times

Re: [GPU] I need to train 1024x1024 model What GPU should I have?

Post by torzdf »

That's a hard question to answer, and given the amount of $$$ you are about to drop, I'd be loathed to steer you in any particular direction.

However, it is possible to train 1080px on an 11GB card using the DNY1024px model. However, I cannot speak for the quality of the final output, because I do not know of anyone who has had the patience to train at that resolution to completion.

Higher quality models are going to need significantly more VRAM (obviously). If money was no issue, I would go with the largest I could to make sure I was as future proofed as possible. However, some testing, trial and error is going to be required on your part to create a model that gives you the output you require.

My word is final

User avatar
Ryzen1988
Posts: 57
Joined: Thu Aug 11, 2022 8:31 am
Location: Netherlands
Has thanked: 8 times
Been thanked: 28 times

Re: [GPU] I need to train 1024x1024 model What GPU should I have?

Post by Ryzen1988 »

Alde wrote: Tue Apr 18, 2023 12:00 pm

Let's say money is no issue. Wil be fine to buy RTX A6000 48 gb or I need go with A100 80GB?
Thank you for your answers.

I have a a6000, 48GB is enough for a 1024px but training time is horrible, so i would imagen a100 or h100 is way faster

Last edited by Ryzen1988 on Wed Aug 16, 2023 11:38 am, edited 1 time in total.
Locked