Hi , I am using Phaze-A for traning with stojo present , its has been trained for 4days but the loss still keep on 0.0170.016 this 48hrs , still cant go down ,
here is my setting :
RTX3080
Phaze-A Stojo mode ( efficientnet v2_s)
Learning rate : 4.5e , EE :-5
Mixed Precision and Nan on ,
Face A and B both over 10K png
Iterations : 260K now
But other PC with 3090 ( efficientnet v2_l), same setting , Iterations 67k loss 0.014 already , so whats should i do ?
one more questions is , RTX3080 cant use ( efficientnet v2_l), cause out of memory , even i set down the batch size to 2 , Learning rate 3.5e still cant use , how can make it ? because 3090 setting result is much better than 3080 setting
thank you.