Search found 3 matches

by rbanfield82
Fri Aug 25, 2023 6:01 pm
Forum: Training Discussion
Topic: Yah new sutff, a vision transformer CLipV
Replies: 25
Views: 32371

Re: Yah new sutff, a vision transformer CLipV

Ryzen1988 wrote: Thu Aug 24, 2023 8:41 am

After doing a shitty load of experiments..

Keep going with the testing Ryzen!

by rbanfield82
Fri Aug 11, 2023 9:46 pm
Forum: Training Discussion
Topic: LPIPS loss function
Replies: 8
Views: 17963

LPIPS loss function

I was using a hybrid of yours and Icarus' phaze-a setup/suggestions that I found in the Phaze-A post. I used Torzdf's Loss Function setup: SSIM - main function MAE - 25% - secondary L1 Reg Term LPIPS-Alex 50% FFL 100% I loved this configuration and have been using it for the past 6 months. However, ...
by rbanfield82
Fri Aug 11, 2023 12:43 pm
Forum: Training Discussion
Topic: Yah new sutff, a vision transformer CLipV
Replies: 25
Views: 32371

Re: Yah new sutff, a vision transformer CLipV

What Learning Rate and Loss Functions are you using? The training speed is crazy with this setup.