Gray outline around edge of converted face - Phaze-a DNY256 preset

If training is failing to start, and you are not receiving an error message telling you what to do, tell us about it here


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for reporting errors with the Training process. If you want to get tips, or better understand the Training process, then you should look in the Training Discussion forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
jcarl
Posts: 13
Joined: Sun Nov 13, 2022 6:41 am
Has thanked: 4 times
Been thanked: 1 time

Gray outline around edge of converted face - Phaze-a DNY256 preset

Post by jcarl »

When using Phaze-a with the DNY256 preset, I am getting a gray outline around the converted face, usually on the top and sides. The swap otherwise looks amazing. The issue does not appear when using the same A/B data with DFL-SAE.

I tried using Reflect Padding with Phaze-A/DNY256, but then model doesn't seem to train at all (preview shows still solid grey converted face after 20k iterations).

Any ideas about what's causing the grey edges, and how to prevent it using Phaze-a?

User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

Post by torzdf »

I'd need to see an image to understand what you mean. This doesn't sound like an issue I've seen before.

My word is final

User avatar
jcarl
Posts: 13
Joined: Sun Nov 13, 2022 6:41 am
Has thanked: 4 times
Been thanked: 1 time

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

Post by jcarl »

Here is a comparison between DNY256 (200k it) and DFL-SAE (30k it)

Image

User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

Post by torzdf »

Ok, It's to do with hairlines and available data. Reasons and potential mitigations are covered here:
viewtopic.php?p=7684&hilit=hairline#p7684

However, I am interested to know whether you are using identical data-sets and settings for each of the 2 models, because it is interesting to me that this doesn't happen with one model, but does with the other, which would be worthy of some further investigation.

My word is final

User avatar
jcarl
Posts: 13
Joined: Sun Nov 13, 2022 6:41 am
Has thanked: 4 times
Been thanked: 1 time

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

Post by jcarl »

I'll check out that thread, thanks.

A and B data sets are identical.

Starting with default DFL-SAE and DNY256 presets, I changed a few global options, but for both models:

Train-Global-Network-Mixed Precision: True
Train-Global-Loss-Mask: Vgg-clear
Train-Model-Dfl Sae: (No changes)
Train-Model-Phaze A: (Loaded DNY256 preset)

Batch Sizes: DflSae: 16 DNY256: 20

Converting:
Mask Type: Vgg-clear

Is there any other information that may help?

I can also try using the same data with other models or Phaze A presets.

User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

Post by torzdf »

Thanks for this, it is useful information. Just to confirm, these are both from presets used in Phaze-A, yes? (I mean that you used Phaze-A DFL-SAE preset, rather than the standalone DFL-SAE model?)

My word is final

User avatar
jcarl
Posts: 13
Joined: Sun Nov 13, 2022 6:41 am
Has thanked: 4 times
Been thanked: 1 time

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

Post by jcarl »

No - It was the standalone model of DFL-SAE.

I will now run a test of Phaze A + DFL SAE Preset though with the same data and settings to compare the three.

User avatar
jcarl
Posts: 13
Joined: Sun Nov 13, 2022 6:41 am
Has thanked: 4 times
Been thanked: 1 time

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

Post by jcarl »

I have confirmed Phaze A with DFL SAE preset (loaded from model_phaze_a_dfl-sae-df_preset.json) behaves the same as the standalone DFL SAE model; the edges look good.

Let me know if there are any other tests I can run to help.

Locked