Search found 13 matches

by jcarl
Thu Mar 16, 2023 4:38 pm
Forum: Training Discussion
Topic: Swapping long videos
Replies: 3
Views: 1954

Re: Swapping long videos

Thank you for the reply. Are there any negative repercussions or hard limits of how many images to with at one time (50,000-500,000 faces)? I remember the FAQ recommending 500-5,000 faces per side. I was concerned about trying to train with 10-100x the number. When a new season of a show is released...
by jcarl
Thu Mar 16, 2023 8:54 am
Forum: Training Discussion
Topic: Swapping long videos
Replies: 3
Views: 1954

Swapping long videos

If swapping the same A and B a 30 minute show... or an entire season of 30 minute shows, should I reuse a single model, or create multiple models? Would each episode have to be split into smaller scenes (assuming 50k+ A-Faces per episode), or just trained all at the same time? If using the same mode...
by jcarl
Sat Feb 25, 2023 4:59 pm
Forum: Training Support
Topic: Training speed tapers off after a two minutes
Replies: 4
Views: 1312

Re: Training speed tapers off after a two minutes

Problem solved. The low/tapering performance was caused by using vgg-clear for the training mask. After switching to bisenet-fp, performance has gone back up to 110 eg/s (sustained over 14 hours so far).

by jcarl
Wed Feb 22, 2023 3:12 am
Forum: Training Support
Topic: Training speed tapers off after a two minutes
Replies: 4
Views: 1312

Re: Training speed tapers off after a two minutes

Thanks for the reply. The fact that this might be indicative of a bottleneck gives me a place to start. Hardware wise, I'm running a relatively new i7-12700k with 32GB of DDR4 3600 memory. CPU utilization itself is low, running about 14% during training, but I'm not sure about memory bandwidth. I wo...
by jcarl
Tue Feb 21, 2023 7:45 pm
Forum: Training Support
Topic: Training speed tapers off after a two minutes
Replies: 4
Views: 1312

Training speed tapers off after a two minutes

Lately I've been having an issue with training performance that I'm struggling to isolate. Training (DNY256 batch-26) starts out strong @ 100 eg/s, but after ~ 2 minutes, the speed starts gradually decreasing to about 55-60 eg/s, where it will stay permanently. Along with the performance drop, GPU p...
by jcarl
Mon Dec 12, 2022 5:38 pm
Forum: Hardware
Topic: Hardware best practices
Replies: 83
Views: 183577

Re: Hardware best practices

bryanlyon wrote: Sat Dec 10, 2022 4:03 am

That said, I'm not sure I'd recommend the 3090 or 3090 ti unless you have a VERY good reason to need that much ram.

GPU prices are still fluctuating quite a bit, but in my area, the 3090ti is hovering around the same price as the 4080 16GB. Would you recommend the 4080 over 3090ti?

by jcarl
Sat Dec 10, 2022 2:41 am
Forum: Hardware
Topic: Hardware best practices
Replies: 83
Views: 183577

Re: Hardware best practices

Thank you for the reply. How are the RAM temps on your 3090? I read that VRAM intensive applications (e.g., ETH mining) caused dangerous temperature (>100 C memory junction temperature) levels on many 3090s, and required additional cooling to the back of the card. I wonder if FS has a similar type o...
by jcarl
Fri Dec 09, 2022 5:15 pm
Forum: Hardware
Topic: Hardware best practices
Replies: 83
Views: 183577

Re: Hardware best practices

A few GPU questions:

  1. Are the new 40xx GPUs automatically supported by Faceswap, or is an update required?

  2. Do faceswap workloads cause concerning memory temperatures on the 3090 (as they do with crypto mining)?

  3. How would the 4080 16GB would stack up against the 3090 or 3090ti?

by jcarl
Fri Nov 18, 2022 5:56 pm
Forum: Training Support
Topic: Gray outline around edge of converted face - Phaze-a DNY256 preset
Replies: 7
Views: 1361

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

I have confirmed Phaze A with DFL SAE preset (loaded from model_phaze_a_dfl-sae-df_preset.json) behaves the same as the standalone DFL SAE model; the edges look good.

Let me know if there are any other tests I can run to help.

by jcarl
Fri Nov 18, 2022 2:00 am
Forum: Training Support
Topic: Gray outline around edge of converted face - Phaze-a DNY256 preset
Replies: 7
Views: 1361

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

No - It was the standalone model of DFL-SAE.

I will now run a test of Phaze A + DFL SAE Preset though with the same data and settings to compare the three.

by jcarl
Wed Nov 16, 2022 10:30 pm
Forum: Training Support
Topic: Gray outline around edge of converted face - Phaze-a DNY256 preset
Replies: 7
Views: 1361

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

I'll check out that thread, thanks. A and B data sets are identical. Starting with default DFL-SAE and DNY256 presets, I changed a few global options, but for both models: Train-Global-Network-Mixed Precision: True Train-Global-Loss-Mask: Vgg-clear Train-Model-Dfl Sae: (No changes) Train-Model-Phaze...
by jcarl
Tue Nov 15, 2022 9:53 pm
Forum: Training Support
Topic: Gray outline around edge of converted face - Phaze-a DNY256 preset
Replies: 7
Views: 1361

Re: Gray outline around edge of converted face - Phaze-a DNY256 preset

Here is a comparison between DNY256 (200k it) and DFL-SAE (30k it)

Image

by jcarl
Sun Nov 13, 2022 7:07 am
Forum: Training Support
Topic: Gray outline around edge of converted face - Phaze-a DNY256 preset
Replies: 7
Views: 1361

Gray outline around edge of converted face - Phaze-a DNY256 preset

When using Phaze-a with the DNY256 preset, I am getting a gray outline around the converted face, usually on the top and sides. The swap otherwise looks amazing. The issue does not appear when using the same A/B data with DFL-SAE. I tried using Reflect Padding with Phaze-A/DNY256, but then model doe...