Phaze-A - 256px Demo

Display post links to interesting swaps
Post Reply
User avatar
torzdf
Posts: 1422
Joined: Fri Jul 12, 2019 12:53 am
Answers: 125
Has thanked: 47 times
Been thanked: 275 times

Phaze-A - 256px Demo

Post by torzdf »

Above is a demonstration of Phaze-A trained at 256px on consumer hardware (1x 2080Ti). The source is We Bought a Zoo, replacing Scarlett Johansson with Emma Stone. No VFX have been applied to this swap. This is raw Faceswap output. The only post-processing applied was to place in side-by-side shots of swap vs original.

This video does not demonstrate the best of what this model is capable of. It is a demonstration of some quickly chosen settings on 2 face-sets I happened to have kicking around (I'm not planning on going viral here!). The best settings for this model have definitely not been discovered yet, so there are definitely improvements to be had for this GPU.

This model took a long time to train (2m iters over about 2 weeks). Good results take time.

I have decided to keep this video quite long, as I don't want to be too selective with the "best scenes", so you can see the good parts, and other areas where it hasn't worked quite so well.

The actual convert is done at 720p. 256px is probably the absolute minimum to get away with close-ups at this resolution, and it would probably benefit from being trained at a slightly higher resolution.

The settings for this model will be placed in the presets section of the Phaze-A thread.

My word is final


User avatar
ianstephens
Posts: 37
Joined: Sun Feb 14, 2021 7:20 pm
Has thanked: 5 times

Re: Phaze-A - 256px Demo

Post by ianstephens »

Looks mighty fine I must say :D

We're still playing with your StoJo model.

We've installed our 3090 FE now and were wondering now with all of that extra VRAM...

You mentioned,

256px is probably the absolute minimum to get away with close-ups at this resolution, and it would probably benefit from being trained at a slightly higher resolution.

With 512px training images for both sides - how would one go about correctly training at a higher resolution?

Is this simple change below all it takes to train at 384px for example (or is there more to it)?

stojo.png
stojo.png (58.04 KiB) Viewed 2668 times

Excuse my ignorance - still learning here :)


User avatar
ianstephens
Posts: 37
Joined: Sun Feb 14, 2021 7:20 pm
Has thanked: 5 times

Re: Phaze-A - 256px Demo

Post by ianstephens »

Quick question @torzdf -

Did you use "no warp" at the end of training for this video? Or was it simply a run of ~2M iterations with the StoJo preset model?


User avatar
bryanlyon
Site Admin
Posts: 620
Joined: Fri Jul 12, 2019 12:49 am
Answers: 40
Location: San Francisco
Has thanked: 3 times
Been thanked: 158 times
Contact:

Re: Phaze-A - 256px Demo

Post by bryanlyon »

ianstephens wrote: Mon Jul 12, 2021 8:31 pm

Quick question @torzdf -

Did you use "no warp" at the end of training for this video? Or was it simply a run of 2M iterations with the StoJo preset model?

Torzdf has said in the past that he regularly turns off warp for the last part of training. I would guess that he did the same here.

torzdf wrote: Tue Jan 26, 2021 12:27 am

Yeah, disabling warp late in train is proper "secret sauce".

I may move it to the main window at some point in the not too distant future.

Disabling warp from the very beginning is enough to totally kill most models though. Think of it as baking the cake (warp on) then icing the cake (warp off).


User avatar
torzdf
Posts: 1422
Joined: Fri Jul 12, 2019 12:53 am
Answers: 125
Has thanked: 47 times
Been thanked: 275 times

Re: Phaze-A - 256px Demo

Post by torzdf »

ianstephens wrote: Tue Jul 06, 2021 1:52 pm

Is this simple change below all it takes to train at 384px for example (or is there more to it)?

Short answer. You could just do that, but there's more to it.

Long answer: A lot of maths.... I will come back and articulate at some point in the (hopefully) not too distant future.

My word is final


User avatar
torzdf
Posts: 1422
Joined: Fri Jul 12, 2019 12:53 am
Answers: 125
Has thanked: 47 times
Been thanked: 275 times

Re: Phaze-A - 256px Demo

Post by torzdf »

ianstephens wrote: Mon Jul 12, 2021 8:31 pm

Quick question @torzdf -

Did you use "no warp" at the end of training for this video? Or was it simply a run of 2M iterations with the StoJo preset model?

Yes. Can't remember when I disabled. Probably about halfway through

My word is final


Post Reply