Corridor Digital's Faceswap videos.

Display post links to interesting swaps
Post Reply
User avatar
bryanlyon
Site Admin
Posts: 87
Joined: Fri Jul 12, 2019 12:49 am
Answers: 9
Location: San Francisco
Has thanked: 3 times
Been thanked: 15 times
Contact:

Corridor Digital's Faceswap videos.

Post by bryanlyon » Fri Jul 19, 2019 6:08 pm





Good examples of what can be done with FS + some post processing. Also a cool Behind The Scenes of the action. Check it out.

User avatar
Sanscouer
Posts: 2
Joined: Thu Jul 25, 2019 4:13 pm

Re: Corridor Digital's Faceswap videos.

Post by Sanscouer » Thu Jul 25, 2019 4:15 pm

They do a nice work on that using the DeepFaceLab, they have other with making a Tom Cruise

User avatar
bryanlyon
Site Admin
Posts: 87
Joined: Fri Jul 12, 2019 12:49 am
Answers: 9
Location: San Francisco
Has thanked: 3 times
Been thanked: 15 times
Contact:

Re: Corridor Digital's Faceswap videos.

Post by bryanlyon » Thu Jul 25, 2019 5:04 pm

Sanscouer wrote:
Thu Jul 25, 2019 4:15 pm
They do a nice work on that using the DeepFaceLab,
This was actually almost entirely made with FaceSwap, not DFL. Some shots were DFL, but the vast majority were FaceSwap.

In fact, check out the second video where they explain exactly that.

User avatar
AndrewB
Posts: 8
Joined: Tue Nov 12, 2019 10:16 am
Has thanked: 1 time

Re: Corridor Digital's Faceswap videos.

Post by AndrewB » Thu Nov 14, 2019 3:46 pm

Did they used the Villain model for most of the shots? The final result is great!

User avatar
bryanlyon
Site Admin
Posts: 87
Joined: Fri Jul 12, 2019 12:49 am
Answers: 9
Location: San Francisco
Has thanked: 3 times
Been thanked: 15 times
Contact:

Re: Corridor Digital's Faceswap videos.

Post by bryanlyon » Mon Nov 18, 2019 9:14 pm

A quote from Niko about the stuff he was using.
nikopueringer 07/14/2019
Answering a couple of the questions from further up;
We used both FS and DFL. In FS we used the villain model, with 100% coverage and extended mask. I first pretrained the villain model for 50k iterations on random faces, then began training it on Keanu from there. The face tone and shading was more natural and “stable” with my pretraining vs no pretraining, but my method then was still rough, and there are things I would try differently if I were to go back.
What you see in the video is almost always the villain model, with the DFL mode being used for the closeup at the end and two other collide-ups in the video
The villain model was trained to 200k iterations on top of the 50k pretrain
It looked more faithful to Keanu’s likeness, but occasionally struggled to match the lighting, and was limited to 128x128 resolution.
The DFL model was SAE, but using the LIAE option, so similar to using IAE in fsceswap.
That was pretrained as well, and then ran on Keanu to 250k iterations. The resolution was 256x256, so noticeably clearer.
The DFL model incorporated more of the base face when generating the new face, so the lighting matched better and some more complicated expressions came through clearer. The downside is that it looked close to Keanu, but sometimes wasn’t completely faithful to his identity.
The ending “selfie” moment is DFL.
So both models had their perks. We focused on using Villain in the beginning to help break the barrier of disbelief, and once that was achieved we had more flexibility in using the DFL model when needed.
Typed this on my phone so there are a few auto-correct errors...

Post Reply