Conversion problem

Converting source frames into swapped frames
Forum rules
Read the FAQs and search the forum before posting a new topic.

Please mark any answers that fixed your problems so others can find the solutions.
Post Reply
User avatar
dreamsafterdeath
Posts: 1
Joined: Sun Mar 01, 2020 4:17 pm

Conversion problem

Post by dreamsafterdeath » Sun Mar 01, 2020 4:39 pm

Hi all,

I cannot seem to convert my video.

What happens:

When I hit Convert, the convert.py starts running and it says it is counting frames. It counts around 2500. (It is strange because the video has around 80k frames). Then the swapping starts and the preview shows kind of the original pictures without swaps. Being more precise only around every 5th picture is swapped.

How I've got here.

I had an A video and a B video. I extracted faces from both. Then I copied a given amount of faces from both to different directories and I trained a model. The results are still not perfect but I wanted to see how it looks in a video.

After the failure, I immediately thought that my alignment does not contain everything. I've re-read everything in the guides and thought the problem is with my alignment files. So I regenerated the VIDEO A alignment file by exporting out everything again. The resulted alignment file is much bigger than the previous one, so I have given it another run. But unfortunately, the results are the same. I even deleted the old alignment files. I tried it both setting the path of the alignment file and not setting it.

I also tried to copy the new alignment file to another directory and I used the alignment tool to remove faces from it which are not in my training A face directory. The resulted alignment file is much smaller now than the original big for all the faces. Then I tried to continue the training. It worked. Then I tried to repeat the conversion with the "updated" model in hope of something has changed - but I get the same result.

Where should be the problem and how could I fix it?

Many Thanks!

User avatar
deephomage
Posts: 22
Joined: Fri Jul 12, 2019 6:09 pm
Has thanked: 2 times
Been thanked: 5 times

Re: Conversion problem

Post by deephomage » Sun Mar 01, 2020 5:55 pm

I would suggest that you use a 1 to 2-minute destination clip, not attempt to convert 80,000 frames.

If only the fifth frame of the destination clip is converted, it sounds like something went awry during the extraction process. You need to extract every face in the destination clip and remove the unwanted faces. If you manually align any of the extracted faces, you need to re-extract all the faces using the Extract option under the Alignments tab, so that the manually-aligned faces are included in the updated alignments.fsa.

User avatar
sethcoast
Posts: 4
Joined: Mon Oct 14, 2019 5:37 pm
Has thanked: 2 times

Re: Conversion problem

Post by sethcoast » Thu Mar 05, 2020 6:09 am

I'm having the same issue with "counting frames" being much less than my actual number of frames. Did you ever figure this problem out?

User avatar
torzdf
Posts: 447
Joined: Fri Jul 12, 2019 12:53 am
Answers: 77
Has thanked: 14 times
Been thanked: 98 times

Re: Conversion problem

Post by torzdf » Thu Mar 05, 2020 9:25 am

Videos files come in many shapes and sizes. Some software encodes videos better than others. Some completely ignore the "rules".

For most players/editing software this doesn't matter. For Faceswap it is crucial as we need 100% frame accuracy.

If you are having this kind of issue, you should either re-encode the video, or look to extract the individual frames from the video and process from those.
My word is final

Post Reply