Poor quality of the alignment file after Extract

Extracting faces for training and converting
Forum rules
Read the FAQs and search the forum before posting a new topic.

Please mark any answers that fixed your problems so others can find the solutions.
Locked
User avatar
uequalsn
Posts: 4
Joined: Tue Dec 10, 2019 1:32 pm
Has thanked: 1 time
Been thanked: 1 time

Poor quality of the alignment file after Extract

Post by uequalsn » Wed Dec 11, 2019 12:09 pm

Hi All,

I wonder if there's a way to streamline the extraction process in terms of the quality of the output alignment file. Tried to extract the face from a video in mkv format using recommended Detector and Aligner (S3Fd and Fan, respectively). Ran extraction with two different maskers (VGG-Obstructed, Extended). The results are roughly the same: I literally have to click through all the frames and fix displaced face contours.

While I can imagine that it may be hard for the algo to detect a face in a dynamic scene, but this is not my case. Any suggestions are appreciated!

User avatar
bryanlyon
Site Admin
Posts: 273
Joined: Fri Jul 12, 2019 12:49 am
Answers: 20
Location: San Francisco
Has thanked: 3 times
Been thanked: 77 times
Contact:

Re: Poor quality of the alignment file after Extract

Post by bryanlyon » Sat Dec 14, 2019 5:05 am

Alignments do not have to be exact, especially when using a smart mask. In those situations, the alignments are just used to get the face generally upright.

User avatar
djandg
Posts: 22
Joined: Mon Dec 09, 2019 7:00 pm
Has thanked: 2 times
Been thanked: 2 times

Re: Poor quality of the alignment file after Extract

Post by djandg » Sat Dec 14, 2019 1:30 pm

Ive seen that sometimes the detector picks up false faces and aligns, so two or maybe more alignments can be on a frame. Especially of its a crowded video. So I normaly end up running manual alignment to get ride of these "ghosts". Time consuming but thats the way it is, A coffee machine is a great "ghost" :lol:

User avatar
bryanlyon
Site Admin
Posts: 273
Joined: Fri Jul 12, 2019 12:49 am
Answers: 20
Location: San Francisco
Has thanked: 3 times
Been thanked: 77 times
Contact:

Re: Poor quality of the alignment file after Extract

Post by bryanlyon » Sun Dec 15, 2019 8:15 pm

Yes, and our guide covers both the alignment tool and the sort tool. The sort tool is definitely going to be the faster and easier option for doing this.

Locked