Cannot extract due to UnicodeDecodeError

Extracting faces for training and converting
Forum rules
Read the FAQs and search the forum before posting a new topic.

Please mark any answers that fixed your problems so others can find the solutions.
Locked
User avatar
skyhigh21
Posts: 2
Joined: Sat Aug 22, 2020 8:17 pm
Has thanked: 1 time

Cannot extract due to UnicodeDecodeError

Post by skyhigh21 »

I am able to extract most videos just fine, but some videos I cannot.
I think it has something to do with UnicodeDecodeError, because the last thing Faceswap displays before writing a crash report is "UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 134: illegal multibyte sequence".
I will paste the crash report contents, hope someone can help.

Crash Report:

Code: Select all

08/23/2020 05:15:34 MainProcess     MainThread      logger          log_setup                 INFO     Log level set to: INFO
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initializing GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    OS is not macOS. Trying pynvml
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Device count: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Active GPU Devices: [0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Handles found: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Driver: 451.67
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Devices: ['GeForce GTX 1660 SUPER']
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU VRAM: [6144.0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initialized GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initializing GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    OS is not macOS. Trying pynvml
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Device count: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Active GPU Devices: [0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Handles found: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Driver: 451.67
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Devices: ['GeForce GTX 1660 SUPER']
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU VRAM: [6144.0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initialized GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      launcher        _configure_backend        DEBUG    Executing: extract. PID: 15064
08/23/2020 05:15:34 MainProcess     MainThread      tpu_cluster_resolver <module>                  DEBUG    Falling back to TensorFlow client; we recommended you install the Cloud TPU client directly with pip install cloud-tpu-client.
08/23/2020 05:15:35 MainProcess     MainThread      launcher        _test_for_tf_version      DEBUG    Installed Tensorflow Version: 2.2
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initializing QueueManager
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initialized QueueManager
08/23/2020 05:15:36 MainProcess     MainThread      extract         __init__                  DEBUG    Initializing Extract: (args: Namespace(aligner='fan', alignments_path=None, colab=False, configfile=None, debug_landmarks=False, detector='s3fd', exclude_gpus=None, extract_every_n=1, filter=None, func=<bound method ScriptExecutor.execute_script of <lib.cli.launcher.ScriptExecutor object at 0x000002393EAC3850>>, input_dir='D:\\Faceswap Proj\\NKW3.mp4', logfile=None, loglevel='INFO', masker=None, min_size=0, nfilter=None, normalization='none', output_dir='D:\\Faceswap Proj\\FaceB', redirect_gui=True, ref_threshold=0.4, rotate_images=None, save_interval=0, singleprocess=False, size=256, skip_existing=False, skip_faces=False, skip_saving_faces=False)
08/23/2020 05:15:36 MainProcess     MainThread      utils           get_folder                DEBUG    Requested path: 'D:\Faceswap Proj\FaceB'
08/23/2020 05:15:36 MainProcess     MainThread      utils           get_folder                DEBUG    Returning: 'D:\Faceswap Proj\FaceB'
08/23/2020 05:15:36 MainProcess     MainThread      extract         __init__                  INFO     Output Directory: D:\Faceswap Proj\FaceB
08/23/2020 05:15:36 MainProcess     MainThread      image           __init__                  DEBUG    Initializing ImagesLoader: (path: D:\Faceswap Proj\NKW3.mp4, queue_size: 8, fast_count: True, skip_list: None, count: None)
08/23/2020 05:15:36 MainProcess     MainThread      image           __init__                  DEBUG    Initializing ImagesLoader: (path: D:\Faceswap Proj\NKW3.mp4, queue_size: 8, args: None)
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   get_queue                 DEBUG    QueueManager getting: 'ImagesLoader'
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   add_queue                 DEBUG    QueueManager adding: (name: 'ImagesLoader', maxsize: 8)
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   add_queue                 DEBUG    QueueManager added: (name: 'ImagesLoader')
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   get_queue                 DEBUG    QueueManager got: 'ImagesLoader'
08/23/2020 05:15:36 MainProcess     MainThread      image           _check_for_video          DEBUG    Input 'D:\Faceswap Proj\NKW3.mp4' is_video: True
08/23/2020 05:15:36 MainProcess     MainThread      image           _get_fps                  DEBUG    29.97
08/23/2020 05:15:36 MainProcess     MainThread      image           count_frames              DEBUG    filename: D:\Faceswap Proj\NKW3.mp4, fast: True
08/23/2020 05:15:36 MainProcess     MainThread      image           count_frames              DEBUG    FFMPEG Command: 'C:\Users\Aron Ha\MiniConda3\envs\faceswap\Library\bin\ffmpeg.exe -i D:\Faceswap Proj\NKW3.mp4 -map 0:v:0 -c copy -f null -'
Traceback (most recent call last):
  File "D:\PC Games\faceswap\lib\cli\launcher.py", line 155, in execute_script
    process = script(arguments)
  File "D:\PC Games\faceswap\scripts\extract.py", line 44, in __init__
    self._images = ImagesLoader(self._args.input_dir, fast_count=True)
  File "D:\PC Games\faceswap\lib\image.py", line 754, in __init__
    self._get_count_and_filelist(fast_count, count)
  File "D:\PC Games\faceswap\lib\image.py", line 858, in _get_count_and_filelist
    self._count = int(count_frames(self.location,
  File "D:\PC Games\faceswap\lib\image.py", line 584, in count_frames
    output = process.stdout.readline().strip()
UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 134: illegal multibyte sequence

============ System Information ============
encoding:            cp949
git_branch:          Not Found
git_commits:         Not Found
gpu_cuda:            No global version found. Check Conda packages for Conda Cuda
gpu_cudnn:           No global version found. Check Conda packages for Conda cuDNN
gpu_devices:         GPU_0: GeForce GTX 1660 SUPER
gpu_devices_active:  GPU_0
gpu_driver:          451.67
gpu_vram:            GPU_0: 6144MB
os_machine:          AMD64
os_platform:         Windows-10-10.0.18362-SP0
os_release:          10
py_command:          D:\PC Games\faceswap\faceswap.py extract -i D:/Faceswap Proj/NKW3.mp4 -o D:/Faceswap Proj/FaceB -D s3fd -A fan -nm none -min 0 -l 0.4 -een 1 -sz 256 -si 0 -L INFO -gui
py_conda_version:    conda 4.8.4
py_implementation:   CPython
py_version:          3.8.5
py_virtual_env:      True
sys_cores:           12
sys_processor:       AMD64 Family 23 Model 113 Stepping 0, AuthenticAMD
sys_ram:             Total: 16333MB, Available: 10848MB, Used: 5484MB, Free: 10848MB

=============== Pip Packages ===============


============== Conda Packages ==============
# packages in environment at C:\Users\Aron Ha\MiniConda3\envs\faceswap:
#
# Name                    Version                   Build  Channel
absl-py                   0.10.0                   pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
blas                      1.0                         mkl  
ca-certificates           2020.6.24                     0  
cachetools                4.1.1                    pypi_0    pypi
certifi                   2020.6.20                py38_0  
chardet                   3.0.4                    pypi_0    pypi
cudatoolkit               10.1.243             h74a9793_0  
cudnn                     7.6.5                cuda10.1_0  
cycler                    0.10.0                   py38_0  
fastcluster               1.1.26           py38hbe40bda_1    conda-forge
ffmpeg                    4.3.1                ha925a31_0    conda-forge
ffmpy                     0.2.3                    pypi_0    pypi
freetype                  2.10.2               hd328e21_0  
gast                      0.3.3                    pypi_0    pypi
git                       2.23.0               h6bb4b03_0  
google-auth               1.20.1                   pypi_0    pypi
google-auth-oauthlib      0.4.1                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
grpcio                    1.31.0                   pypi_0    pypi
h5py                      2.10.0                   pypi_0    pypi
icc_rt                    2019.0.0             h0cc432a_1  
icu                       58.2                 ha925a31_3  
idna                      2.10                     pypi_0    pypi
imageio                   2.9.0                      py_0  
imageio-ffmpeg            0.4.2                      py_0    conda-forge
intel-openmp              2020.1                      216  
joblib                    0.16.0                     py_0  
jpeg                      9b                   hb83a4c4_2  
keras-preprocessing       1.1.2                    pypi_0    pypi
kiwisolver                1.2.0            py38h74a9793_0  
libpng                    1.6.37               h2a8f88b_0  
libtiff                   4.1.0                h56a325e_1  
lz4-c                     1.9.2                h62dcd97_1  
markdown                  3.2.2                    pypi_0    pypi
matplotlib                3.2.2                         0  
matplotlib-base           3.2.2            py38h64f37c6_0  
mkl                       2020.1                      216  
mkl-service               2.3.0            py38hb782905_0  
mkl_fft                   1.1.0            py38h45dec08_0  
mkl_random                1.1.1            py38h47e9c7a_0  
numpy                     1.19.1           py38h5510c5b_0  
numpy-base                1.19.1           py38ha3acd2a_0  
nvidia-ml-py3             7.352.1                  pypi_0    pypi
oauthlib                  3.1.0                    pypi_0    pypi
olefile                   0.46                       py_0  
opencv-python             4.4.0.42                 pypi_0    pypi
openssl                   1.1.1g               he774522_1  
opt-einsum                3.3.0                    pypi_0    pypi
pathlib                   1.0.1                      py_1  
pillow                    7.2.0            py38hcc1f983_0  
pip                       20.2.2                   py38_0  
protobuf                  3.13.0                   pypi_0    pypi
psutil                    5.7.0            py38he774522_0  
pyasn1                    0.4.8                    pypi_0    pypi
pyasn1-modules            0.2.8                    pypi_0    pypi
pyparsing                 2.4.7                      py_0  
pyqt                      5.9.2            py38ha925a31_4  
python                    3.8.5                he1778fa_0  
python-dateutil           2.8.1                      py_0  
python_abi                3.8                      1_cp38    conda-forge
pywin32                   227              py38he774522_1  
qt                        5.9.7            vc14h73c81de_0  
requests                  2.24.0                   pypi_0    pypi
requests-oauthlib         1.3.0                    pypi_0    pypi
rsa                       4.6                      pypi_0    pypi
scikit-learn              0.23.1           py38h25d0782_0  
scipy                     1.4.1                    pypi_0    pypi
setuptools                49.6.0                   py38_0  
sip                       4.19.13          py38ha925a31_0  
six                       1.15.0                     py_0  
sqlite                    3.33.0               h2a8f88b_0  
tensorboard               2.2.2                    pypi_0    pypi
tensorboard-plugin-wit    1.7.0                    pypi_0    pypi
tensorflow-gpu            2.2.0                    pypi_0    pypi
tensorflow-gpu-estimator  2.2.0                    pypi_0    pypi
termcolor                 1.1.0                    pypi_0    pypi
threadpoolctl             2.1.0              pyh5ca1d4c_0  
tk                        8.6.10               he774522_0  
tornado                   6.0.4            py38he774522_1  
tqdm                      4.48.2                     py_0  
urllib3                   1.25.10                  pypi_0    pypi
vc                        14.1                 h0510ff6_4  
vs2015_runtime            14.16.27012          hf0eaf9b_3  
werkzeug                  1.0.1                    pypi_0    pypi
wheel                     0.34.2                   py38_0  
wincertstore              0.2                      py38_0  
wrapt                     1.12.1                   pypi_0    pypi
xz                        5.2.5                h62dcd97_0  
zlib                      1.2.11               h62dcd97_4  
zstd                      1.4.5                h04227a9_0  

================= Configs ==================
--------- .faceswap ---------
backend:                  nvidia

--------- convert.ini ---------

[color.color_transfer]
clip:                     True
preserve_paper:           True

[color.manual_balance]
colorspace:               HSV
balance_1:                0.0
balance_2:                0.0
balance_3:                0.0
contrast:                 0.0
brightness:               0.0

[color.match_hist]
threshold:                99.0

[mask.box_blend]
type:                     gaussian
distance:                 11.0
radius:                   5.0
passes:                   1

[mask.mask_blend]
type:                     normalized
kernel_size:              3
passes:                   4
threshold:                4
erosion:                  0.0

[scaling.sharpen]
method:                   unsharp_mask
amount:                   150
radius:                   0.3
threshold:                5.0

[writer.ffmpeg]
container:                mp4
codec:                    libx264
crf:                      23
preset:                   medium
tune:                     none
profile:                  auto
level:                    auto
skip_mux:                 False

[writer.gif]
fps:                      25
loop:                     0
palettesize:              256
subrectangles:            False

[writer.opencv]
format:                   png
draw_transparent:         False
jpg_quality:              75
png_compress_level:       3

[writer.pillow]
format:                   png
draw_transparent:         False
optimize:                 False
gif_interlace:            True
jpg_quality:              75
png_compress_level:       3
tif_compression:          tiff_deflate

--------- extract.ini ---------

[global]
allow_growth:             True

[align.fan]
batch-size:               12

[detect.cv2_dnn]
confidence:               50

[detect.mtcnn]
minsize:                  20
threshold_1:              0.6
threshold_2:              0.7
threshold_3:              0.7
scalefactor:              0.709
batch-size:               8

[detect.s3fd]
confidence:               70
batch-size:               4

[mask.unet_dfl]
batch-size:               8

[mask.vgg_clear]
batch-size:               6

[mask.vgg_obstructed]
batch-size:               2

--------- gui.ini ---------

[global]
fullscreen:               False
tab:                      extract
options_panel_width:      30
console_panel_height:     20
icon_size:                14
font:                     default
font_size:                9
autosave_last_session:    prompt
timeout:                  120
auto_load_model_stats:    True

--------- train.ini ---------

[global]
coverage:                 68.75
mask_type:                extended
mask_blur_kernel:         3
mask_threshold:           4
learn_mask:               False
penalized_mask_loss:      True
loss_function:            mae
icnr_init:                False
conv_aware_init:          False
optimizer:                adam
learning_rate:            5e-05
reflect_padding:          False
allow_growth:             False
mixed_precision:          False
convert_batchsize:        16

[model.dfl_h128]
lowmem:                   False

[model.dfl_sae]
input_size:               128
clipnorm:                 True
architecture:             df
autoencoder_dims:         0
encoder_dims:             42
decoder_dims:             21
multiscale_decoder:       False

[model.dlight]
features:                 best
details:                  good
output_size:              256

[model.original]
lowmem:                   False

[model.realface]
input_size:               64
output_size:              128
dense_nodes:              1536
complexity_encoder:       128
complexity_decoder:       512

[model.unbalanced]
input_size:               128
lowmem:                   False
clipnorm:                 True
nodes:                    1024
complexity_encoder:       128
complexity_decoder_a:     384
complexity_decoder_b:     512

[model.villain]
lowmem:                   False

[trainer.original]
preview_images:           14
zoom_amount:              5
rotation_range:           10
shift_range:              5
flip_chance:              50
color_lightness:          30
color_ab:                 8
color_clahe_chance:       50
color_clahe_max_size:     4
by torzdf » Sun Aug 23, 2020 7:47 am
This is the same issue as seen here: viewtopic.php?f=7&t=881

Please try the workarounds I have posted.
Go to full post

User avatar
torzdf
Posts: 948
Joined: Fri Jul 12, 2019 12:53 am
Answers: 126
Has thanked: 26 times
Been thanked: 185 times

Re: Cannot extract due to UnicodeDecodeError

Post by torzdf »

This is the same issue as seen here: viewtopic.php?f=7&t=881

Please try the workarounds I have posted.

My word is final


User avatar
skyhigh21
Posts: 2
Joined: Sat Aug 22, 2020 8:17 pm
Has thanked: 1 time

Re: Cannot extract due to UnicodeDecodeError

Post by skyhigh21 »

torzdf wrote: Sun Aug 23, 2020 7:47 am This is the same issue as seen here: viewtopic.php?f=7&t=881

Please try the workarounds I have posted.
It worked! Thank you very much.

Locked