Page 1 of 1

Cannot extract due to UnicodeDecodeError

Posted: Sat Aug 22, 2020 8:26 pm
by skyhigh21

I am able to extract most videos just fine, but some videos I cannot.
I think it has something to do with UnicodeDecodeError, because the last thing Faceswap displays before writing a crash report is "UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 134: illegal multibyte sequence".
I will paste the crash report contents, hope someone can help.

Crash Report:

Code: Select all

08/23/2020 05:15:34 MainProcess     MainThread      logger          log_setup                 INFO     Log level set to: INFO
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initializing GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    OS is not macOS. Trying pynvml
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Device count: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Active GPU Devices: [0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Handles found: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Driver: 451.67
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Devices: ['GeForce GTX 1660 SUPER']
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU VRAM: [6144.0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initialized GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initializing GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    OS is not macOS. Trying pynvml
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Device count: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Active GPU Devices: [0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Handles found: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Driver: 451.67
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Devices: ['GeForce GTX 1660 SUPER']
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU VRAM: [6144.0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initialized GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      launcher        _configure_backend        DEBUG    Executing: extract. PID: 15064
08/23/2020 05:15:34 MainProcess     MainThread      tpu_cluster_resolver <module>                  DEBUG    Falling back to TensorFlow client; we recommended you install the Cloud TPU client directly with pip install cloud-tpu-client.
08/23/2020 05:15:35 MainProcess     MainThread      launcher        _test_for_tf_version      DEBUG    Installed Tensorflow Version: 2.2
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initializing QueueManager
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initialized QueueManager
08/23/2020 05:15:36 MainProcess     MainThread      extract         __init__                  DEBUG    Initializing Extract: (args: Namespace(aligner='fan', alignments_path=None, colab=False, configfile=None, debug_landmarks=False, detector='s3fd', exclude_gpus=None, extract_every_n=1, filter=None, func=<bound method ScriptExecutor.execute_script of <lib.cli.launcher.ScriptExecutor object at 0x000002393EAC3850>>, input_dir='D:\\Faceswap Proj\\NKW3.mp4', logfile=None, loglevel='INFO', masker=None, min_size=0, nfilter=None, normalization='none', output_dir='D:\\Faceswap Proj\\FaceB', redirect_gui=True, ref_threshold=0.4, rotate_images=None, save_interval=0, singleprocess=False, size=256, skip_existing=False, skip_faces=False, skip_saving_faces=False)
08/23/2020 05:15:36 MainProcess     MainThread      utils           get_folder                DEBUG    Requested path: 'D:\Faceswap Proj\FaceB'
08/23/2020 05:15:36 MainProcess     MainThread      utils           get_folder                DEBUG    Returning: 'D:\Faceswap Proj\FaceB'
08/23/2020 05:15:36 MainProcess     MainThread      extract         __init__                  INFO     Output Directory: D:\Faceswap Proj\FaceB
08/23/2020 05:15:36 MainProcess     MainThread      image           __init__                  DEBUG    Initializing ImagesLoader: (path: D:\Faceswap Proj\NKW3.mp4, queue_size: 8, fast_count: True, skip_list: None, count: None)
08/23/2020 05:15:36 MainProcess     MainThread      image           __init__                  DEBUG    Initializing ImagesLoader: (path: D:\Faceswap Proj\NKW3.mp4, queue_size: 8, args: None)
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   get_queue                 DEBUG    QueueManager getting: 'ImagesLoader'
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   add_queue                 DEBUG    QueueManager adding: (name: 'ImagesLoader', maxsize: 8)
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   add_queue                 DEBUG    QueueManager added: (name: 'ImagesLoader')
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   get_queue                 DEBUG    QueueManager got: 'ImagesLoader'
08/23/2020 05:15:36 MainProcess     MainThread      image           _check_for_video          DEBUG    Input 'D:\Faceswap Proj\NKW3.mp4' is_video: True
08/23/2020 05:15:36 MainProcess     MainThread      image           _get_fps                  DEBUG    29.97
08/23/2020 05:15:36 MainProcess     MainThread      image           count_frames              DEBUG    filename: D:\Faceswap Proj\NKW3.mp4, fast: True
08/23/2020 05:15:36 MainProcess     MainThread      image           count_frames              DEBUG    FFMPEG Command: 'C:\Users\Aron Ha\MiniConda3\envs\faceswap\Library\bin\ffmpeg.exe -i D:\Faceswap Proj\NKW3.mp4 -map 0:v:0 -c copy -f null -'
Traceback (most recent call last):
  File "D:\PC Games\faceswap\lib\cli\launcher.py", line 155, in execute_script
    process = script(arguments)
  File "D:\PC Games\faceswap\scripts\extract.py", line 44, in __init__
    self._images = ImagesLoader(self._args.input_dir, fast_count=True)
  File "D:\PC Games\faceswap\lib\image.py", line 754, in __init__
    self._get_count_and_filelist(fast_count, count)
  File "D:\PC Games\faceswap\lib\image.py", line 858, in _get_count_and_filelist
    self._count = int(count_frames(self.location,
  File "D:\PC Games\faceswap\lib\image.py", line 584, in count_frames
    output = process.stdout.readline().strip()
UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 134: illegal multibyte sequence

============ System Information ============
encoding:            cp949
git_branch:          Not Found
git_commits:         Not Found
gpu_cuda:            No global version found. Check Conda packages for Conda Cuda
gpu_cudnn:           No global version found. Check Conda packages for Conda cuDNN
gpu_devices:         GPU_0: GeForce GTX 1660 SUPER
gpu_devices_active:  GPU_0
gpu_driver:          451.67
gpu_vram:            GPU_0: 6144MB
os_machine:          AMD64
os_platform:         Windows-10-10.0.18362-SP0
os_release:          10
py_command:          D:\PC Games\faceswap\faceswap.py extract -i D:/Faceswap Proj/NKW3.mp4 -o D:/Faceswap Proj/FaceB -D s3fd -A fan -nm none -min 0 -l 0.4 -een 1 -sz 256 -si 0 -L INFO -gui
py_conda_version:    conda 4.8.4
py_implementation:   CPython
py_version:          3.8.5
py_virtual_env:      True
sys_cores:           12
sys_processor:       AMD64 Family 23 Model 113 Stepping 0, AuthenticAMD
sys_ram:             Total: 16333MB, Available: 10848MB, Used: 5484MB, Free: 10848MB

=============== Pip Packages ===============


============== Conda Packages ==============
# packages in environment at C:\Users\Aron Ha\MiniConda3\envs\faceswap:
#
# Name                    Version                   Build  Channel
absl-py                   0.10.0                   pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
blas                      1.0                         mkl  
ca-certificates 2020.6.24 0
cachetools 4.1.1 pypi_0 pypi certifi 2020.6.20 py38_0
chardet 3.0.4 pypi_0 pypi cudatoolkit 10.1.243 h74a9793_0
cudnn 7.6.5 cuda10.1_0
cycler 0.10.0 py38_0
fastcluster 1.1.26 py38hbe40bda_1 conda-forge ffmpeg 4.3.1 ha925a31_0 conda-forge ffmpy 0.2.3 pypi_0 pypi freetype 2.10.2 hd328e21_0
gast 0.3.3 pypi_0 pypi git 2.23.0 h6bb4b03_0
google-auth 1.20.1 pypi_0 pypi google-auth-oauthlib 0.4.1 pypi_0 pypi google-pasta 0.2.0 pypi_0 pypi grpcio 1.31.0 pypi_0 pypi h5py 2.10.0 pypi_0 pypi icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha925a31_3
idna 2.10 pypi_0 pypi imageio 2.9.0 py_0
imageio-ffmpeg 0.4.2 py_0 conda-forge intel-openmp 2020.1 216
joblib 0.16.0 py_0
jpeg 9b hb83a4c4_2
keras-preprocessing 1.1.2 pypi_0 pypi kiwisolver 1.2.0 py38h74a9793_0
libpng 1.6.37 h2a8f88b_0
libtiff 4.1.0 h56a325e_1
lz4-c 1.9.2 h62dcd97_1
markdown 3.2.2 pypi_0 pypi matplotlib 3.2.2 0
matplotlib-base 3.2.2 py38h64f37c6_0
mkl 2020.1 216
mkl-service 2.3.0 py38hb782905_0
mkl_fft 1.1.0 py38h45dec08_0
mkl_random 1.1.1 py38h47e9c7a_0
numpy 1.19.1 py38h5510c5b_0
numpy-base 1.19.1 py38ha3acd2a_0
nvidia-ml-py3 7.352.1 pypi_0 pypi oauthlib 3.1.0 pypi_0 pypi olefile 0.46 py_0
opencv-python 4.4.0.42 pypi_0 pypi openssl 1.1.1g he774522_1
opt-einsum 3.3.0 pypi_0 pypi pathlib 1.0.1 py_1
pillow 7.2.0 py38hcc1f983_0
pip 20.2.2 py38_0
protobuf 3.13.0 pypi_0 pypi psutil 5.7.0 py38he774522_0
pyasn1 0.4.8 pypi_0 pypi pyasn1-modules 0.2.8 pypi_0 pypi pyparsing 2.4.7 py_0
pyqt 5.9.2 py38ha925a31_4
python 3.8.5 he1778fa_0
python-dateutil 2.8.1 py_0
python_abi 3.8 1_cp38 conda-forge pywin32 227 py38he774522_1
qt 5.9.7 vc14h73c81de_0
requests 2.24.0 pypi_0 pypi requests-oauthlib 1.3.0 pypi_0 pypi rsa 4.6 pypi_0 pypi scikit-learn 0.23.1 py38h25d0782_0
scipy 1.4.1 pypi_0 pypi setuptools 49.6.0 py38_0
sip 4.19.13 py38ha925a31_0
six 1.15.0 py_0
sqlite 3.33.0 h2a8f88b_0
tensorboard 2.2.2 pypi_0 pypi tensorboard-plugin-wit 1.7.0 pypi_0 pypi tensorflow-gpu 2.2.0 pypi_0 pypi tensorflow-gpu-estimator 2.2.0 pypi_0 pypi termcolor 1.1.0 pypi_0 pypi threadpoolctl 2.1.0 pyh5ca1d4c_0
tk 8.6.10 he774522_0
tornado 6.0.4 py38he774522_1
tqdm 4.48.2 py_0
urllib3 1.25.10 pypi_0 pypi vc 14.1 h0510ff6_4
vs2015_runtime 14.16.27012 hf0eaf9b_3
werkzeug 1.0.1 pypi_0 pypi wheel 0.34.2 py38_0
wincertstore 0.2 py38_0
wrapt 1.12.1 pypi_0 pypi xz 5.2.5 h62dcd97_0
zlib 1.2.11 h62dcd97_4
zstd 1.4.5 h04227a9_0 ================= Configs ================== --------- .faceswap --------- backend: nvidia --------- convert.ini --------- [color.color_transfer] clip: True preserve_paper: True [color.manual_balance] colorspace: HSV balance_1: 0.0 balance_2: 0.0 balance_3: 0.0 contrast: 0.0 brightness: 0.0 [color.match_hist] threshold: 99.0 [mask.box_blend] type: gaussian distance: 11.0 radius: 5.0 passes: 1 [mask.mask_blend] type: normalized kernel_size: 3 passes: 4 threshold: 4 erosion: 0.0 [scaling.sharpen] method: unsharp_mask amount: 150 radius: 0.3 threshold: 5.0 [writer.ffmpeg] container: mp4 codec: libx264 crf: 23 preset: medium tune: none profile: auto level: auto skip_mux: False [writer.gif] fps: 25 loop: 0 palettesize: 256 subrectangles: False [writer.opencv] format: png draw_transparent: False jpg_quality: 75 png_compress_level: 3 [writer.pillow] format: png draw_transparent: False optimize: False gif_interlace: True jpg_quality: 75 png_compress_level: 3 tif_compression: tiff_deflate --------- extract.ini --------- [global] allow_growth: True [align.fan] batch-size: 12 [detect.cv2_dnn] confidence: 50 [detect.mtcnn] minsize: 20 threshold_1: 0.6 threshold_2: 0.7 threshold_3: 0.7 scalefactor: 0.709 batch-size: 8 [detect.s3fd] confidence: 70 batch-size: 4 [mask.unet_dfl] batch-size: 8 [mask.vgg_clear] batch-size: 6 [mask.vgg_obstructed] batch-size: 2 --------- gui.ini --------- [global] fullscreen: False tab: extract options_panel_width: 30 console_panel_height: 20 icon_size: 14 font: default font_size: 9 autosave_last_session: prompt timeout: 120 auto_load_model_stats: True --------- train.ini --------- [global] coverage: 68.75 mask_type: extended mask_blur_kernel: 3 mask_threshold: 4 learn_mask: False penalized_mask_loss: True loss_function: mae icnr_init: False conv_aware_init: False optimizer: adam learning_rate: 5e-05 reflect_padding: False allow_growth: False mixed_precision: False convert_batchsize: 16 [model.dfl_h128] lowmem: False [model.dfl_sae] input_size: 128 clipnorm: True architecture: df autoencoder_dims: 0 encoder_dims: 42 decoder_dims: 21 multiscale_decoder: False [model.dlight] features: best details: good output_size: 256 [model.original] lowmem: False [model.realface] input_size: 64 output_size: 128 dense_nodes: 1536 complexity_encoder: 128 complexity_decoder: 512 [model.unbalanced] input_size: 128 lowmem: False clipnorm: True nodes: 1024 complexity_encoder: 128 complexity_decoder_a: 384 complexity_decoder_b: 512 [model.villain] lowmem: False [trainer.original] preview_images: 14 zoom_amount: 5 rotation_range: 10 shift_range: 5 flip_chance: 50 color_lightness: 30 color_ab: 8 color_clahe_chance: 50 color_clahe_max_size: 4

Re: Cannot extract due to UnicodeDecodeError

Posted: Sun Aug 23, 2020 7:47 am
by torzdf

This is the same issue as seen here: viewtopic.php?f=7&t=881

Please try the workarounds I have posted.


Re: Cannot extract due to UnicodeDecodeError

Posted: Mon Aug 24, 2020 4:53 pm
by skyhigh21
torzdf wrote: Sun Aug 23, 2020 7:47 am

This is the same issue as seen here: viewtopic.php?f=7&t=881

Please try the workarounds I have posted.

It worked! Thank you very much.