Cannot extract due to UnicodeDecodeError

The Extraction process failing on you, and you aren't getting an error back with clear instructions? Tell us about it here


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for reporting errors with the Extraction process. If you want to get tips, or better understand the Extract process, then you should look in the Extract Discussion forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
skyhigh21
Posts: 3
Joined: Sat Aug 22, 2020 8:17 pm
Has thanked: 1 time

Cannot extract due to UnicodeDecodeError

Post by skyhigh21 »

I am able to extract most videos just fine, but some videos I cannot.
I think it has something to do with UnicodeDecodeError, because the last thing Faceswap displays before writing a crash report is "UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 134: illegal multibyte sequence".
I will paste the crash report contents, hope someone can help.

Crash Report:

Code: Select all

08/23/2020 05:15:34 MainProcess     MainThread      logger          log_setup                 INFO     Log level set to: INFO
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initializing GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    OS is not macOS. Trying pynvml
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Device count: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Active GPU Devices: [0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Handles found: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Driver: 451.67
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Devices: ['GeForce GTX 1660 SUPER']
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU VRAM: [6144.0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initialized GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initializing GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    OS is not macOS. Trying pynvml
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Device count: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Active GPU Devices: [0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Handles found: 1
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Driver: 451.67
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Devices: ['GeForce GTX 1660 SUPER']
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU VRAM: [6144.0]
08/23/2020 05:15:34 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initialized GPUStats
08/23/2020 05:15:34 MainProcess     MainThread      launcher        _configure_backend        DEBUG    Executing: extract. PID: 15064
08/23/2020 05:15:34 MainProcess     MainThread      tpu_cluster_resolver <module>                  DEBUG    Falling back to TensorFlow client; we recommended you install the Cloud TPU client directly with pip install cloud-tpu-client.
08/23/2020 05:15:35 MainProcess     MainThread      launcher        _test_for_tf_version      DEBUG    Installed Tensorflow Version: 2.2
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initializing QueueManager
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initialized QueueManager
08/23/2020 05:15:36 MainProcess     MainThread      extract         __init__                  DEBUG    Initializing Extract: (args: Namespace(aligner='fan', alignments_path=None, colab=False, configfile=None, debug_landmarks=False, detector='s3fd', exclude_gpus=None, extract_every_n=1, filter=None, func=<bound method ScriptExecutor.execute_script of <lib.cli.launcher.ScriptExecutor object at 0x000002393EAC3850>>, input_dir='D:\\Faceswap Proj\\NKW3.mp4', logfile=None, loglevel='INFO', masker=None, min_size=0, nfilter=None, normalization='none', output_dir='D:\\Faceswap Proj\\FaceB', redirect_gui=True, ref_threshold=0.4, rotate_images=None, save_interval=0, singleprocess=False, size=256, skip_existing=False, skip_faces=False, skip_saving_faces=False)
08/23/2020 05:15:36 MainProcess     MainThread      utils           get_folder                DEBUG    Requested path: 'D:\Faceswap Proj\FaceB'
08/23/2020 05:15:36 MainProcess     MainThread      utils           get_folder                DEBUG    Returning: 'D:\Faceswap Proj\FaceB'
08/23/2020 05:15:36 MainProcess     MainThread      extract         __init__                  INFO     Output Directory: D:\Faceswap Proj\FaceB
08/23/2020 05:15:36 MainProcess     MainThread      image           __init__                  DEBUG    Initializing ImagesLoader: (path: D:\Faceswap Proj\NKW3.mp4, queue_size: 8, fast_count: True, skip_list: None, count: None)
08/23/2020 05:15:36 MainProcess     MainThread      image           __init__                  DEBUG    Initializing ImagesLoader: (path: D:\Faceswap Proj\NKW3.mp4, queue_size: 8, args: None)
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   get_queue                 DEBUG    QueueManager getting: 'ImagesLoader'
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   add_queue                 DEBUG    QueueManager adding: (name: 'ImagesLoader', maxsize: 8)
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   add_queue                 DEBUG    QueueManager added: (name: 'ImagesLoader')
08/23/2020 05:15:36 MainProcess     MainThread      queue_manager   get_queue                 DEBUG    QueueManager got: 'ImagesLoader'
08/23/2020 05:15:36 MainProcess     MainThread      image           _check_for_video          DEBUG    Input 'D:\Faceswap Proj\NKW3.mp4' is_video: True
08/23/2020 05:15:36 MainProcess     MainThread      image           _get_fps                  DEBUG    29.97
08/23/2020 05:15:36 MainProcess     MainThread      image           count_frames              DEBUG    filename: D:\Faceswap Proj\NKW3.mp4, fast: True
08/23/2020 05:15:36 MainProcess     MainThread      image           count_frames              DEBUG    FFMPEG Command: 'C:\Users\Aron Ha\MiniConda3\envs\faceswap\Library\bin\ffmpeg.exe -i D:\Faceswap Proj\NKW3.mp4 -map 0:v:0 -c copy -f null -'
Traceback (most recent call last):
  File "D:\PC Games\faceswap\lib\cli\launcher.py", line 155, in execute_script
    process = script(arguments)
  File "D:\PC Games\faceswap\scripts\extract.py", line 44, in __init__
    self._images = ImagesLoader(self._args.input_dir, fast_count=True)
  File "D:\PC Games\faceswap\lib\image.py", line 754, in __init__
    self._get_count_and_filelist(fast_count, count)
  File "D:\PC Games\faceswap\lib\image.py", line 858, in _get_count_and_filelist
    self._count = int(count_frames(self.location,
  File "D:\PC Games\faceswap\lib\image.py", line 584, in count_frames
    output = process.stdout.readline().strip()
UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 134: illegal multibyte sequence

============ System Information ============
encoding:            cp949
git_branch:          Not Found
git_commits:         Not Found
gpu_cuda:            No global version found. Check Conda packages for Conda Cuda
gpu_cudnn:           No global version found. Check Conda packages for Conda cuDNN
gpu_devices:         GPU_0: GeForce GTX 1660 SUPER
gpu_devices_active:  GPU_0
gpu_driver:          451.67
gpu_vram:            GPU_0: 6144MB
os_machine:          AMD64
os_platform:         Windows-10-10.0.18362-SP0
os_release:          10
py_command:          D:\PC Games\faceswap\faceswap.py extract -i D:/Faceswap Proj/NKW3.mp4 -o D:/Faceswap Proj/FaceB -D s3fd -A fan -nm none -min 0 -l 0.4 -een 1 -sz 256 -si 0 -L INFO -gui
py_conda_version:    conda 4.8.4
py_implementation:   CPython
py_version:          3.8.5
py_virtual_env:      True
sys_cores:           12
sys_processor:       AMD64 Family 23 Model 113 Stepping 0, AuthenticAMD
sys_ram:             Total: 16333MB, Available: 10848MB, Used: 5484MB, Free: 10848MB

=============== Pip Packages ===============


============== Conda Packages ==============
# packages in environment at C:\Users\Aron Ha\MiniConda3\envs\faceswap:
#
# Name                    Version                   Build  Channel
absl-py                   0.10.0                   pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
blas                      1.0                         mkl  
ca-certificates 2020.6.24 0
cachetools 4.1.1 pypi_0 pypi certifi 2020.6.20 py38_0
chardet 3.0.4 pypi_0 pypi cudatoolkit 10.1.243 h74a9793_0
cudnn 7.6.5 cuda10.1_0
cycler 0.10.0 py38_0
fastcluster 1.1.26 py38hbe40bda_1 conda-forge ffmpeg 4.3.1 ha925a31_0 conda-forge ffmpy 0.2.3 pypi_0 pypi freetype 2.10.2 hd328e21_0
gast 0.3.3 pypi_0 pypi git 2.23.0 h6bb4b03_0
google-auth 1.20.1 pypi_0 pypi google-auth-oauthlib 0.4.1 pypi_0 pypi google-pasta 0.2.0 pypi_0 pypi grpcio 1.31.0 pypi_0 pypi h5py 2.10.0 pypi_0 pypi icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha925a31_3
idna 2.10 pypi_0 pypi imageio 2.9.0 py_0
imageio-ffmpeg 0.4.2 py_0 conda-forge intel-openmp 2020.1 216
joblib 0.16.0 py_0
jpeg 9b hb83a4c4_2
keras-preprocessing 1.1.2 pypi_0 pypi kiwisolver 1.2.0 py38h74a9793_0
libpng 1.6.37 h2a8f88b_0
libtiff 4.1.0 h56a325e_1
lz4-c 1.9.2 h62dcd97_1
markdown 3.2.2 pypi_0 pypi matplotlib 3.2.2 0
matplotlib-base 3.2.2 py38h64f37c6_0
mkl 2020.1 216
mkl-service 2.3.0 py38hb782905_0
mkl_fft 1.1.0 py38h45dec08_0
mkl_random 1.1.1 py38h47e9c7a_0
numpy 1.19.1 py38h5510c5b_0
numpy-base 1.19.1 py38ha3acd2a_0
nvidia-ml-py3 7.352.1 pypi_0 pypi oauthlib 3.1.0 pypi_0 pypi olefile 0.46 py_0
opencv-python 4.4.0.42 pypi_0 pypi openssl 1.1.1g he774522_1
opt-einsum 3.3.0 pypi_0 pypi pathlib 1.0.1 py_1
pillow 7.2.0 py38hcc1f983_0
pip 20.2.2 py38_0
protobuf 3.13.0 pypi_0 pypi psutil 5.7.0 py38he774522_0
pyasn1 0.4.8 pypi_0 pypi pyasn1-modules 0.2.8 pypi_0 pypi pyparsing 2.4.7 py_0
pyqt 5.9.2 py38ha925a31_4
python 3.8.5 he1778fa_0
python-dateutil 2.8.1 py_0
python_abi 3.8 1_cp38 conda-forge pywin32 227 py38he774522_1
qt 5.9.7 vc14h73c81de_0
requests 2.24.0 pypi_0 pypi requests-oauthlib 1.3.0 pypi_0 pypi rsa 4.6 pypi_0 pypi scikit-learn 0.23.1 py38h25d0782_0
scipy 1.4.1 pypi_0 pypi setuptools 49.6.0 py38_0
sip 4.19.13 py38ha925a31_0
six 1.15.0 py_0
sqlite 3.33.0 h2a8f88b_0
tensorboard 2.2.2 pypi_0 pypi tensorboard-plugin-wit 1.7.0 pypi_0 pypi tensorflow-gpu 2.2.0 pypi_0 pypi tensorflow-gpu-estimator 2.2.0 pypi_0 pypi termcolor 1.1.0 pypi_0 pypi threadpoolctl 2.1.0 pyh5ca1d4c_0
tk 8.6.10 he774522_0
tornado 6.0.4 py38he774522_1
tqdm 4.48.2 py_0
urllib3 1.25.10 pypi_0 pypi vc 14.1 h0510ff6_4
vs2015_runtime 14.16.27012 hf0eaf9b_3
werkzeug 1.0.1 pypi_0 pypi wheel 0.34.2 py38_0
wincertstore 0.2 py38_0
wrapt 1.12.1 pypi_0 pypi xz 5.2.5 h62dcd97_0
zlib 1.2.11 h62dcd97_4
zstd 1.4.5 h04227a9_0 ================= Configs ================== --------- .faceswap --------- backend: nvidia --------- convert.ini --------- [color.color_transfer] clip: True preserve_paper: True [color.manual_balance] colorspace: HSV balance_1: 0.0 balance_2: 0.0 balance_3: 0.0 contrast: 0.0 brightness: 0.0 [color.match_hist] threshold: 99.0 [mask.box_blend] type: gaussian distance: 11.0 radius: 5.0 passes: 1 [mask.mask_blend] type: normalized kernel_size: 3 passes: 4 threshold: 4 erosion: 0.0 [scaling.sharpen] method: unsharp_mask amount: 150 radius: 0.3 threshold: 5.0 [writer.ffmpeg] container: mp4 codec: libx264 crf: 23 preset: medium tune: none profile: auto level: auto skip_mux: False [writer.gif] fps: 25 loop: 0 palettesize: 256 subrectangles: False [writer.opencv] format: png draw_transparent: False jpg_quality: 75 png_compress_level: 3 [writer.pillow] format: png draw_transparent: False optimize: False gif_interlace: True jpg_quality: 75 png_compress_level: 3 tif_compression: tiff_deflate --------- extract.ini --------- [global] allow_growth: True [align.fan] batch-size: 12 [detect.cv2_dnn] confidence: 50 [detect.mtcnn] minsize: 20 threshold_1: 0.6 threshold_2: 0.7 threshold_3: 0.7 scalefactor: 0.709 batch-size: 8 [detect.s3fd] confidence: 70 batch-size: 4 [mask.unet_dfl] batch-size: 8 [mask.vgg_clear] batch-size: 6 [mask.vgg_obstructed] batch-size: 2 --------- gui.ini --------- [global] fullscreen: False tab: extract options_panel_width: 30 console_panel_height: 20 icon_size: 14 font: default font_size: 9 autosave_last_session: prompt timeout: 120 auto_load_model_stats: True --------- train.ini --------- [global] coverage: 68.75 mask_type: extended mask_blur_kernel: 3 mask_threshold: 4 learn_mask: False penalized_mask_loss: True loss_function: mae icnr_init: False conv_aware_init: False optimizer: adam learning_rate: 5e-05 reflect_padding: False allow_growth: False mixed_precision: False convert_batchsize: 16 [model.dfl_h128] lowmem: False [model.dfl_sae] input_size: 128 clipnorm: True architecture: df autoencoder_dims: 0 encoder_dims: 42 decoder_dims: 21 multiscale_decoder: False [model.dlight] features: best details: good output_size: 256 [model.original] lowmem: False [model.realface] input_size: 64 output_size: 128 dense_nodes: 1536 complexity_encoder: 128 complexity_decoder: 512 [model.unbalanced] input_size: 128 lowmem: False clipnorm: True nodes: 1024 complexity_encoder: 128 complexity_decoder_a: 384 complexity_decoder_b: 512 [model.villain] lowmem: False [trainer.original] preview_images: 14 zoom_amount: 5 rotation_range: 10 shift_range: 5 flip_chance: 50 color_lightness: 30 color_ab: 8 color_clahe_chance: 50 color_clahe_max_size: 4
by torzdf » Sun Aug 23, 2020 7:47 am

This is the same issue as seen here: viewtopic.php?f=7&t=881

Please try the workarounds I have posted.

Go to full post
User avatar
torzdf
Posts: 2651
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 129 times
Been thanked: 622 times

Re: Cannot extract due to UnicodeDecodeError

Post by torzdf »

This is the same issue as seen here: viewtopic.php?f=7&t=881

Please try the workarounds I have posted.

My word is final

User avatar
skyhigh21
Posts: 3
Joined: Sat Aug 22, 2020 8:17 pm
Has thanked: 1 time

Re: Cannot extract due to UnicodeDecodeError

Post by skyhigh21 »

torzdf wrote: Sun Aug 23, 2020 7:47 am

This is the same issue as seen here: viewtopic.php?f=7&t=881

Please try the workarounds I have posted.

It worked! Thank you very much.

Locked