Page 1 of 1

UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 72: illegal multibyte sequence

Posted: Sun Oct 25, 2020 5:44 am
by skyflypeter

I have no idea to solve this problem

I've already read other people's questions same as me

But I still don't understand how to handle it.

Find a video editing tool that you can use to strip the metadata. (Something like mp3tag should work ok for mp4 files).
=> I can't find appropriate video editing tool

And this is my log

Code: Select all

Setting Faceswap backend to NVIDIA
10/25/2020 14:33:09 INFO     Log level set to: INFO
10/25/2020 14:33:11 INFO     Output Directory: C:\Users\3214p\OneDrive\바탕 화면\영상
10/25/2020 14:33:17 ERROR    Got Exception on main handler:
Traceback (most recent call last):
File "C:\Users\3214p\faceswap\lib\cli\launcher.py", line 181, in execute_script
process = script(arguments)
File "C:\Users\3214p\faceswap\scripts\extract.py", line 45, in __init__
self._images = ImagesLoader(self._args.input_dir, fast_count=True)
File "C:\Users\3214p\faceswap\lib\image.py", line 756, in __init__
self._get_count_and_filelist(fast_count, count)
File "C:\Users\3214p\faceswap\lib\image.py", line 860, in _get_count_and_filelist
self._count = int(count_frames(self.location,
File "C:\Users\3214p\faceswap\lib\image.py", line 586, in count_frames
output = process.stdout.readline().strip()
UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 72: illegal multibyte sequence
10/25/2020 14:33:17 CRITICAL An unexpected crash has occurred. Crash report written to 'C:\Users\3214p\faceswap\crash_report.2020.10.25.143312199532.log'. You MUST provide this file if seeking assistance. Please verify you are running the latest version of faceswap before reporting
Process exited.

Re: UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 72: illegal multibyte sequence

Posted: Sun Oct 25, 2020 10:26 am
by torzdf

Please provide the file 'C:\Users\3214p\faceswap\crash_report.2020.10.25.143312199532.log'


Re: UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 72: illegal multibyte sequence

Posted: Sun Oct 25, 2020 11:59 am
by skyflypeter

This is the file

Code: Select all

10/25/2020 20:57:46 MainProcess     MainThread      logger          log_setup                 INFO     Log level set to: INFO
10/25/2020 20:57:46 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initializing GPUStats
10/25/2020 20:57:46 MainProcess     MainThread      gpu_stats       _log                      DEBUG    OS is not macOS. Trying pynvml
10/25/2020 20:57:46 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Device count: 1
10/25/2020 20:57:46 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Active GPU Devices: [0]
10/25/2020 20:57:46 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Handles found: 1
10/25/2020 20:57:46 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Driver: 456.43
10/25/2020 20:57:46 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU Devices: ['GeForce GTX 1660 SUPER']
10/25/2020 20:57:46 MainProcess     MainThread      gpu_stats       _log                      DEBUG    GPU VRAM: [6144.0]
10/25/2020 20:57:46 MainProcess     MainThread      gpu_stats       _log                      DEBUG    Initialized GPUStats
10/25/2020 20:57:46 MainProcess     MainThread      launcher        _configure_backend        DEBUG    Executing: extract. PID: 7300
10/25/2020 20:57:47 MainProcess     MainThread      tpu_cluster_resolver <module>                  DEBUG    Falling back to TensorFlow client; we recommended you install the Cloud TPU client directly with pip install cloud-tpu-client.
10/25/2020 20:57:48 MainProcess     MainThread      launcher        _test_for_tf_version      DEBUG    Installed Tensorflow Version: 2.2
10/25/2020 20:57:49 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initializing QueueManager
10/25/2020 20:57:49 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initialized QueueManager
10/25/2020 20:57:49 MainProcess     MainThread      extract         __init__                  DEBUG    Initializing Extract: (args: Namespace(aligner='fan', alignments_path=None, colab=False, configfile=None, debug_landmarks=False, detector='s3fd', exclude_gpus=None, extract_every_n=1, filter=None, func=<bound method ScriptExecutor.execute_script of <lib.cli.launcher.ScriptExecutor object at 0x0000024E119EF280>>, input_dir='C:\\Users\\3214p\\OneDrive\\바탕 화면\\영상\\a.mp4', logfile=None, loglevel='INFO', masker=None, min_size=0, nfilter=None, normalization='none', output_dir='C:\\Users\\3214p\\OneDrive\\바탕 화면\\영상', redirect_gui=True, ref_threshold=0.4, rotate_images=None, save_interval=0, singleprocess=False, size=256, skip_existing=False, skip_faces=False, skip_saving_faces=False)
10/25/2020 20:57:49 MainProcess     MainThread      utils           get_folder                DEBUG    Requested path: 'C:\Users\3214p\OneDrive\바탕 화면\영상'
10/25/2020 20:57:49 MainProcess     MainThread      utils           get_folder                DEBUG    Returning: 'C:\Users\3214p\OneDrive\바탕 화면\영상'
10/25/2020 20:57:49 MainProcess     MainThread      extract         __init__                  INFO     Output Directory: C:\Users\3214p\OneDrive\바탕 화면\영상
10/25/2020 20:57:49 MainProcess     MainThread      image           __init__                  DEBUG    Initializing ImagesLoader: (path: C:\Users\3214p\OneDrive\바탕 화면\영상\a.mp4, queue_size: 8, fast_count: True, skip_list: None, count: None)
10/25/2020 20:57:49 MainProcess     MainThread      image           __init__                  DEBUG    Initializing ImagesLoader: (path: C:\Users\3214p\OneDrive\바탕 화면\영상\a.mp4, queue_size: 8, args: None)
10/25/2020 20:57:49 MainProcess     MainThread      queue_manager   get_queue                 DEBUG    QueueManager getting: 'ImagesLoader'
10/25/2020 20:57:49 MainProcess     MainThread      queue_manager   add_queue                 DEBUG    QueueManager adding: (name: 'ImagesLoader', maxsize: 8)
10/25/2020 20:57:49 MainProcess     MainThread      queue_manager   add_queue                 DEBUG    QueueManager added: (name: 'ImagesLoader')
10/25/2020 20:57:49 MainProcess     MainThread      queue_manager   get_queue                 DEBUG    QueueManager got: 'ImagesLoader'
10/25/2020 20:57:49 MainProcess     MainThread      image           _check_for_video          DEBUG    Input 'C:\Users\3214p\OneDrive\바탕 화면\영상\a.mp4' is_video: True
10/25/2020 20:57:50 MainProcess     MainThread      image           _get_fps                  DEBUG    29.97
10/25/2020 20:57:50 MainProcess     MainThread      image           count_frames              DEBUG    filename: C:\Users\3214p\OneDrive\바탕 화면\영상\a.mp4, fast: True
10/25/2020 20:57:50 MainProcess     MainThread      image           count_frames              DEBUG    FFMPEG Command: 'C:\Users\3214p\MiniConda3\envs\faceswap\Library\bin\ffmpeg.exe -i C:\Users\3214p\OneDrive\바탕 화면\영상\a.mp4 -map 0:v:0 -c copy -f null -'
Traceback (most recent call last):
  File "C:\Users\3214p\faceswap\lib\cli\launcher.py", line 181, in execute_script
    process = script(arguments)
  File "C:\Users\3214p\faceswap\scripts\extract.py", line 45, in __init__
    self._images = ImagesLoader(self._args.input_dir, fast_count=True)
  File "C:\Users\3214p\faceswap\lib\image.py", line 756, in __init__
    self._get_count_and_filelist(fast_count, count)
  File "C:\Users\3214p\faceswap\lib\image.py", line 860, in _get_count_and_filelist
    self._count = int(count_frames(self.location,
  File "C:\Users\3214p\faceswap\lib\image.py", line 586, in count_frames
    output = process.stdout.readline().strip()
UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 72: illegal multibyte sequence

============ System Information ============
encoding:            cp949
git_branch:          master
git_commits:         3dbbac5 Convert - Move scaling option exclusively to config
gpu_cuda:            11.1
gpu_cudnn:           No global version found. Check Conda packages for Conda cuDNN
gpu_devices:         GPU_0: GeForce GTX 1660 SUPER
gpu_devices_active:  GPU_0
gpu_driver:          456.43
gpu_vram:            GPU_0: 6144MB
os_machine:          AMD64
os_platform:         Windows-10-10.0.18362-SP0
os_release:          10
py_command:          C:\Users\3214p\faceswap\faceswap.py extract -i C:/Users/3214p/OneDrive/바탕 화면/영상/a.mp4 -o C:/Users/3214p/OneDrive/바탕 화면/영상 -D s3fd -A fan -nm none -min 0 -l 0.4 -een 1 -sz 256 -si 0 -L INFO -gui
py_conda_version:    conda 4.9.0
py_implementation:   CPython
py_version:          3.8.5
py_virtual_env:      True
sys_cores:           6
sys_processor:       AMD64 Family 23 Model 113 Stepping 0, AuthenticAMD
sys_ram:             Total: 16332MB, Available: 9452MB, Used: 6880MB, Free: 9452MB

=============== Pip Packages ===============
absl-py==0.10.0
astunparse==1.6.3
cachetools==4.1.1
certifi==2020.6.20
chardet==3.0.4
cycler==0.10.0
fastcluster==1.1.26
ffmpy==0.2.3
gast==0.3.3
google-auth==1.22.1
google-auth-oauthlib==0.4.1
google-pasta==0.2.0
grpcio==1.33.1
h5py==2.10.0
idna==2.10
imageio @ file:///tmp/build/80754af9/imageio_1594161405741/work
imageio-ffmpeg @ file:///home/conda/feedstock_root/build_artifacts/imageio-ffmpeg_1589202782679/work
joblib @ file:///tmp/build/80754af9/joblib_1601912903842/work
Keras-Preprocessing==1.1.2
kiwisolver==1.2.0
Markdown==3.3.2
matplotlib @ file:///C:/ci/matplotlib-base_1592837548929/work
mkl-fft==1.2.0
mkl-random==1.1.1
mkl-service==2.3.0
numpy==1.18.5
nvidia-ml-py3 @ git+https://github.com/deepfakes/nvidia-ml-py3.git@6fc29ac84b32bad877f078cb4a777c1548a00bf6
oauthlib==3.1.0
olefile==0.46
opencv-python==4.4.0.44
opt-einsum==3.3.0
pathlib==1.0.1
Pillow @ file:///C:/ci/pillow_1602770972588/work
protobuf==3.13.0
psutil @ file:///C:/ci/psutil_1598370330503/work
pyasn1==0.4.8
pyasn1-modules==0.2.8
pyparsing==2.4.7
python-dateutil==2.8.1
pywin32==227
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.6
scikit-learn @ file:///C:/ci/scikit-learn_1598377018496/work
scipy @ file:///C:/ci/scipy_1592916963468/work
sip==4.19.13
six==1.15.0
tensorboard==2.2.2
tensorboard-plugin-wit==1.7.0
tensorflow-gpu==2.2.1
tensorflow-gpu-estimator==2.2.0
termcolor==1.1.0
threadpoolctl @ file:///tmp/tmp9twdgx9k/threadpoolctl-2.1.0-py3-none-any.whl
tornado==6.0.4
tqdm @ file:///tmp/build/80754af9/tqdm_1602185206534/work
urllib3==1.25.11
Werkzeug==1.0.1
wincertstore==0.2
wrapt==1.12.1

============== Conda Packages ==============
# packages in environment at C:\Users\3214p\MiniConda3\envs\faceswap:
#
# Name                    Version                   Build  Channel
absl-py                   0.10.0                   pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
blas                      1.0                         mkl  
ca-certificates           2020.10.14                    0  
cachetools                4.1.1                    pypi_0    pypi
certifi                   2020.6.20                py38_0  
chardet                   3.0.4                    pypi_0    pypi
cudatoolkit               10.1.243             h74a9793_0  
cudnn                     7.6.5                cuda10.1_0  
cycler                    0.10.0                   py38_0  
fastcluster               1.1.26           py38h251f6bf_2    conda-forge
ffmpeg                    4.3.1                ha925a31_0    conda-forge
ffmpy                     0.2.3                    pypi_0    pypi
freetype                  2.10.4               hd328e21_0  
gast                      0.3.3                    pypi_0    pypi
git                       2.23.0               h6bb4b03_0  
google-auth               1.22.1                   pypi_0    pypi
google-auth-oauthlib      0.4.1                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
grpcio                    1.33.1                   pypi_0    pypi
h5py                      2.10.0                   pypi_0    pypi
icc_rt                    2019.0.0             h0cc432a_1  
icu                       58.2                 ha925a31_3  
idna                      2.10                     pypi_0    pypi
imageio                   2.9.0                      py_0  
imageio-ffmpeg            0.4.2                      py_0    conda-forge
intel-openmp              2020.2                      254  
joblib                    0.17.0                     py_0  
jpeg                      9b                   hb83a4c4_2  
keras-preprocessing       1.1.2                    pypi_0    pypi
kiwisolver                1.2.0            py38h74a9793_0  
libpng                    1.6.37               h2a8f88b_0  
libtiff                   4.1.0                h56a325e_1  
lz4-c                     1.9.2                hf4a77e7_3  
markdown                  3.3.2                    pypi_0    pypi
matplotlib                3.2.2                         0  
matplotlib-base           3.2.2            py38h64f37c6_0  
mkl                       2020.2                      256  
mkl-service               2.3.0            py38hb782905_0  
mkl_fft                   1.2.0            py38h45dec08_0  
mkl_random                1.1.1            py38h47e9c7a_0  
numpy                     1.18.5                   pypi_0    pypi
nvidia-ml-py3             7.352.1                  pypi_0    pypi
oauthlib                  3.1.0                    pypi_0    pypi
olefile                   0.46                       py_0  
opencv-python             4.4.0.44                 pypi_0    pypi
openssl                   1.1.1h               he774522_0  
opt-einsum                3.3.0                    pypi_0    pypi
pathlib                   1.0.1                      py_1  
pillow                    8.0.0            py38hca74424_0  
pip                       20.2.4                   py38_0  
protobuf                  3.13.0                   pypi_0    pypi
psutil                    5.7.2            py38he774522_0  
pyasn1                    0.4.8                    pypi_0    pypi
pyasn1-modules            0.2.8                    pypi_0    pypi
pyparsing                 2.4.7                      py_0  
pyqt                      5.9.2            py38ha925a31_4  
python                    3.8.5                h5fd99cc_1  
python-dateutil           2.8.1                      py_0  
python_abi                3.8                      1_cp38    conda-forge
pywin32                   227              py38he774522_1  
qt                        5.9.7            vc14h73c81de_0  
requests                  2.24.0                   pypi_0    pypi
requests-oauthlib         1.3.0                    pypi_0    pypi
rsa                       4.6                      pypi_0    pypi
scikit-learn              0.23.2           py38h47e9c7a_0  
scipy                     1.5.0            py38h9439919_0  
setuptools                50.3.0           py38h9490d1a_1  
sip                       4.19.13          py38ha925a31_0  
six                       1.15.0                     py_0  
sqlite                    3.33.0               h2a8f88b_0  
tensorboard               2.2.2                    pypi_0    pypi
tensorboard-plugin-wit    1.7.0                    pypi_0    pypi
tensorflow-gpu            2.2.1                    pypi_0    pypi
tensorflow-gpu-estimator  2.2.0                    pypi_0    pypi
termcolor                 1.1.0                    pypi_0    pypi
threadpoolctl             2.1.0              pyh5ca1d4c_0  
tk                        8.6.10               he774522_0  
tornado                   6.0.4            py38he774522_1  
tqdm                      4.50.2                     py_0  
urllib3                   1.25.11                  pypi_0    pypi
vc                        14.1                 h0510ff6_4  
vs2015_runtime            14.16.27012          hf0eaf9b_3  
werkzeug                  1.0.1                    pypi_0    pypi
wheel                     0.35.1                     py_0  
wincertstore              0.2                      py38_0  
wrapt                     1.12.1                   pypi_0    pypi
xz                        5.2.5                h62dcd97_0  
zlib                      1.2.11               h62dcd97_4  
zstd                      1.4.5                h04227a9_0  

================= Configs ==================
--------- .faceswap ---------
backend:                  nvidia

--------- convert.ini ---------

[color.color_transfer]
clip:                     True
preserve_paper:           True

[color.manual_balance]
colorspace:               HSV
balance_1:                0.0
balance_2:                0.0
balance_3:                0.0
contrast:                 0.0
brightness:               0.0

[color.match_hist]
threshold:                99.0

[mask.box_blend]
type:                     gaussian
distance:                 11.0
radius:                   5.0
passes:                   1

[mask.mask_blend]
type:                     normalized
kernel_size:              3
passes:                   4
threshold:                4
erosion:                  0.0

[scaling.sharpen]
method:                   none
amount:                   150
radius:                   0.3
threshold:                5.0

[writer.ffmpeg]
container:                mp4
codec:                    libx264
crf:                      23
preset:                   medium
tune:                     none
profile:                  auto
level:                    auto
skip_mux:                 False

[writer.gif]
fps:                      25
loop:                     0
palettesize:              256
subrectangles:            False

[writer.opencv]
format:                   png
draw_transparent:         False
jpg_quality:              75
png_compress_level:       3

[writer.pillow]
format:                   png
draw_transparent:         False
optimize:                 False
gif_interlace:            True
jpg_quality:              75
png_compress_level:       3
tif_compression:          tiff_deflate

--------- extract.ini ---------

[global]
allow_growth:             False

[align.fan]
batch-size:               12

[detect.cv2_dnn]
confidence:               50

[detect.mtcnn]
minsize:                  20
threshold_1:              0.6
threshold_2:              0.7
threshold_3:              0.7
scalefactor:              0.709
batch-size:               8

[detect.s3fd]
confidence:               70
batch-size:               4

[mask.unet_dfl]
batch-size:               8

[mask.vgg_clear]
batch-size:               6

[mask.vgg_obstructed]
batch-size:               2

--------- gui.ini ---------

[global]
fullscreen:               False
tab:                      extract
options_panel_width:      30
console_panel_height:     20
icon_size:                14
font:                     default
font_size:                9
autosave_last_session:    prompt
timeout:                  120
auto_load_model_stats:    True

--------- train.ini ---------

[global]
coverage:                 68.75
icnr_init:                False
conv_aware_init:          False
optimizer:                adam
learning_rate:            5e-05
reflect_padding:          False
allow_growth:             False
mixed_precision:          False
convert_batchsize:        16

[global.loss]
loss_function:            ssim
mask_loss_function:       mse
l2_reg_term:              100
eye_multiplier:           3
mouth_multiplier:         2
penalized_mask_loss:      True
mask_type:                extended
mask_blur_kernel:         3
mask_threshold:           4
learn_mask:               False

[model.dfl_h128]
lowmem:                   False

[model.dfl_sae]
input_size:               128
clipnorm:                 True
architecture:             df
autoencoder_dims:         0
encoder_dims:             42
decoder_dims:             21
multiscale_decoder:       False

[model.dlight]
features:                 best
details:                  good
output_size:              256

[model.original]
lowmem:                   False

[model.realface]
input_size:               64
output_size:              128
dense_nodes:              1536
complexity_encoder:       128
complexity_decoder:       512

[model.unbalanced]
input_size:               128
lowmem:                   False
clipnorm:                 True
nodes:                    1024
complexity_encoder:       128
complexity_decoder_a:     384
complexity_decoder_b:     512

[model.villain]
lowmem:                   False

[trainer.original]
preview_images:           14
zoom_amount:              5
rotation_range:           10
shift_range:              5
flip_chance:              50
disable_warp:             False
color_lightness:          30
color_ab:                 8
color_clahe_chance:       50
color_clahe_max_size:     4

Re: UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 72: illegal multibyte sequence

Posted: Sun Oct 25, 2020 12:45 pm
by torzdf

Ok, please can you post the output of this command:

Code: Select all

C:\Users\3214p\MiniConda3\envs\faceswap\Library\bin\ffmpeg.exe -i C:\Users\3214p\OneDrive\바탕 화면\영상\a.mp4 -map 0:v:0 -c copy -f null -

Also, if there is any way you can provide me with this file:
C:\Users\3214p\OneDrive\바탕 화면\영상\a.mp4

I can see if I can try to prevent these errors from happening.


Re: UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 72: illegal multibyte sequence

Posted: Sun Oct 25, 2020 2:55 pm
by skyflypeter

This is the output of the command

C:\Users\3214p>C:\Users\3214p\MiniConda3\envs\faceswap\Library\bin\ffmpeg.exe -i C:\Users\3214p\OneDrive\바탕 화면\영상\a.mp4 -map 0:v:0 -c copy -f null -
ffmpeg version 4.3.1 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 10.2.1 (GCC) 20200726
configuration: --disable-static --enable-shared --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libdav1d --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libsrt --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvmaf --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libgsm --enable-librav1e --disable-w32threads --enable-libmfx --enable-ffnvcodec --enable-cuda-llvm --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt --enable-amf
libavutil 56. 51.100 / 56. 51.100
libavcodec 58. 91.100 / 58. 91.100
libavformat 58. 45.100 / 58. 45.100
libavdevice 58. 10.100 / 58. 10.100
libavfilter 7. 85.100 / 7. 85.100
libswscale 5. 7.100 / 5. 7.100
libswresample 3. 7.100 / 3. 7.100
libpostproc 55. 7.100 / 55. 7.100
C:\Users\3214p\OneDrive\바탕: No such file or directory

and if you give your email address I can give it to you a file


Re: UnicodeDecodeError: 'cp949' codec can't decode byte 0xed in position 72: illegal multibyte sequence

Posted: Sun Oct 25, 2020 6:10 pm
by torzdf

Sorry, that command didn't work because of spaces. Please try this one:

Code: Select all

C:\Users\3214p\MiniConda3\envs\faceswap\Library\bin\ffmpeg.exe -i "C:\Users\3214p\OneDrive\바탕 화면\영상\a.mp4" -map 0:v:0 -c copy -f null -

You can send me a link to the video by Private Message (I don't like to publicly post my email address)