Critical An unexpected crash has occurred

If training is failing to start, and you are not receiving an error message telling you what to do, tell us about it here


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for reporting errors with the Training process. If you want to get tips, or better understand the Training process, then you should look in the Training Discussion forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
damao88881
Posts: 1
Joined: Mon Aug 14, 2023 3:58 pm

Critical An unexpected crash has occurred

Post by damao88881 »

The first time I used it, it kept crashing during training and could not last

Code: Select all

08/14/2023 23:38:40 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _get_headers                   DEBUG    side: 'a', width: 72
08/14/2023 23:38:40 MainProcess     _training                      _base           _get_headers                   DEBUG    height: 16, total_width: 216
08/14/2023 23:38:40 MainProcess     _training                      _base           _get_headers                   DEBUG    texts: ['Original (A)', 'Original > Original', 'Original > Swap'], text_sizes: [(41, 6), (66, 6), (58, 6)], text_x: [15, 75, 151], text_y: 11
08/14/2023 23:38:40 MainProcess     _training                      _base           _get_headers                   DEBUG    header_box.shape: (16, 216, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _to_full_frame                 DEBUG    side: 'b', number of sample arrays: 3, prediction.shapes: [(14, 64, 64, 3), (14, 64, 64, 3)])
08/14/2023 23:38:40 MainProcess     _training                      _base           _process_full                  DEBUG    full_size: 74, prediction_size: 64, color: (0.0, 0.0, 1.0)
08/14/2023 23:38:40 MainProcess     _training                      _base           _resize_sample                 DEBUG    Resizing sample: (side: 'b', sample.shape: (14, 74, 74, 3), target_size: 72, scale: 0.972972972972973)
08/14/2023 23:38:40 MainProcess     _training                      _base           _resize_sample                 DEBUG    Resized sample: (side: 'b' shape: (14, 72, 72, 3))
08/14/2023 23:38:40 MainProcess     _training                      _base           _process_full                  DEBUG    Overlayed background. Shape: (14, 72, 72, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _compile_masked                DEBUG    masked shapes: [(14, 64, 64, 3), (14, 64, 64, 3), (14, 64, 64, 3)]
08/14/2023 23:38:40 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _get_headers                   DEBUG    side: 'b', width: 72
08/14/2023 23:38:40 MainProcess     _training                      _base           _get_headers                   DEBUG    height: 16, total_width: 216
08/14/2023 23:38:40 MainProcess     _training                      _base           _get_headers                   DEBUG    texts: ['Swap (B)', 'Swap > Swap', 'Swap > Original'], text_sizes: [(34, 6), (50, 6), (58, 6)], text_x: [19, 83, 151], text_y: 11
08/14/2023 23:38:40 MainProcess     _training                      _base           _get_headers                   DEBUG    header_box.shape: (16, 216, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _duplicate_headers             DEBUG    side: a header.shape: (16, 216, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _duplicate_headers             DEBUG    side: b header.shape: (16, 216, 3)
08/14/2023 23:38:40 MainProcess     _training                      _base           _stack_images                  DEBUG    Stack images
08/14/2023 23:38:40 MainProcess     _training                      _base           get_transpose_axes             DEBUG    Even number of images to stack
08/14/2023 23:38:40 MainProcess     _training                      _base           _stack_images                  DEBUG    Stacked images
08/14/2023 23:38:40 MainProcess     _training                      _base           _compile_preview               DEBUG    Compiled sample
08/14/2023 23:38:40 MainProcess     _training                      _base           output_timelapse               DEBUG    Created time-lapse: 'C:\Users\Administrator\Desktop\output\1692027520.jpg'
08/14/2023 23:38:40 MainProcess     _training                      train           _run_training_cycle            DEBUG    Saving (save_iterations: True, save_now: False) Iteration: (iteration: 1)
08/14/2023 23:38:40 MainProcess     _training                      io              save                           DEBUG    Backing up and saving models
08/14/2023 23:38:40 MainProcess     _training                      io              _get_save_averages             DEBUG    Getting save averages
08/14/2023 23:38:40 MainProcess     _training                      io              _get_save_averages             DEBUG    Average losses since last save: [0.23443853855133057, 0.25847458839416504]
08/14/2023 23:38:40 MainProcess     _training                      io              _should_backup                 DEBUG    Should backup: False
08/14/2023 23:38:40 MainProcess     _training                      attrs           create                         DEBUG    Creating converter from 5 to 3
08/14/2023 23:38:42 MainProcess     _training                      model           save                           DEBUG    Saving State
08/14/2023 23:38:42 MainProcess     _training                      serializer      save                           DEBUG    filename: C:\Users\Administrator\Desktop\model\original_state.json, data type: <class 'dict'>
08/14/2023 23:38:42 MainProcess     _training                      serializer      _check_extension               DEBUG    Original filename: 'C:\Users\Administrator\Desktop\model\original_state.json', final filename: 'C:\Users\Administrator\Desktop\model\original_state.json'
08/14/2023 23:38:42 MainProcess     _training                      serializer      marshal                        DEBUG    data type: <class 'dict'>
08/14/2023 23:38:42 MainProcess     _training                      serializer      marshal                        DEBUG    returned data type: <class 'bytes'>
08/14/2023 23:38:42 MainProcess     _training                      model           save                           DEBUG    Saved State
08/14/2023 23:38:42 MainProcess     _training                      io              save                           INFO     [Saved models] - Average loss since last save: face_a: 0.23444, face_b: 0.25847
08/14/2023 23:38:46 MainProcess     _training                      _base           generate_preview               DEBUG    Generating preview (is_timelapse: False)
08/14/2023 23:38:46 MainProcess     _training                      _base           generate_preview               DEBUG    Generated samples: is_timelapse: False, images: {'feed': {'a': (14, 64, 64, 3), 'b': (14, 64, 64, 3)}, 'samples': {'a': (14, 74, 74, 3), 'b': (14, 74, 74, 3)}, 'sides': {'a': (14, 64, 64, 1), 'b': (14, 64, 64, 1)}}
08/14/2023 23:38:46 MainProcess     _training                      _base           compile_sample                 DEBUG    Compiling samples: (side: 'a', samples: 14)
08/14/2023 23:38:46 MainProcess     _training                      _base           compile_sample                 DEBUG    Compiling samples: (side: 'b', samples: 14)
08/14/2023 23:38:46 MainProcess     _training                      _base           compile_sample                 DEBUG    Compiled Samples: {'a': [(14, 64, 64, 3), (14, 74, 74, 3), (14, 64, 64, 1)], 'b': [(14, 64, 64, 3), (14, 74, 74, 3), (14, 64, 64, 1)]}
08/14/2023 23:38:46 MainProcess     _training                      _base           show_sample                    DEBUG    Showing sample
08/14/2023 23:38:46 MainProcess     _training                      _base           _get_predictions               DEBUG    Getting Predictions
08/14/2023 23:38:48 MainProcess     _training                      _base           _get_predictions               DEBUG    Returning predictions: {'a_a': (14, 64, 64, 3), 'b_b': (14, 64, 64, 3), 'a_b': (14, 64, 64, 3), 'b_a': (14, 64, 64, 3)}
08/14/2023 23:38:48 MainProcess     _training                      _base           _to_full_frame                 DEBUG    side: 'a', number of sample arrays: 3, prediction.shapes: [(14, 64, 64, 3), (14, 64, 64, 3)])
08/14/2023 23:38:48 MainProcess     _training                      _base           _process_full                  DEBUG    full_size: 74, prediction_size: 64, color: (0.0, 0.0, 1.0)
08/14/2023 23:38:48 MainProcess     _training                      _base           _resize_sample                 DEBUG    Resizing sample: (side: 'a', sample.shape: (14, 74, 74, 3), target_size: 72, scale: 0.972972972972973)
08/14/2023 23:38:48 MainProcess     _training                      _base           _resize_sample                 DEBUG    Resized sample: (side: 'a' shape: (14, 72, 72, 3))
08/14/2023 23:38:48 MainProcess     _training                      _base           _process_full                  DEBUG    Overlayed background. Shape: (14, 72, 72, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _compile_masked                DEBUG    masked shapes: [(14, 64, 64, 3), (14, 64, 64, 3), (14, 64, 64, 3)]
08/14/2023 23:38:48 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _get_headers                   DEBUG    side: 'a', width: 72
08/14/2023 23:38:48 MainProcess     _training                      _base           _get_headers                   DEBUG    height: 16, total_width: 216
08/14/2023 23:38:48 MainProcess     _training                      _base           _get_headers                   DEBUG    texts: ['Original (A)', 'Original > Original', 'Original > Swap'], text_sizes: [(41, 6), (66, 6), (58, 6)], text_x: [15, 75, 151], text_y: 11
08/14/2023 23:38:48 MainProcess     _training                      _base           _get_headers                   DEBUG    header_box.shape: (16, 216, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _to_full_frame                 DEBUG    side: 'b', number of sample arrays: 3, prediction.shapes: [(14, 64, 64, 3), (14, 64, 64, 3)])
08/14/2023 23:38:48 MainProcess     _training                      _base           _process_full                  DEBUG    full_size: 74, prediction_size: 64, color: (0.0, 0.0, 1.0)
08/14/2023 23:38:48 MainProcess     _training                      _base           _resize_sample                 DEBUG    Resizing sample: (side: 'b', sample.shape: (14, 74, 74, 3), target_size: 72, scale: 0.972972972972973)
08/14/2023 23:38:48 MainProcess     _training                      _base           _resize_sample                 DEBUG    Resized sample: (side: 'b' shape: (14, 72, 72, 3))
08/14/2023 23:38:48 MainProcess     _training                      _base           _process_full                  DEBUG    Overlayed background. Shape: (14, 72, 72, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _compile_masked                DEBUG    masked shapes: [(14, 64, 64, 3), (14, 64, 64, 3), (14, 64, 64, 3)]
08/14/2023 23:38:48 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _overlay_foreground            DEBUG    Overlayed foreground. Shape: (14, 72, 72, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _get_headers                   DEBUG    side: 'b', width: 72
08/14/2023 23:38:48 MainProcess     _training                      _base           _get_headers                   DEBUG    height: 16, total_width: 216
08/14/2023 23:38:48 MainProcess     _training                      _base           _get_headers                   DEBUG    texts: ['Swap (B)', 'Swap > Swap', 'Swap > Original'], text_sizes: [(34, 6), (50, 6), (58, 6)], text_x: [19, 83, 151], text_y: 11
08/14/2023 23:38:48 MainProcess     _training                      _base           _get_headers                   DEBUG    header_box.shape: (16, 216, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _duplicate_headers             DEBUG    side: a header.shape: (16, 216, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _duplicate_headers             DEBUG    side: b header.shape: (16, 216, 3)
08/14/2023 23:38:48 MainProcess     _training                      _base           _stack_images                  DEBUG    Stack images
08/14/2023 23:38:48 MainProcess     _training                      _base           get_transpose_axes             DEBUG    Even number of images to stack
08/14/2023 23:38:48 MainProcess     _training                      _base           _stack_images                  DEBUG    Stacked images
08/14/2023 23:38:48 MainProcess     _training                      _base           _compile_preview               DEBUG    Compiled sample
08/14/2023 23:38:48 MainProcess     _training                      train           _show                          DEBUG    Updating preview: (name: Training - 'S': Save Now. 'R': Refresh Preview. 'M': Toggle Mask. 'F': Toggle Screen Fit-Actual Size. 'ENTER': Save and Quit)
08/14/2023 23:38:48 MainProcess     _training                      train           _show                          DEBUG    Generating preview for GUI
08/14/2023 23:38:48 MainProcess     _training                      train           _show                          DEBUG    Generated preview for GUI: 'D:\ai\faceswap\lib\gui\.cache\preview\.gui_training_preview.png'
08/14/2023 23:38:48 MainProcess     _training                      train           _show                          DEBUG    Updated preview: (name: Training - 'S': Save Now. 'R': Refresh Preview. 'M': Toggle Mask. 'F': Toggle Screen Fit-Actual Size. 'ENTER': Save and Quit)
08/14/2023 23:38:48 MainProcess     _training                      train           _run_training_cycle            INFO     [Preview Updated]
08/14/2023 23:48:49 MainProcess     _run_0                         cache           cache_metadata                 VERBOSE  Cache filled: 'C:\Users\Administrator\Desktop\b'
08/14/2023 23:48:53 MainProcess     ThreadPoolExecutor-709_3       image           read_image                     ERROR    Error while reading image. This can be caused by special characters in the filename or a corrupt image file: 'C:\Users\Administrator\Desktop\b\刘德华_000032_0.png'. Original error message: Image is None
08/14/2023 23:48:53 MainProcess     ThreadPoolExecutor-709_1       image           read_image                     ERROR    Error while reading image. This can be caused by special characters in the filename or a corrupt image file: 'C:\Users\Administrator\Desktop\b\刘德华_000488_0.png'. Original error message: Image is None
08/14/2023 23:48:53 MainProcess     ThreadPoolExecutor-709_0       image           read_image                     ERROR    Error while reading image. This can be caused by special characters in the filename or a corrupt image file: 'C:\Users\Administrator\Desktop\b\刘德华_000627_0.png'. Original error message: Image is None
08/14/2023 23:48:53 MainProcess     ThreadPoolExecutor-709_2       image           read_image                     ERROR    Error while reading image. This can be caused by special characters in the filename or a corrupt image file: 'C:\Users\Administrator\Desktop\b\刘德华_000637_0.png'. Original error message: Image is None
08/14/2023 23:48:56 MainProcess     _run_0                         multithreading  run                            DEBUG    Error in thread (_run_0): Error while reading image. This can be caused by special characters in the filename or a corrupt image file: 'C:\Users\Administrator\Desktop\b\刘德华_000032_0.png'. Original error message: Image is None
08/14/2023 23:49:00 MainProcess     _training                      multithreading  check_and_raise_error          DEBUG    Thread error caught: [(<class 'Exception'>, Exception("Error while reading image. This can be caused by special characters in the filename or a corrupt image file: 'C:\\Users\\Administrator\\Desktop\\b\\刘德华_000032_0.png'. Original error message: Image is None"), <traceback object at 0x000002138139CA00>)]
08/14/2023 23:49:00 MainProcess     _training                      multithreading  run                            DEBUG    Error in thread (_training): Error while reading image. This can be caused by special characters in the filename or a corrupt image file: 'C:\Users\Administrator\Desktop\b\刘德华_000032_0.png'. Original error message: Image is None
08/14/2023 23:49:00 MainProcess     MainThread                     train           _monitor                       DEBUG    Thread error detected
08/14/2023 23:49:00 MainProcess     MainThread                     train           _monitor                       DEBUG    Closed Monitor
08/14/2023 23:49:00 MainProcess     MainThread                     train           _end_thread                    DEBUG    Ending Training thread
08/14/2023 23:49:00 MainProcess     MainThread                     train           _end_thread                    CRITICAL Error caught! Exiting...
08/14/2023 23:49:00 MainProcess     MainThread                     multithreading  join                           DEBUG    Joining Threads: '_training'
08/14/2023 23:49:00 MainProcess     MainThread                     multithreading  join                           DEBUG    Joining Thread: '_training'
08/14/2023 23:49:00 MainProcess     MainThread                     multithreading  join                           ERROR    Caught exception in thread: '_training'
Traceback (most recent call last):
  File "D:\ai\faceswap\lib\image.py", line 301, in read_image
    raise ValueError("Image is None")
ValueError: Image is None

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\ai\faceswap\lib\cli\launcher.py", line 225, in execute_script
    process.process()
  File "D:\ai\faceswap\scripts\train.py", line 209, in process
    self._end_thread(thread, err)
  File "D:\ai\faceswap\scripts\train.py", line 249, in _end_thread
    thread.join()
  File "D:\ai\faceswap\lib\multithreading.py", line 224, in join
    raise thread.err[1].with_traceback(thread.err[2])
  File "D:\ai\faceswap\lib\multithreading.py", line 100, in run
    self._target(*self._args, **self._kwargs)
  File "D:\ai\faceswap\scripts\train.py", line 271, in _training
    raise err
  File "D:\ai\faceswap\scripts\train.py", line 261, in _training
    self._run_training_cycle(model, trainer)
  File "D:\ai\faceswap\scripts\train.py", line 349, in _run_training_cycle
    trainer.train_one_step(viewer, timelapse)
  File "D:\ai\faceswap\plugins\train\trainer\_base.py", line 211, in train_one_step
    model_inputs, model_targets = self._feeder.get_batch()
  File "D:\ai\faceswap\plugins\train\trainer\_base.py", line 457, in get_batch
    side_feed, side_targets = next(self._feeds[side])
  File "D:\ai\faceswap\lib\multithreading.py", line 296, in iterator
    self.check_and_raise_error()
  File "D:\ai\faceswap\lib\multithreading.py", line 173, in check_and_raise_error
    raise error[1].with_traceback(error[2])
  File "D:\ai\faceswap\lib\multithreading.py", line 100, in run
    self._target(*self._args, **self._kwargs)
  File "D:\ai\faceswap\lib\multithreading.py", line 279, in _run
    for item in self.generator(*self._gen_args, **self._gen_kwargs):
  File "D:\ai\faceswap\lib\training\generator.py", line 217, in _minibatch
    retval = self._process_batch(img_paths)
  File "D:\ai\faceswap\lib\training\generator.py", line 330, in _process_batch
    raw_faces, detected_faces = self._get_images_with_meta(filenames)
  File "D:\ai\faceswap\lib\training\generator.py", line 243, in _get_images_with_meta
    raw_faces = read_image_batch(filenames)
  File "D:\ai\faceswap\lib\image.py", line 376, in read_image_batch
    batch[ret_idx] = future.result()
  File "C:\Users\Administrator\MiniConda3\envs\faceswap\lib\concurrent\futures\_base.py", line 451, in result
    return self.__get_result()
  File "C:\Users\Administrator\MiniConda3\envs\faceswap\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "C:\Users\Administrator\MiniConda3\envs\faceswap\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "D:\ai\faceswap\lib\image.py", line 322, in read_image
    raise Exception(msg)
Exception: Error while reading image. This can be caused by special characters in the filename or a corrupt image file: 'C:\Users\Administrator\Desktop\b\刘德华_000032_0.png'. Original error message: Image is None

============ System Information ============
backend:             cpu
encoding:            cp936
git_branch:          master
git_commits:         68a3322 bugfix: train - fix learn_mask training
gpu_cuda:            No global version found. Check Conda packages for Conda Cuda
gpu_cudnn:           No global version found. Check Conda packages for Conda cuDNN
gpu_devices:         
gpu_devices_active:  
gpu_driver:          
gpu_vram:            
os_machine:          AMD64
os_platform:         Windows-10-10.0.19043-SP0
os_release:          10
py_command:          D:\ai\faceswap\faceswap.py train -A C:/Users/Administrator/Desktop/a -B C:/Users/Administrator/Desktop/b -m C:/Users/Administrator/Desktop/model -t original -bs 4 -it 1000000 -s 250 -ss 25000 -tia C:/Users/Administrator/Desktop/a -tib C:/Users/Administrator/Desktop/b -to C:/Users/Administrator/Desktop/output -L INFO -gui
py_conda_version:    conda 23.7.2
py_implementation:   CPython
py_version:          3.10.12
py_virtual_env:      True
sys_cores:           4
sys_processor:       Intel64 Family 6 Model 158 Stepping 9, GenuineIntel
sys_ram:             Total: 8109MB, Available: 1527MB, Used: 6582MB, Free: 1527MB

=============== Pip Packages ===============
absl-py==1.4.0
astunparse==1.6.3
cachetools==5.3.1
certifi==2023.7.22
charset-normalizer==3.2.0
colorama @ file:///C:/b/abs_a9ozq0l032/croot/colorama_1672387194846/work
contourpy @ file:///C:/b/abs_d5rpy288vc/croots/recipe/contourpy_1663827418189/work
cycler @ file:///tmp/build/80754af9/cycler_1637851556182/work
fastcluster @ file:///D:/bld/fastcluster_1649783460966/work
ffmpy @ file:///home/conda/feedstock_root/build_artifacts/ffmpy_1659474992694/work
flatbuffers==23.5.26
fonttools==4.25.0
gast==0.4.0
google-auth==2.22.0
google-auth-oauthlib==0.4.6
google-pasta==0.2.0
grpcio==1.57.0
h5py==3.9.0
idna==3.4
imageio @ file:///C:/b/abs_27kq2gy1us/croot/imageio_1677879918708/work
imageio-ffmpeg @ file:///home/conda/feedstock_root/build_artifacts/imageio-ffmpeg_1673483481485/work
joblib @ file:///C:/b/abs_1anqjntpan/croot/joblib_1685113317150/work
keras==2.10.0
Keras-Preprocessing==1.1.2
kiwisolver @ file:///C:/b/abs_88mdhvtahm/croot/kiwisolver_1672387921783/work
libclang==16.0.6
Markdown==3.4.4
MarkupSafe==2.1.3
matplotlib @ file:///C:/b/abs_49b2acwxd4/croot/matplotlib-suite_1679593486357/work
mkl-fft==1.3.6
mkl-random @ file:///C:/Users/dev-admin/mkl/mkl_random_1682977971003/work
mkl-service==2.4.0
munkres==1.1.4
numexpr @ file:///C:/b/abs_afm0oewmmt/croot/numexpr_1683221839116/work
numpy @ file:///C:/b/abs_f6napi3n6e/croot/numpy_and_numpy_base_1691091651337/work
oauthlib==3.2.2
opencv-python==4.8.0.76
opt-einsum==3.3.0
packaging @ file:///C:/b/abs_ed_kb9w6g4/croot/packaging_1678965418855/work
Pillow==9.4.0
ply==3.11
protobuf==3.19.6
psutil @ file:///C:/Windows/Temp/abs_b2c2fd7f-9fd5-4756-95ea-8aed74d0039flsd9qufz/croots/recipe/psutil_1656431277748/work
pyasn1==0.5.0
pyasn1-modules==0.3.0
pyparsing @ file:///C:/Users/BUILDE~1/AppData/Local/Temp/abs_7f_7lba6rl/croots/recipe/pyparsing_1661452540662/work
PyQt5==5.15.7
PyQt5-sip @ file:///C:/Windows/Temp/abs_d7gmd2jg8i/croots/recipe/pyqt-split_1659273064801/work/pyqt_sip
python-dateutil @ file:///tmp/build/80754af9/python-dateutil_1626374649649/work
pywin32==305.1
pywinpty @ file:///C:/ci_310/pywinpty_1644230983541/work/target/wheels/pywinpty-2.0.2-cp310-none-win_amd64.whl
requests==2.31.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn @ file:///C:/b/abs_55olq_4gzc/croot/scikit-learn_1690978955123/work
scipy==1.11.1
sip @ file:///C:/Windows/Temp/abs_b8fxd17m2u/croots/recipe/sip_1659012372737/work
six @ file:///tmp/build/80754af9/six_1644875935023/work
tensorboard==2.10.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow-cpu==2.10.1
tensorflow-estimator==2.10.0
tensorflow-intel==2.10.1
tensorflow-io-gcs-filesystem==0.31.0
termcolor==2.3.0
threadpoolctl @ file:///Users/ktietz/demo/mc3/conda-bld/threadpoolctl_1629802263681/work
toml @ file:///tmp/build/80754af9/toml_1616166611790/work
tornado @ file:///C:/b/abs_61jhmrrua1/croot/tornado_1690848767317/work
tqdm @ file:///C:/b/abs_f76j9hg7pv/croot/tqdm_1679561871187/work
typing_extensions==4.7.1
urllib3==1.26.16
Werkzeug==2.3.6
wrapt==1.15.0

============== Conda Packages ==============
# packages in environment at C:\Users\Administrator\MiniConda3\envs\faceswap:
#
# Name                    Version                   Build  Channel
absl-py                   1.4.0                    pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
blas                      1.0                         mkl  
brotli                    1.0.9                h2bbff1b_7  
brotli-bin                1.0.9                h2bbff1b_7  
bzip2                     1.0.8                he774522_0  
ca-certificates           2023.05.30           haa95532_0  
cachetools                5.3.1                    pypi_0    pypi
certifi                   2023.7.22                pypi_0    pypi
charset-normalizer        3.2.0                    pypi_0    pypi
colorama                  0.4.6           py310haa95532_0  
contourpy                 1.0.5           py310h59b6b97_0  
cycler                    0.11.0             pyhd3eb1b0_0  
fastcluster               1.2.6           py310hf5e1058_1    conda-forge
ffmpeg                    4.3.1                ha925a31_0    conda-forge
ffmpy                     0.3.0              pyhb6f538c_0    conda-forge
flatbuffers               23.5.26                  pypi_0    pypi
fonttools                 4.25.0             pyhd3eb1b0_0  
freetype                  2.12.1               ha860e81_0  
gast                      0.4.0                    pypi_0    pypi
giflib                    5.2.1                h8cc25b3_3  
git                       2.40.1               haa95532_1  
glib                      2.69.1               h5dc1a3c_2  
google-auth               2.22.0                   pypi_0    pypi
google-auth-oauthlib      0.4.6                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
grpcio                    1.57.0                   pypi_0    pypi
gst-plugins-base          1.18.5               h9e645db_0  
gstreamer                 1.18.5               hd78058f_0  
h5py                      3.9.0                    pypi_0    pypi
icc_rt                    2022.1.0             h6049295_2  
icu                       58.2                 ha925a31_3  
idna                      3.4                      pypi_0    pypi
imageio                   2.26.0          py310haa95532_0  
imageio-ffmpeg            0.4.8              pyhd8ed1ab_0    conda-forge
intel-openmp              2023.1.0         h59b6b97_46319  
joblib                    1.2.0           py310haa95532_0  
jpeg                      9e                   h2bbff1b_1  
keras                     2.10.0                   pypi_0    pypi
keras-preprocessing       1.1.2                    pypi_0    pypi
kiwisolver                1.4.4           py310hd77b12b_0  
krb5                      1.19.4               h5b6d351_0  
lerc                      3.0                  hd77b12b_0  
libbrotlicommon           1.0.9                h2bbff1b_7  
libbrotlidec              1.0.9                h2bbff1b_7  
libbrotlienc              1.0.9                h2bbff1b_7  
libclang                  16.0.6                   pypi_0    pypi
libclang13                14.0.6          default_h8e68704_1  
libdeflate                1.17                 h2bbff1b_0  
libffi                    3.4.4                hd77b12b_0  
libiconv                  1.16                 h2bbff1b_2  
libogg                    1.3.5                h2bbff1b_1  
libpng                    1.6.39               h8cc25b3_0  
libtiff                   4.5.0                h6c2663c_2  
libvorbis                 1.3.7                he774522_0  
libwebp                   1.2.4                hbc33d0d_1  
libwebp-base              1.2.4                h2bbff1b_1  
libxml2                   2.10.3               h0ad7f3c_0  
libxslt                   1.1.37               h2bbff1b_0  
lz4-c                     1.9.4                h2bbff1b_0  
markdown                  3.4.4                    pypi_0    pypi
markupsafe                2.1.3                    pypi_0    pypi
matplotlib                3.7.1           py310haa95532_1  
matplotlib-base           3.7.1           py310h4ed8f06_1  
mkl                       2023.1.0         h6b88ed4_46357  
mkl-service               2.4.0           py310h2bbff1b_1  
mkl_fft                   1.3.6           py310h4ed8f06_1  
mkl_random                1.2.2           py310h4ed8f06_1  
munkres                   1.1.4                      py_0  
numexpr                   2.8.4           py310h2cd9be0_1  
numpy                     1.25.2          py310h055cbcc_0  
numpy-base                1.25.2          py310h65a83cf_0  
oauthlib                  3.2.2                    pypi_0    pypi
opencv-python             4.8.0.76                 pypi_0    pypi
openssl                   1.1.1v               h2bbff1b_0  
opt-einsum                3.3.0                    pypi_0    pypi
packaging                 23.0            py310haa95532_0  
pcre                      8.45                 hd77b12b_0  
pillow                    9.4.0           py310hd77b12b_0  
pip                       23.2.1          py310haa95532_0  
ply                       3.11            py310haa95532_0  
protobuf                  3.19.6                   pypi_0    pypi
psutil                    5.9.0           py310h2bbff1b_0  
pyasn1                    0.5.0                    pypi_0    pypi
pyasn1-modules            0.3.0                    pypi_0    pypi
pyparsing                 3.0.9           py310haa95532_0  
pyqt                      5.15.7          py310hd77b12b_0  
pyqt5-sip                 12.11.0         py310hd77b12b_0  
python                    3.10.12              h966fe2a_0  
python-dateutil           2.8.2              pyhd3eb1b0_0  
python_abi                3.10                    2_cp310    conda-forge
pywin32                   305             py310h2bbff1b_0  
pywinpty                  2.0.2           py310h5da7b33_0  
qt-main                   5.15.2               he8e5bd7_8  
qt-webengine              5.15.9               hb9a9bb5_5  
qtwebkit                  5.212                h2bbfb41_5  
requests                  2.31.0                   pypi_0    pypi
requests-oauthlib         1.3.1                    pypi_0    pypi
rsa                       4.9                      pypi_0    pypi
scikit-learn              1.3.0           py310h4ed8f06_0  
scipy                     1.11.1          py310h309d312_0  
setuptools                68.0.0          py310haa95532_0  
sip                       6.6.2           py310hd77b12b_0  
six                       1.16.0             pyhd3eb1b0_1  
sqlite                    3.41.2               h2bbff1b_0  
tbb                       2021.8.0             h59b6b97_0  
tensorboard               2.10.1                   pypi_0    pypi
tensorboard-data-server   0.6.1                    pypi_0    pypi
tensorboard-plugin-wit    1.8.1                    pypi_0    pypi
tensorflow-cpu            2.10.1                   pypi_0    pypi
tensorflow-estimator      2.10.0                   pypi_0    pypi
tensorflow-intel          2.10.1                   pypi_0    pypi
tensorflow-io-gcs-filesystem 0.31.0                   pypi_0    pypi
termcolor                 2.3.0                    pypi_0    pypi
threadpoolctl             2.2.0              pyh0d69192_0  
tk                        8.6.12               h2bbff1b_0  
toml                      0.10.2             pyhd3eb1b0_0  
tornado                   6.3.2           py310h2bbff1b_0  
tqdm                      4.65.0          py310h9909e9c_0  
typing-extensions         4.7.1                    pypi_0    pypi
tzdata                    2023c                h04d1e81_0  
urllib3                   1.26.16                  pypi_0    pypi
vc                        14.2                 h21ff451_1  
vs2015_runtime            14.27.29016          h5e58377_2  
werkzeug                  2.3.6                    pypi_0    pypi
wheel                     0.38.4          py310haa95532_0  
winpty                    0.4.3                         4  
wrapt                     1.15.0                   pypi_0    pypi
xz                        5.4.2                h8cc25b3_0  
zlib                      1.2.13               h8cc25b3_0  
zstd                      1.5.5                hd43e919_0  

=============== State File =================
{
  "name": "original",
  "sessions": {
    "1": {
      "timestamp": 1692017843.5632231,
      "no_logs": false,
      "loss_names": [
        "total",
        "face_a",
        "face_b"
      ],
      "batchsize": 23,
      "iterations": 1,
      "config": {
        "learning_rate": 5e-05,
        "epsilon_exponent": -7,
        "save_optimizer": "exit",
        "autoclip": false,
        "allow_growth": false,
        "mixed_precision": false,
        "nan_protection": true,
        "convert_batchsize": 16,
        "loss_function": "ssim",
        "loss_function_2": "mse",
        "loss_weight_2": 100,
        "loss_function_3": null,
        "loss_weight_3": 0,
        "loss_function_4": null,
        "loss_weight_4": 0,
        "mask_loss_function": "mse",
        "eye_multiplier": 3,
        "mouth_multiplier": 2
      }
    },
    "2": {
      "timestamp": 1692018489.619099,
      "no_logs": false,
      "loss_names": [
        "total",
        "face_a",
        "face_b"
      ],
      "batchsize": 19,
      "iterations": 1,
      "config": {
        "learning_rate": 5e-05,
        "epsilon_exponent": -7,
        "save_optimizer": "exit",
        "autoclip": false,
        "allow_growth": false,
        "mixed_precision": false,
        "nan_protection": true,
        "convert_batchsize": 16,
        "loss_function": "ssim",
        "loss_function_2": "mse",
        "loss_weight_2": 100,
        "loss_function_3": null,
        "loss_weight_3": 0,
        "loss_function_4": null,
        "loss_weight_4": 0,
        "mask_loss_function": "mse",
        "eye_multiplier": 3,
        "mouth_multiplier": 2
      }
    },
    "3": {
      "timestamp": 1692023725.458847,
      "no_logs": false,
      "loss_names": [
        "total",
        "face_a",
        "face_b"
      ],
      "batchsize": 19,
      "iterations": 1,
      "config": {
        "learning_rate": 5e-05,
        "epsilon_exponent": -7,
        "save_optimizer": "exit",
        "autoclip": false,
        "allow_growth": false,
        "mixed_precision": false,
        "nan_protection": true,
        "convert_batchsize": 16,
        "loss_function": "ssim",
        "loss_function_2": "mse",
        "loss_weight_2": 100,
        "loss_function_3": null,
        "loss_weight_3": 0,
        "loss_function_4": null,
        "loss_weight_4": 0,
        "mask_loss_function": "mse",
        "eye_multiplier": 3,
        "mouth_multiplier": 2
      }
    },
    "4": {
      "timestamp": 1692025799.5652034,
      "no_logs": false,
      "loss_names": [
        "total",
        "face_a",
        "face_b"
      ],
      "batchsize": 19,
      "iterations": 1,
      "config": {
        "learning_rate": 5e-05,
        "epsilon_exponent": -7,
        "save_optimizer": "exit",
        "autoclip": false,
        "allow_growth": false,
        "mixed_precision": false,
        "nan_protection": true,
        "convert_batchsize": 16,
        "loss_function": "ssim",
        "loss_function_2": "mse",
        "loss_weight_2": 100,
        "loss_function_3": null,
        "loss_weight_3": 0,
        "loss_function_4": null,
        "loss_weight_4": 0,
        "mask_loss_function": "mse",
        "eye_multiplier": 3,
        "mouth_multiplier": 2
      }
    },
    "5": {
      "timestamp": 1692026300.7550843,
      "no_logs": false,
      "loss_names": [
        "total",
        "face_a",
        "face_b"
      ],
      "batchsize": 8,
      "iterations": 1,
      "config": {
        "learning_rate": 5e-05,
        "epsilon_exponent": -7,
        "save_optimizer": "exit",
        "autoclip": false,
        "allow_growth": false,
        "mixed_precision": false,
        "nan_protection": true,
        "convert_batchsize": 16,
        "loss_function": "ssim",
        "loss_function_2": "mse",
        "loss_weight_2": 100,
        "loss_function_3": null,
        "loss_weight_3": 0,
        "loss_function_4": null,
        "loss_weight_4": 0,
        "mask_loss_function": "mse",
        "eye_multiplier": 3,
        "mouth_multiplier": 2
      }
    },
    "6": {
      "timestamp": 1692027370.5302582,
      "no_logs": false,
      "loss_names": [
        "total",
        "face_a",
        "face_b"
      ],
      "batchsize": 8,
      "iterations": 1,
      "config": {
        "learning_rate": 5e-05,
        "epsilon_exponent": -7,
        "save_optimizer": "exit",
        "autoclip": false,
        "allow_growth": false,
        "mixed_precision": false,
        "nan_protection": true,
        "convert_batchsize": 16,
        "loss_function": "ssim",
        "loss_function_2": "mse",
        "loss_weight_2": 100,
        "loss_function_3": null,
        "loss_weight_3": 0,
        "loss_function_4": null,
        "loss_weight_4": 0,
        "mask_loss_function": "mse",
        "eye_multiplier": 3,
        "mouth_multiplier": 2
      }
    },
    "7": {
      "timestamp": 1692027498.9199758,
      "no_logs": false,
      "loss_names": [
        "total",
        "face_a",
        "face_b"
      ],
      "batchsize": 4,
      "iterations": 1,
      "config": {
        "learning_rate": 5e-05,
        "epsilon_exponent": -7,
        "save_optimizer": "exit",
        "autoclip": false,
        "allow_growth": false,
        "mixed_precision": false,
        "nan_protection": true,
        "convert_batchsize": 16,
        "loss_function": "ssim",
        "loss_function_2": "mse",
        "loss_weight_2": 100,
        "loss_function_3": null,
        "loss_weight_3": 0,
        "loss_function_4": null,
        "loss_weight_4": 0,
        "mask_loss_function": "mse",
        "eye_multiplier": 3,
        "mouth_multiplier": 2
      }
    }
  },
  "lowest_avg_loss": {
    "a": 0.24879761040210724,
    "b": 0.23274117708206177
  },
  "iterations": 7,
  "mixed_precision_layers": [
    "conv_128_0_conv2d",
    "conv_128_0_leakyrelu",
    "conv_256_0_conv2d",
    "conv_256_0_leakyrelu",
    "conv_512_0_conv2d",
    "conv_512_0_leakyrelu",
    "conv_1024_0_conv2d",
    "conv_1024_0_leakyrelu",
    "flatten",
    "dense",
    "dense_1",
    "reshape",
    "upscale_512_0_conv2d_conv2d",
    "upscale_512_0_conv2d_leakyrelu",
    "upscale_512_0_pixelshuffler",
    "upscale_256_0_conv2d_conv2d",
    "upscale_256_0_conv2d_leakyrelu",
    "upscale_256_0_pixelshuffler",
    "upscale_128_0_conv2d_conv2d",
    "upscale_128_0_conv2d_leakyrelu",
    "upscale_128_0_pixelshuffler",
    "upscale_64_0_conv2d_conv2d",
    "upscale_64_0_conv2d_leakyrelu",
    "upscale_64_0_pixelshuffler",
    "face_out_a_0_conv2d",
    "upscale_256_1_conv2d_conv2d",
    "upscale_256_1_conv2d_leakyrelu",
    "upscale_256_1_pixelshuffler",
    "upscale_128_1_conv2d_conv2d",
    "upscale_128_1_conv2d_leakyrelu",
    "upscale_128_1_pixelshuffler",
    "upscale_64_1_conv2d_conv2d",
    "upscale_64_1_conv2d_leakyrelu",
    "upscale_64_1_pixelshuffler",
    "face_out_b_0_conv2d"
  ],
  "config": {
    "centering": "face",
    "coverage": 87.5,
    "optimizer": "adam",
    "learning_rate": 5e-05,
    "epsilon_exponent": -7,
    "save_optimizer": "exit",
    "autoclip": false,
    "allow_growth": false,
    "mixed_precision": false,
    "nan_protection": true,
    "convert_batchsize": 16,
    "loss_function": "ssim",
    "loss_function_2": "mse",
    "loss_weight_2": 100,
    "loss_function_3": null,
    "loss_weight_3": 0,
    "loss_function_4": null,
    "loss_weight_4": 0,
    "mask_loss_function": "mse",
    "eye_multiplier": 3,
    "mouth_multiplier": 2,
    "penalized_mask_loss": true,
    "mask_type": "extended",
    "mask_blur_kernel": 3,
    "mask_threshold": 4,
    "learn_mask": false,
    "lowmem": false
  }
}

================= Configs ==================
--------- .faceswap ---------
backend:                  cpu

--------- convert.ini ---------

[color.color_transfer]
clip:                     True
preserve_paper:           True

[color.manual_balance]
colorspace:               HSV
balance_1:                0.0
balance_2:                0.0
balance_3:                0.0
contrast:                 0.0
brightness:               0.0

[color.match_hist]
threshold:                99.0

[mask.mask_blend]
type:                     normalized
kernel_size:              3
passes:                   4
threshold:                4
erosion:                  0.0
erosion_top:              0.0
erosion_bottom:           0.0
erosion_left:             0.0
erosion_right:            0.0

[scaling.sharpen]
method:                   none
amount:                   150
radius:                   0.3
threshold:                5.0

[writer.ffmpeg]
container:                mp4
codec:                    libx264
crf:                      23
preset:                   medium
tune:                     none
profile:                  auto
level:                    auto
skip_mux:                 False

[writer.gif]
fps:                      25
loop:                     0
palettesize:              256
subrectangles:            False

[writer.opencv]
format:                   png
draw_transparent:         False
separate_mask:            False
jpg_quality:              75
png_compress_level:       3

[writer.pillow]
format:                   png
draw_transparent:         False
separate_mask:            False
optimize:                 False
gif_interlace:            True
jpg_quality:              75
png_compress_level:       3
tif_compression:          tiff_deflate

--------- extract.ini ---------

[global]
allow_growth:             False
aligner_min_scale:        0.07
aligner_max_scale:        2.0
aligner_distance:         22.5
aligner_roll:             45.0
aligner_features:         True
filter_refeed:            True
save_filtered:            False
realign_refeeds:          True
filter_realign:           True

[align.fan]
batch-size:               12

[detect.cv2_dnn]
confidence:               50

[detect.mtcnn]
minsize:                  20
scalefactor:              0.709
batch-size:               8
cpu:                      True
threshold_1:              0.6
threshold_2:              0.7
threshold_3:              0.7

[detect.s3fd]
confidence:               70
batch-size:               4

[mask.bisenet_fp]
batch-size:               8
cpu:                      False
weights:                  faceswap
include_ears:             False
include_hair:             False
include_glasses:          True

[mask.custom]
batch-size:               8
centering:                face
fill:                     False

[mask.unet_dfl]
batch-size:               8

[mask.vgg_clear]
batch-size:               6

[mask.vgg_obstructed]
batch-size:               2

[recognition.vgg_face2]
batch-size:               16
cpu:                      False

--------- gui.ini ---------

[global]
fullscreen:               False
tab:                      extract
options_panel_width:      30
console_panel_height:     20
icon_size:                14
font:                     default
font_size:                9
autosave_last_session:    prompt
timeout:                  120
auto_load_model_stats:    True

--------- train.ini ---------

[global]
centering:                face
coverage:                 87.5
icnr_init:                False
conv_aware_init:          False
optimizer:                adam
learning_rate:            5e-05
epsilon_exponent:         -7
save_optimizer:           exit
autoclip:                 False
reflect_padding:          False
allow_growth:             False
mixed_precision:          False
nan_protection:           True
convert_batchsize:        16

[global.loss]
loss_function:            ssim
loss_function_2:          mse
loss_weight_2:            100
loss_function_3:          none
loss_weight_3:            0
loss_function_4:          none
loss_weight_4:            0
mask_loss_function:       mse
eye_multiplier:           3
mouth_multiplier:         2
penalized_mask_loss:      True
mask_type:                extended
mask_blur_kernel:         3
mask_threshold:           4
learn_mask:               False

[model.dfaker]
output_size:              128

[model.dfl_h128]
lowmem:                   False

[model.dfl_sae]
input_size:               128
architecture:             df
autoencoder_dims:         0
encoder_dims:             42
decoder_dims:             21
multiscale_decoder:       False

[model.dlight]
features:                 best
details:                  good
output_size:              256

[model.original]
lowmem:                   False

[model.phaze_a]
output_size:              128
shared_fc:                none
enable_gblock:            True
split_fc:                 True
split_gblock:             False
split_decoders:           False
enc_architecture:         fs_original
enc_scaling:              7
enc_load_weights:         True
bottleneck_type:          dense
bottleneck_norm:          none
bottleneck_size:          1024
bottleneck_in_encoder:    True
fc_depth:                 1
fc_min_filters:           1024
fc_max_filters:           1024
fc_dimensions:            4
fc_filter_slope:          -0.5
fc_dropout:               0.0
fc_upsampler:             upsample2d
fc_upsamples:             1
fc_upsample_filters:      512
fc_gblock_depth:          3
fc_gblock_min_nodes:      512
fc_gblock_max_nodes:      512
fc_gblock_filter_slope:   -0.5
fc_gblock_dropout:        0.0
dec_upscale_method:       subpixel
dec_upscales_in_fc:       0
dec_norm:                 none
dec_min_filters:          64
dec_max_filters:          512
dec_slope_mode:           full
dec_filter_slope:         -0.45
dec_res_blocks:           1
dec_output_kernel:        5
dec_gaussian:             True
dec_skip_last_residual:   True
freeze_layers:            keras_encoder
load_layers:              encoder
fs_original_depth:        4
fs_original_min_filters:  128
fs_original_max_filters:  1024
fs_original_use_alt:      False
mobilenet_width:          1.0
mobilenet_depth:          1
mobilenet_dropout:        0.001
mobilenet_minimalistic:   False

[model.realface]
input_size:               64
output_size:              128
dense_nodes:              1536
complexity_encoder:       128
complexity_decoder:       512

[model.unbalanced]
input_size:               128
lowmem:                   False
nodes:                    1024
complexity_encoder:       128
complexity_decoder_a:     384
complexity_decoder_b:     512

[model.villain]
lowmem:                   False

[trainer.original]
preview_images:           14
mask_opacity:             30
mask_color:               #ff0000
zoom_amount:              5
rotation_range:           10
shift_range:              5
flip_chance:              50
color_lightness:          30
color_ab:                 8
color_clahe_chance:       50
color_clahe_max_size:     4
Last edited by torzdf on Mon Aug 14, 2023 5:11 pm, edited 1 time in total.
User avatar
torzdf
Posts: 2687
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 135 times
Been thanked: 628 times

Re: Critical An unexpected crash has occurred

Post by torzdf »

This is almost definitely because of foreign characters in your filenames. Specifically these characters : 刘德华

If you can provide me with the file C:\Users\Administrator\Desktop\b\刘德华_000032_0.png I may be able to look into putting in a fix for this.

However, if you rename your files to only have Latin characters, you should be ok to train.

My word is final

Locked