Read the FAQs and search the forum before posting a new topic.
This forum is for reporting errors with the Training process. If you want to get tips, or better understand the Training process, then you should look in the Training Discussion forum.
Please mark any answers that fixed your problems so others can find the solutions.
Hi,
I have an error when I try to train my model :
01/04/2021 09:22:42 ERROR Caught exception in thread: '_training_0'
01/04/2021 09:22:44 ERROR Got Exception on main handler
ValueError: could not broadcast input array from shape (251,119,3) into shape (251,0,3)
Do you know what's wrong ?
Thanks in advance 
Hi,
I've been having the same issue over and over again. I tried quite a lot of different things with no success. The error I get is this :
Error in thread (_run_0): could not broadcast input array from shape (0,384,3) into shape (9,384,3)
Among the things I already checked out :
I switched the log level to "TRACE" to have more information on the issue and I received one additional info (see below), but I don't know if this is an issue :
Code: Select all
W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: Invoking GPU asm compilation is supported on Cuda non-Windows platforms only
Relying on driver to perform ptx compilation.
Modify $PATH to customize ptxas location.I put a lot of efforts in that but I feel like I'm hitting a wall, I have a hard time knowing what I should try next. If any of you has an idea of what it might be, I would really appreciate having help on this.
Here is the full stack trace :
Code: Select all
01/07/2021 23:43:12 MainProcess _training_0 _base _get_predictions DEBUG Returning predictions: {'a_a': (14, 128, 128, 3), 'b_b': (14, 128, 128, 3), 'a_b': (14, 128, 128, 3), 'b_a': (14, 128, 128, 3)}
01/07/2021 23:43:12 MainProcess _training_0 _base _to_full_frame DEBUG side: 'a', number of sample arrays: 3, prediction.shapes: [(14, 128, 128, 3), (14, 128, 128, 3)])
01/07/2021 23:43:12 MainProcess _training_0 _base _process_full DEBUG full_size: 384, prediction_size: 128, color: (0, 0, 255)
01/07/2021 23:43:12 MainProcess _training_0 _base _resize_sample DEBUG Resizing sample: (side: 'a', sample.shape: (14, 384, 384, 3), target_size: 186, scale: 0.484375)
01/07/2021 23:43:12 MainProcess _training_0 _base _resize_sample DEBUG Resized sample: (side: 'a' shape: (14, 186, 186, 3))
01/07/2021 23:43:12 MainProcess _training_0 _base _process_full DEBUG Overlayed background. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG side: 'a', width: 186
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG height: 41, total_width: 558
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG texts: ['Original (A)', 'Original > Original', 'Original > Swap'], text_sizes: [(104, 13), (168, 13), (147, 13)], text_x: [41, 195, 391], text_y: 27
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG header_box.shape: (41, 558, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _to_full_frame DEBUG side: 'b', number of sample arrays: 3, prediction.shapes: [(14, 128, 128, 3), (14, 128, 128, 3)])
01/07/2021 23:43:12 MainProcess _training_0 _base _process_full DEBUG full_size: 384, prediction_size: 128, color: (0, 0, 255)
01/07/2021 23:43:12 MainProcess _training_0 _base _resize_sample DEBUG Resizing sample: (side: 'b', sample.shape: (14, 384, 384, 3), target_size: 186, scale: 0.484375)
01/07/2021 23:43:12 MainProcess _training_0 _base _resize_sample DEBUG Resized sample: (side: 'b' shape: (14, 186, 186, 3))
01/07/2021 23:43:12 MainProcess _training_0 _base _process_full DEBUG Overlayed background. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG side: 'b', width: 186
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG height: 41, total_width: 558
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG texts: ['Swap (B)', 'Swap > Swap', 'Swap > Original'], text_sizes: [(85, 13), (127, 13), (147, 13)], text_x: [50, 215, 391], text_y: 27
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG header_box.shape: (41, 558, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _duplicate_headers DEBUG side: a header.shape: (41, 558, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _duplicate_headers DEBUG side: b header.shape: (41, 558, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _stack_images DEBUG Stack images
01/07/2021 23:43:12 MainProcess _training_0 _base get_transpose_axes DEBUG Even number of images to stack
01/07/2021 23:43:12 MainProcess _training_0 _base _stack_images DEBUG Stacked images
01/07/2021 23:43:12 MainProcess _training_0 _base show_sample DEBUG Compiled sample
01/07/2021 23:43:12 MainProcess _training_0 train _show DEBUG Updating preview: (name: Training - 'S': Save Now. 'R': Refresh Preview. 'ENTER': Save and Quit)
01/07/2021 23:43:12 MainProcess _training_0 train _show DEBUG Generating preview for GUI
01/07/2021 23:43:12 MainProcess _training_0 train _show DEBUG Generated preview for GUI: '.gui_training_preview.jpg'
01/07/2021 23:43:12 MainProcess _training_0 train _show DEBUG Updated preview: (name: Training - 'S': Save Now. 'R': Refresh Preview. 'ENTER': Save and Quit)
01/07/2021 23:43:12 MainProcess _training_0 _base output_timelapse DEBUG Ouputting time-lapse
01/07/2021 23:43:12 MainProcess _training_0 _base output_timelapse DEBUG Getting time-lapse samples
01/07/2021 23:43:12 MainProcess _training_0 _base compile_sample DEBUG Compiling samples: (side: 'a', samples: 14)
01/07/2021 23:43:12 MainProcess _training_0 _base compile_sample DEBUG Compiling samples: (side: 'b', samples: 14)
01/07/2021 23:43:12 MainProcess _training_0 _base output_timelapse DEBUG Got time-lapse samples: {'a': 3, 'b': 3}
01/07/2021 23:43:12 MainProcess _training_0 _base show_sample DEBUG Showing sample
01/07/2021 23:43:12 MainProcess _training_0 _base _get_predictions DEBUG Getting Predictions
01/07/2021 23:43:12 MainProcess _training_0 _base _get_predictions DEBUG Returning predictions: {'a_a': (14, 128, 128, 3), 'b_b': (14, 128, 128, 3), 'a_b': (14, 128, 128, 3), 'b_a': (14, 128, 128, 3)}
01/07/2021 23:43:12 MainProcess _training_0 _base _to_full_frame DEBUG side: 'a', number of sample arrays: 3, prediction.shapes: [(14, 128, 128, 3), (14, 128, 128, 3)])
01/07/2021 23:43:12 MainProcess _training_0 _base _process_full DEBUG full_size: 384, prediction_size: 128, color: (0, 0, 255)
01/07/2021 23:43:12 MainProcess _training_0 _base _resize_sample DEBUG Resizing sample: (side: 'a', sample.shape: (14, 384, 384, 3), target_size: 186, scale: 0.484375)
01/07/2021 23:43:12 MainProcess _training_0 _base _resize_sample DEBUG Resized sample: (side: 'a' shape: (14, 186, 186, 3))
01/07/2021 23:43:12 MainProcess _training_0 _base _process_full DEBUG Overlayed background. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG side: 'a', width: 186
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG height: 41, total_width: 558
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG texts: ['Original (A)', 'Original > Original', 'Original > Swap'], text_sizes: [(104, 13), (168, 13), (147, 13)], text_x: [41, 195, 391], text_y: 27
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG header_box.shape: (41, 558, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _to_full_frame DEBUG side: 'b', number of sample arrays: 3, prediction.shapes: [(14, 128, 128, 3), (14, 128, 128, 3)])
01/07/2021 23:43:12 MainProcess _training_0 _base _process_full DEBUG full_size: 384, prediction_size: 128, color: (0, 0, 255)
01/07/2021 23:43:12 MainProcess _training_0 _base _resize_sample DEBUG Resizing sample: (side: 'b', sample.shape: (14, 384, 384, 3), target_size: 186, scale: 0.484375)
01/07/2021 23:43:12 MainProcess _training_0 _base _resize_sample DEBUG Resized sample: (side: 'b' shape: (14, 186, 186, 3))
01/07/2021 23:43:12 MainProcess _training_0 _base _process_full DEBUG Overlayed background. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _overlay_foreground DEBUG Overlayed foreground. Shape: (14, 186, 186, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG side: 'b', width: 186
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG height: 41, total_width: 558
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG texts: ['Swap (B)', 'Swap > Swap', 'Swap > Original'], text_sizes: [(85, 13), (127, 13), (147, 13)], text_x: [50, 215, 391], text_y: 27
01/07/2021 23:43:12 MainProcess _training_0 _base _get_headers DEBUG header_box.shape: (41, 558, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _duplicate_headers DEBUG side: a header.shape: (41, 558, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _duplicate_headers DEBUG side: b header.shape: (41, 558, 3)
01/07/2021 23:43:12 MainProcess _training_0 _base _stack_images DEBUG Stack images
01/07/2021 23:43:12 MainProcess _training_0 _base get_transpose_axes DEBUG Even number of images to stack
01/07/2021 23:43:12 MainProcess _training_0 _base _stack_images DEBUG Stacked images
01/07/2021 23:43:12 MainProcess _training_0 _base show_sample DEBUG Compiled sample
01/07/2021 23:43:12 MainProcess _training_0 _base output_timelapse DEBUG Created time-lapse: 'D:\Faceswap\Fucking Timelapse\1610080992.jpg'
01/07/2021 23:43:12 MainProcess _training_0 train _run_training_cycle DEBUG Save Iteration: (iteration: 250
01/07/2021 23:43:12 MainProcess _training_0 _base _save DEBUG Backing up and saving models
01/07/2021 23:43:12 MainProcess _training_0 _base _get_save_averages DEBUG Getting save averages
01/07/2021 23:43:12 MainProcess _training_0 _base _get_save_averages DEBUG Average losses since last save: [1.2393386627296845, 0.9816525899262792]
01/07/2021 23:43:12 MainProcess _training_0 _base _should_backup DEBUG Updated lowest historical save iteration averages from: {'a': 2.3554301261901855, 'b': 2.8172590732574463} to: {'a': 1.2393386627296845, 'b': 0.9816525899262792}
01/07/2021 23:43:12 MainProcess _training_0 _base _should_backup DEBUG Should backup: True
01/07/2021 23:43:12 MainProcess _training_0 backup_restore backup_model VERBOSE Backing up: 'D:\Faceswap\Fucking New Model\villain.h5' to 'D:\Faceswap\Fucking New Model\villain.h5.bk'
01/07/2021 23:43:12 MainProcess _training_0 backup_restore backup_model VERBOSE Backing up: 'D:\Faceswap\Fucking New Model\villain_state.json' to 'D:\Faceswap\Fucking New Model\villain_state.json.bk'
01/07/2021 23:43:13 MainProcess _training_0 _base save DEBUG Saving State
01/07/2021 23:43:13 MainProcess _training_0 serializer save DEBUG filename: D:\Faceswap\Fucking New Model\villain_state.json, data type: <class 'dict'>
01/07/2021 23:43:13 MainProcess _training_0 serializer _check_extension DEBUG Original filename: 'D:\Faceswap\Fucking New Model\villain_state.json', final filename: 'D:\Faceswap\Fucking New Model\villain_state.json'
01/07/2021 23:43:13 MainProcess _training_0 serializer marshal DEBUG data type: <class 'dict'>
01/07/2021 23:43:13 MainProcess _training_0 serializer marshal DEBUG returned data type: <class 'bytes'>
01/07/2021 23:43:13 MainProcess _training_0 _base save DEBUG Saved State
01/07/2021 23:43:13 MainProcess _training_0 _base _save INFO [Saved models] - Average loss since last save: face_a: 1.23934, face_b: 0.98165
01/07/2021 23:44:29 MainProcess _run_0 multithreading run DEBUG Error in thread (_run_0): could not broadcast input array from shape (0,384,3) into shape (9,384,3)
01/07/2021 23:44:30 MainProcess _training_0 multithreading check_and_raise_error DEBUG Thread error caught: [(<class 'ValueError'>, ValueError('could not broadcast input array from shape (0,384,3) into shape (9,384,3)'), <traceback object at 0x000001E3EC951600>)]
01/07/2021 23:44:30 MainProcess _training_0 multithreading run DEBUG Error in thread (_training_0): could not broadcast input array from shape (0,384,3) into shape (9,384,3)
01/07/2021 23:44:30 MainProcess _run_1 multithreading run DEBUG Error in thread (_run_1): could not broadcast input array from shape (0,384,3) into shape (9,384,3)
01/07/2021 23:44:30 MainProcess MainThread train _monitor DEBUG Thread error detected
01/07/2021 23:44:30 MainProcess MainThread train _monitor DEBUG Closed Monitor
01/07/2021 23:44:30 MainProcess MainThread train _end_thread DEBUG Ending Training thread
01/07/2021 23:44:30 MainProcess MainThread train _end_thread CRITICAL Error caught! Exiting...
01/07/2021 23:44:30 MainProcess MainThread multithreading join DEBUG Joining Threads: '_training'
01/07/2021 23:44:30 MainProcess MainThread multithreading join DEBUG Joining Thread: '_training_0'
01/07/2021 23:44:30 MainProcess MainThread multithreading join ERROR Caught exception in thread: '_training_0'
Traceback (most recent call last):
File "C:\Program Files (x86)\faceswap\lib\cli\launcher.py", line 182, in execute_script
process.process()
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 170, in process
self._end_thread(thread, err)
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 210, in _end_thread
thread.join()
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 121, in join
raise thread.err[1].with_traceback(thread.err[2])
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 37, in run
self._target(*self._args, **self._kwargs)
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 232, in _training
raise err
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 222, in _training
self._run_training_cycle(model, trainer)
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 302, in _run_training_cycle
trainer.train_one_step(viewer, timelapse)
File "C:\Program Files (x86)\faceswap\plugins\train\trainer\_base.py", line 236, in train_one_step
model_inputs, model_targets = self._feeder.get_batch()
File "C:\Program Files (x86)\faceswap\plugins\train\trainer\_base.py", line 450, in get_batch
batch = next(self._feeds[side])
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 156, in iterator
self.check_and_raise_error()
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 84, in check_and_raise_error
raise error[1].with_traceback(error[2])
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 37, in run
self._target(*self._args, **self._kwargs)
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 145, in _run
for item in self.generator(*self._gen_args, **self._gen_kwargs):
File "C:\Program Files (x86)\faceswap\lib\training_data.py", line 206, in _minibatch
yield self._process_batch(img_paths, side)
File "C:\Program Files (x86)\faceswap\lib\training_data.py", line 215, in _process_batch
batch, landmarks = self._crop_to_center(filenames, batch, side)
File "C:\Program Files (x86)\faceswap\lib\training_data.py", line 319, in _crop_to_center
cropped = np.array([align.extract_face(img) for align, img in zip(aligned, batch)])
File "C:\Program Files (x86)\faceswap\lib\training_data.py", line 319, in <listcomp>
cropped = np.array([align.extract_face(img) for align, img in zip(aligned, batch)])
File "C:\Program Files (x86)\faceswap\lib\align\aligned_face.py", line 341, in extract_face
image = self._convert_centering(image)
File "C:\Program Files (x86)\faceswap\lib\align\aligned_face.py", line 380, in _convert_centering
out[slices["out"][0], slices["out"][1], :] = image[slices["in"][0], slices["in"][1], :]
ValueError: could not broadcast input array from shape (0,384,3) into shape (9,384,3)
============ System Information ============
encoding: cp1252
git_branch: Not Found
git_commits: Not Found
gpu_cuda: No global version found. Check Conda packages for Conda Cuda
gpu_cudnn: No global version found. Check Conda packages for Conda cuDNN
gpu_devices: GPU_0: GeForce RTX 2080 Ti
gpu_devices_active: GPU_0
gpu_driver: 457.30
gpu_vram: GPU_0: 11264MB
os_machine: AMD64
os_platform: Windows-10-10.0.18362-SP0
os_release: 10
py_command: C:\Program Files (x86)\faceswap\faceswap.py train -A D:/Faceswap/Hitler/Full HD Images -ala D:/Faceswap/Hitler Alignment/Hitler_alignments.fsa -B D:/Faceswap/Legault/Video 1 -alb D:/Faceswap/Legault Alignment/1_alignments.fsa -m D:/Faceswap/Fucking New Model -t villain -bs 16 -it 5000000 -s 250 -ss 25000 -tia D:/Faceswap/Hitler/Full HD Images -tib D:/Faceswap/Legault/Video 1 -to D:/Faceswap/Fucking Timelapse -ps 100 -L TRACE -gui
py_conda_version: conda 4.9.2
py_implementation: CPython
py_version: 3.8.5
py_virtual_env: True
sys_cores: 16
sys_processor: Intel64 Family 6 Model 158 Stepping 12, GenuineIntel
sys_ram: Total: 32683MB, Available: 13531MB, Used: 19151MB, Free: 13531MB
=============== Pip Packages ===============
absl-py @ file:///tmp/build/80754af9/absl-py_1607439979954/work
aiohttp @ file:///C:/ci/aiohttp_1607109697839/work
astunparse==1.6.3
async-timeout==3.0.1
attrs @ file:///tmp/build/80754af9/attrs_1604765588209/work
blinker==1.4
brotlipy==0.7.0
cachetools @ file:///tmp/build/80754af9/cachetools_1607706694405/work
certifi==2020.12.5
cffi @ file:///C:/ci/cffi_1606255208697/work
chardet @ file:///C:/ci/chardet_1605303225733/work
click==7.1.2
cryptography==2.9.2
cycler==0.10.0
fastcluster==1.1.26
ffmpy==0.2.3
gast @ file:///tmp/build/80754af9/gast_1597433534803/work
google-auth @ file:///tmp/build/80754af9/google-auth_1607969906642/work
google-auth-oauthlib @ file:///tmp/build/80754af9/google-auth-oauthlib_1603929124518/work
google-pasta==0.2.0
grpcio @ file:///C:/ci/grpcio_1597406462198/work
h5py==2.10.0
idna @ file:///tmp/build/80754af9/idna_1593446292537/work
imageio @ file:///tmp/build/80754af9/imageio_1594161405741/work
imageio-ffmpeg @ file:///home/conda/feedstock_root/build_artifacts/imageio-ffmpeg_1589202782679/work
importlib-metadata @ file:///tmp/build/80754af9/importlib-metadata_1602276842396/work
joblib @ file:///tmp/build/80754af9/joblib_1607970656719/work
Keras-Applications @ file:///tmp/build/80754af9/keras-applications_1594366238411/work
Keras-Preprocessing==1.1.0
kiwisolver @ file:///C:/ci/kiwisolver_1604014703538/work
Markdown @ file:///C:/ci/markdown_1605111189761/work
matplotlib @ file:///C:/ci/matplotlib-base_1592837548929/work
mkl-fft==1.2.0
mkl-random==1.1.1
mkl-service==2.3.0
multidict @ file:///C:/ci/multidict_1600456481656/work
numpy @ file:///C:/ci/numpy_and_numpy_base_1603466732592/work
nvidia-ml-py3 @ git+https://github.com/deepfakes/nvidia-ml-py3.git@6fc29ac84b32bad877f078cb4a777c1548a00bf6
oauthlib==3.1.0
olefile==0.46
opencv-python==4.5.1.48
opt-einsum==3.1.0
pathlib==1.0.1
Pillow @ file:///C:/ci/pillow_1603823068645/work
protobuf==3.13.0
psutil @ file:///C:/ci/psutil_1598370330503/work
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser @ file:///tmp/build/80754af9/pycparser_1594388511720/work
PyJWT @ file:///C:/ci/pyjwt_1608658192037/work
pyOpenSSL @ file:///tmp/build/80754af9/pyopenssl_1608057966937/work
pyparsing==2.4.7
pyreadline==2.1
PySocks @ file:///C:/ci/pysocks_1605287845585/work
python-dateutil==2.8.1
pywin32==227
requests @ file:///tmp/build/80754af9/requests_1608241421344/work
requests-oauthlib==1.3.0
rsa @ file:///tmp/build/80754af9/rsa_1596998415516/work
scikit-learn @ file:///C:/ci/scikit-learn_1598377018496/work
scipy @ file:///C:/ci/scipy_1604596260408/work
sip==4.19.13
six @ file:///C:/ci/six_1605187374963/work
tensorboard @ file:///home/builder/ktietz/conda/conda-bld/tensorboard_1604313476433/work/tmp_pip_dir
tensorboard-plugin-wit==1.6.0
tensorflow==2.3.0
tensorflow-estimator @ file:///tmp/build/80754af9/tensorflow-estimator_1599136169057/work/whl_temp/tensorflow_estimator-2.3.0-py2.py3-none-any.whl
termcolor==1.1.0
threadpoolctl @ file:///tmp/tmp9twdgx9k/threadpoolctl-2.1.0-py3-none-any.whl
tornado @ file:///C:/ci/tornado_1606942392901/work
tqdm @ file:///tmp/build/80754af9/tqdm_1608922753628/work
typing-extensions @ file:///tmp/build/80754af9/typing_extensions_1598376058250/work
urllib3 @ file:///tmp/build/80754af9/urllib3_1606938623459/work
Werkzeug==1.0.1
win-inet-pton @ file:///C:/ci/win_inet_pton_1605306167264/work
wincertstore==0.2
wrapt==1.12.1
yarl @ file:///C:/ci/yarl_1598045274898/work
zipp @ file:///tmp/build/80754af9/zipp_1604001098328/work
============== Conda Packages ==============
# packages in environment at C:\Users\antoi\MiniConda3\envs\Faceswap:
#
# Name Version Build Channel
_tflow_select 2.3.0 gpu
absl-py 0.11.0 pyhd3eb1b0_1
aiohttp 3.7.3 py38h2bbff1b_1
astunparse 1.6.3 py_0
async-timeout 3.0.1 py38_0
attrs 20.3.0 pyhd3eb1b0_0
blas 1.0 mkl
blinker 1.4 py38_0
brotlipy 0.7.0 py38h2bbff1b_1003
ca-certificates 2020.12.8 haa95532_0
cachetools 4.2.0 pyhd3eb1b0_0
certifi 2020.12.5 py38haa95532_0
cffi 1.14.4 py38hcd4344a_0
chardet 3.0.4 py38haa95532_1003
click 7.1.2 py_0
cryptography 2.9.2 py38h7a1dbc1_0
cudatoolkit 10.1.243 h74a9793_0
cudnn 7.6.5 cuda10.1_0
cycler 0.10.0 py38_0
fastcluster 1.1.26 py38h251f6bf_2 conda-forge
ffmpeg 4.3.1 ha925a31_0 conda-forge
ffmpy 0.2.3 pypi_0 pypi
freetype 2.10.4 hd328e21_0
gast 0.4.0 py_0
git 2.23.0 h6bb4b03_0
google-auth 1.24.0 pyhd3eb1b0_0
google-auth-oauthlib 0.4.2 pyhd3eb1b0_2
google-pasta 0.2.0 py_0
grpcio 1.31.0 py38he7da953_0
h5py 2.10.0 py38h5e291fa_0
hdf5 1.10.4 h7ebc959_0
icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha925a31_3
idna 2.10 py_0
imageio 2.9.0 py_0
imageio-ffmpeg 0.4.2 py_0 conda-forge
importlib-metadata 2.0.0 py_1
intel-openmp 2020.2 254
joblib 1.0.0 pyhd3eb1b0_0
jpeg 9b hb83a4c4_2
keras-applications 1.0.8 py_1
keras-preprocessing 1.1.0 py_1
kiwisolver 1.3.0 py38hd77b12b_0
libpng 1.6.37 h2a8f88b_0
libprotobuf 3.13.0.1 h200bbdf_0
libtiff 4.1.0 h56a325e_1
lz4-c 1.9.2 hf4a77e7_3
markdown 3.3.3 py38haa95532_0
matplotlib 3.2.2 0
matplotlib-base 3.2.2 py38h64f37c6_0
mkl 2020.2 256
mkl-service 2.3.0 py38h196d8e1_0
mkl_fft 1.2.0 py38h45dec08_0
mkl_random 1.1.1 py38h47e9c7a_0
multidict 4.7.6 py38he774522_1
numpy 1.19.2 py38hadc3359_0
numpy-base 1.19.2 py38ha3acd2a_0
nvidia-ml-py3 7.352.1 pypi_0 pypi
oauthlib 3.1.0 py_0
olefile 0.46 py_0
opencv-python 4.5.1.48 pypi_0 pypi
openssl 1.1.1i h2bbff1b_0
opt_einsum 3.1.0 py_0
pathlib 1.0.1 py_1
pillow 8.0.1 py38h4fa10fc_0
pip 20.3.3 py38haa95532_0
protobuf 3.13.0.1 py38ha925a31_1
psutil 5.7.2 py38he774522_0
pyasn1 0.4.8 py_0
pyasn1-modules 0.2.8 py_0
pycparser 2.20 py_2
pyjwt 2.0.0 py38haa95532_0
pyopenssl 20.0.1 pyhd3eb1b0_1
pyparsing 2.4.7 py_0
pyqt 5.9.2 py38ha925a31_4
pyreadline 2.1 py38_1
pysocks 1.7.1 py38haa95532_0
python 3.8.5 h5fd99cc_1
python-dateutil 2.8.1 py_0
python_abi 3.8 1_cp38 conda-forge
pywin32 227 py38he774522_1
qt 5.9.7 vc14h73c81de_0
requests 2.25.1 pyhd3eb1b0_0
requests-oauthlib 1.3.0 py_0
rsa 4.6 py_0
scikit-learn 0.23.2 py38h47e9c7a_0
scipy 1.5.2 py38h14eb087_0
setuptools 51.0.0 py38haa95532_2
sip 4.19.13 py38ha925a31_0
six 1.15.0 py38haa95532_0
sqlite 3.33.0 h2a8f88b_0
tensorboard 2.3.0 pyh4dce500_0
tensorboard-plugin-wit 1.6.0 py_0
tensorflow 2.3.0 mkl_py38h1fcfbd6_0
tensorflow-base 2.3.0 gpu_py38h7339f5a_0
tensorflow-estimator 2.3.0 pyheb71bc4_0
tensorflow-gpu 2.3.0 he13fc11_0
termcolor 1.1.0 py38_1
threadpoolctl 2.1.0 pyh5ca1d4c_0
tk 8.6.10 he774522_0
tornado 6.1 py38h2bbff1b_0
tqdm 4.55.0 pyhd3eb1b0_0
typing-extensions 3.7.4.3 0
typing_extensions 3.7.4.3 py_0
urllib3 1.26.2 pyhd3eb1b0_0
vc 14.2 h21ff451_1
vs2015_runtime 14.27.29016 h5e58377_2
werkzeug 1.0.1 py_0
wheel 0.36.2 pyhd3eb1b0_0
win_inet_pton 1.1.0 py38haa95532_0
wincertstore 0.2 py38_0
wrapt 1.12.1 py38he774522_1
xz 5.2.5 h62dcd97_0
yarl 1.5.1 py38he774522_0
zipp 3.4.0 pyhd3eb1b0_0
zlib 1.2.11 h62dcd97_4
zstd 1.4.5 h04227a9_0
=============== State File =================
{
"name": "villain",
"sessions": {
"1": {
"timestamp": 1610069504.3544455,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"2": {
"timestamp": 1610069832.2736046,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"3": {
"timestamp": 1610072398.4454982,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"4": {
"timestamp": 1610080597.7570343,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 250,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
}
},
"lowest_avg_loss": {
"a": 1.2393386627296845,
"b": 0.9816525899262792
},
"iterations": 253,
"config": {
"centering": "face",
"coverage": 68.75,
"optimizer": "adam",
"learning_rate": 5e-05,
"allow_growth": false,
"mixed_precision": true,
"convert_batchsize": 16,
"loss_function": "ssim",
"mask_loss_function": "mse",
"l2_reg_term": 100,
"eye_multiplier": 3,
"mouth_multiplier": 2,
"penalized_mask_loss": false,
"mask_type": "extended",
"mask_blur_kernel": 3,
"mask_threshold": 4,
"learn_mask": false,
"lowmem": false
}
}
================= Configs ==================
--------- .faceswap ---------
backend: nvidia
--------- convert.ini ---------
[color.color_transfer]
clip: True
preserve_paper: True
[color.manual_balance]
colorspace: HSV
balance_1: 0.0
balance_2: 0.0
balance_3: 0.0
contrast: 0.0
brightness: 0.0
[color.match_hist]
threshold: 99.0
[mask.box_blend]
type: gaussian
distance: 11.0
radius: 5.0
passes: 1
[mask.mask_blend]
type: normalized
kernel_size: 3
passes: 4
threshold: 4
erosion: 0.0
[scaling.sharpen]
method: none
amount: 150
radius: 0.3
threshold: 5.0
[writer.ffmpeg]
container: mp4
codec: libx264
crf: 23
preset: medium
tune: none
profile: auto
level: auto
skip_mux: False
[writer.gif]
fps: 25
loop: 0
palettesize: 256
subrectangles: False
[writer.opencv]
format: png
draw_transparent: False
jpg_quality: 75
png_compress_level: 3
[writer.pillow]
format: png
draw_transparent: False
optimize: False
gif_interlace: True
jpg_quality: 75
png_compress_level: 3
tif_compression: tiff_deflate
--------- extract.ini ---------
[global]
allow_growth: False
[align.fan]
batch-size: 12
[detect.cv2_dnn]
confidence: 50
[detect.mtcnn]
minsize: 20
threshold_1: 0.6
threshold_2: 0.7
threshold_3: 0.7
scalefactor: 0.709
batch-size: 8
[detect.s3fd]
confidence: 70
batch-size: 4
[mask.unet_dfl]
batch-size: 8
[mask.vgg_clear]
batch-size: 6
[mask.vgg_obstructed]
batch-size: 2
--------- gui.ini ---------
[global]
fullscreen: False
tab: extract
options_panel_width: 30
console_panel_height: 20
icon_size: 14
font: default
font_size: 9
autosave_last_session: prompt
timeout: 120
auto_load_model_stats: True
--------- train.ini ---------
[global]
centering: face
coverage: 68.75
icnr_init: False
conv_aware_init: False
optimizer: adam
learning_rate: 5e-05
reflect_padding: False
allow_growth: False
mixed_precision: True
convert_batchsize: 16
[global.loss]
loss_function: ssim
mask_loss_function: mse
l2_reg_term: 100
eye_multiplier: 3
mouth_multiplier: 2
penalized_mask_loss: False
mask_type: extended
mask_blur_kernel: 3
mask_threshold: 4
learn_mask: False
[model.dfaker]
output_size: 128
[model.dfl_h128]
lowmem: False
[model.dfl_sae]
input_size: 128
clipnorm: True
architecture: df
autoencoder_dims: 0
encoder_dims: 42
decoder_dims: 21
multiscale_decoder: False
[model.dlight]
features: best
details: good
output_size: 256
[model.original]
lowmem: False
[model.realface]
input_size: 64
output_size: 128
dense_nodes: 1536
complexity_encoder: 128
complexity_decoder: 512
[model.unbalanced]
input_size: 128
lowmem: False
clipnorm: True
nodes: 1024
complexity_encoder: 128
complexity_decoder_a: 384
complexity_decoder_b: 512
[model.villain]
lowmem: False
[trainer.original]
preview_images: 14
zoom_amount: 5
rotation_range: 10
shift_range: 5
flip_chance: 50
disable_warp: False
color_lightness: 30
color_ab: 8
color_clahe_chance: 50
color_clahe_max_size: 4sacapierres wrote: ↑Fri Jan 08, 2021 5:07 amI switched the log level to "TRACE" to have more information on the issue and I received one additional info (see below), but I don't know if this is an issue :
Code: Select all
W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: Invoking GPU asm compilation is supported on Cuda non-Windows platforms only Relying on driver to perform ptx compilation. Modify $PATH to customize ptxas location.
Don't worry about this, it's a standard Tensorflow Warning. It has not impact on Faceswap.
As to the rest, it looks like a bug of some kind, but it's not something I'm likely to be able to address unless I can replicate.
If there is anyway that you can provide the training images + alignment files (you can PM me if you wish), then I can look into this.
My word is final
Thank you very much for offering your help. I think that my pictures set is a little bit too big to send it for now.
The pictures from the original video (for which I want to replace the face with another) is not so big (3 711 files, about 900 MB for the pictures + the alignment file).
However, the pictures of the face that I want to put on the original video is much bigger (54 962 files, 16.2 GB for the pictures, 136 MB for the alignments file). This makes me think that I may have too many files. I am aware that this is not optimal, I wanted to avoid spending too much time on sorting the pictures (I plainly took every pictures from two different videos) since it is my first shot at deep-faking a video.
I will try to lower the number of files from 54 962 to 5 000 or so. This would amount to something like 2.5 GB for all the files or the original video and the pictures of the face to replace what is in the video. So I would be able to put share them on the cloud so you can try on your end .
Does it sound like a good plan?
I've actually managed to get some other data to replicate this issue, so I am looking into it currently. Hopefully I'll have a fix in place in the next few days.
My word is final
Oh thank you very much!
Have a good day!
I have the same problem, can you tell me how u fix it?
The crash happens around 10 minutes after i start training.
I have no any ideas of why this pops up
I saw somebody suffer this question from small vram, so I tried to lower the batch size to one, but it didn't work.
Code: Select all
01/18/2021 19:21:28 ERROR Caught exception in thread: '_training_0'
01/18/2021 19:21:31 ERROR Got Exception on main handler:
Traceback (most recent call last):
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\cli\launcher.py", line 182, in execute_script
process.process()
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 170, in process
self._end_thread(thread, err)
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 210, in _end_thread
thread.join()
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 121, in join
raise thread.err[1].with_traceback(thread.err[2])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 37, in run
self._target(*self._args, **self._kwargs)
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 232, in _training
raise err
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 222, in _training
self._run_training_cycle(model, trainer)
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 302, in _run_training_cycle
trainer.train_one_step(viewer, timelapse)
File "C:\Users\Joshua_Lin940508\Videos\GE\plugins\train\trainer\_base.py", line 236, in train_one_step
model_inputs, model_targets = self._feeder.get_batch()
File "C:\Users\Joshua_Lin940508\Videos\GE\plugins\train\trainer\_base.py", line 450, in get_batch
batch = next(self._feeds[side])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 156, in iterator
self.check_and_raise_error()
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 84, in check_and_raise_error
raise error[1].with_traceback(error[2])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 37, in run
self._target(*self._args, **self._kwargs)
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 145, in _run
for item in self.generator(*self._gen_args, **self._gen_kwargs):
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\training_data.py", line 206, in _minibatch
yield self._process_batch(img_paths, side)
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\training_data.py", line 215, in _process_batch
batch, landmarks = self._crop_to_center(filenames, batch, side)
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\training_data.py", line 319, in _crop_to_center
cropped = np.array([align.extract_face(img) for align, img in zip(aligned, batch)])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\training_data.py", line 319, in <listcomp>
cropped = np.array([align.extract_face(img) for align, img in zip(aligned, batch)])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\align\aligned_face.py", line 341, in extract_face
image = self._convert_centering(image)
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\align\aligned_face.py", line 380, in _convert_centering
out[slices["out"][0], slices["out"][1], :] = image[slices["in"][0], slices["in"][1], :]
ValueError: could not broadcast input array from shape (5,0,3) into shape (5,137,3)
01/18/2021 19:21:31 CRITICAL An unexpected crash has occurred. Crash report written to 'C:\Users\Joshua_Lin940508\Videos\GE\crash_report.2021.01.18.192128529385.log'. You MUST provide this file if seeking assistance. Please verify you are running the latest version of faceswap before reporting
Code: Select all
============ System Information ============
encoding: cp65001
git_branch: master
git_commits: 15bbc95 Update Dockerfile (#1112). 163b8fe sysinfo/setup - Standardize cuda/cudnn checks. f9a5b72 Bugfix - setup.py. Explicitly install cudatoolkit in Conda. b1420a6 Merge pull request #1096 from deepfakes/dev-tf2.4. 29667b4 Expand support for tf2.2-2.4
gpu_cuda: No global version found. Check Conda packages for Conda Cuda
gpu_cudnn: No global version found. Check Conda packages for Conda cuDNN
gpu_devices: GPU_0: GeForce GTX 1650 SUPER
gpu_devices_active: GPU_0
gpu_driver: 456.71
gpu_vram: GPU_0: 4096MB
os_machine: AMD64
os_platform: Windows-10-10.0.19041-SP0
os_release: 10
py_command: faceswap.py gui
py_conda_version: conda 4.9.2
py_implementation: CPython
py_version: 3.8.5
py_virtual_env: True
sys_cores: 8
sys_processor: AMD64 Family 23 Model 113 Stepping 0, AuthenticAMD
sys_ram: Total: 16315MB, Available: 10727MB, Used: 5588MB, Free: 10727MB
=============== Pip Packages ===============
absl-py @ file:///tmp/build/80754af9/absl-py_1607439979954/work
aiohttp @ file:///C:/ci/aiohttp_1607109697839/work
astunparse==1.6.3
async-timeout==3.0.1
attrs @ file:///tmp/build/80754af9/attrs_1604765588209/work
blinker==1.4
brotlipy==0.7.0
cachetools @ file:///tmp/build/80754af9/cachetools_1607706694405/work
certifi==2020.6.20
cffi @ file:///C:/ci/cffi_1606255208697/work
chardet @ file:///C:/ci/chardet_1605303225733/work
click==7.1.2
cryptography==2.9.2
cycler==0.10.0
fastcluster==1.1.26
ffmpy==0.2.3
flatbuffers==1.12
gast @ file:///tmp/build/80754af9/gast_1597433534803/work
google-auth @ file:///tmp/build/80754af9/google-auth_1607969906642/work
google-auth-oauthlib @ file:///tmp/build/80754af9/google-auth-oauthlib_1603929124518/work
google-pasta==0.2.0
grpcio==1.32.0
h5py==2.10.0
idna @ file:///tmp/build/80754af9/idna_1593446292537/work
imageio @ file:///tmp/build/80754af9/imageio_1594161405741/work
imageio-ffmpeg @ file:///home/conda/feedstock_root/build_artifacts/imageio-ffmpeg_1609799311556/work
importlib-metadata @ file:///tmp/build/80754af9/importlib-metadata_1602276842396/work
joblib @ file:///tmp/build/80754af9/joblib_1607970656719/work
Keras-Applications @ file:///tmp/build/80754af9/keras-applications_1594366238411/work
Keras-Preprocessing==1.1.2
kiwisolver @ file:///C:/ci/kiwisolver_1604014703538/work
Markdown @ file:///C:/ci/markdown_1605111189761/work
matplotlib @ file:///C:/ci/matplotlib-base_1592837548929/work
mkl-fft==1.2.0
mkl-random==1.1.1
mkl-service==2.3.0
multidict @ file:///C:/ci/multidict_1600456481656/work
numpy @ file:///C:/ci/numpy_and_numpy_base_1603466732592/work
nvidia-ml-py3 @ git+https://github.com/deepfakes/nvidia-ml-py3.git@6fc29ac84b32bad877f078cb4a777c1548a00bf6
oauthlib==3.1.0
olefile==0.46
opencv-python==4.5.1.48
opt-einsum==3.3.0
pathlib==1.0.1
Pillow @ file:///C:/ci/pillow_1609786840597/work
protobuf==3.13.0
psutil @ file:///C:/ci/psutil_1598370330503/work
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser @ file:///tmp/build/80754af9/pycparser_1594388511720/work
PyJWT @ file:///C:/ci/pyjwt_1608658192037/work
pynvml==8.0.4
pyOpenSSL @ file:///tmp/build/80754af9/pyopenssl_1608057966937/work
pyparsing==2.4.7
pyreadline==2.1
PySocks @ file:///C:/ci/pysocks_1605287845585/work
python-dateutil==2.8.1
pywin32==227
requests @ file:///tmp/build/80754af9/requests_1608241421344/work
requests-oauthlib==1.3.0
rsa @ file:///tmp/build/80754af9/rsa_1610483308194/work
scikit-learn @ file:///C:/ci/scikit-learn_1598377018496/work
scipy @ file:///C:/ci/scipy_1604596260408/work
sip==4.19.13
six @ file:///C:/ci/six_1605187374963/work
tensorboard==2.4.1
tensorboard-plugin-wit==1.6.0
tensorflow==2.4.0
tensorflow-estimator==2.4.0
termcolor==1.1.0
threadpoolctl @ file:///tmp/tmp9twdgx9k/threadpoolctl-2.1.0-py3-none-any.whl
tornado @ file:///C:/ci/tornado_1606942392901/work
tqdm @ file:///tmp/build/80754af9/tqdm_1609788246169/work
typing-extensions @ file:///tmp/build/80754af9/typing_extensions_1598376058250/work
urllib3 @ file:///tmp/build/80754af9/urllib3_1606938623459/work
Werkzeug==1.0.1
win-inet-pton @ file:///C:/ci/win_inet_pton_1605306167264/work
wincertstore==0.2
wrapt==1.12.1
yarl @ file:///C:/ci/yarl_1598045274898/work
zipp @ file:///tmp/build/80754af9/zipp_1604001098328/work
============== Conda Packages ==============
# packages in environment at C:\Users\Joshua_Lin940508\anaconda3\envs\GEM:
#
# Name Version Build Channel
_tflow_select 2.3.0 gpu
absl-py 0.11.0 pyhd3eb1b0_1
aiohttp 3.7.3 py38h2bbff1b_1
astunparse 1.6.3 py_0
async-timeout 3.0.1 py38_0
attrs 20.3.0 pyhd3eb1b0_0
blas 1.0 mkl
blinker 1.4 py38_0
brotlipy 0.7.0 py38h2bbff1b_1003
ca-certificates 2020.10.14 0 anaconda
cachetools 4.2.0 pyhd3eb1b0_0
certifi 2020.6.20 py38_0 anaconda
cffi 1.14.4 py38hcd4344a_0
chardet 3.0.4 py38haa95532_1003
click 7.1.2 py_0
cryptography 2.9.2 py38h7a1dbc1_0
cudatoolkit 10.1.243 h74a9793_0
cudnn 7.6.5 cuda10.1_0 anaconda
cycler 0.10.0 py38_0
fastcluster 1.1.26 py38h251f6bf_2 conda-forge
ffmpeg 4.3.1 ha925a31_0 conda-forge
ffmpy 0.2.3 pypi_0 pypi
flatbuffers 1.12 pypi_0 pypi
freetype 2.10.4 hd328e21_0
gast 0.3.3 pypi_0 pypi
google-auth 1.24.0 pyhd3eb1b0_0
google-auth-oauthlib 0.4.2 pyhd3eb1b0_2
google-pasta 0.2.0 py_0
grpcio 1.32.0 pypi_0 pypi
h5py 2.10.0 py38h5e291fa_0
hdf5 1.10.4 h7ebc959_0
icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha925a31_3
idna 2.10 py_0
imageio 2.9.0 py_0
imageio-ffmpeg 0.4.3 pyhd8ed1ab_0 conda-forge
importlib-metadata 2.0.0 py_1
intel-openmp 2020.2 254
joblib 1.0.0 pyhd3eb1b0_0
jpeg 9b hb83a4c4_2
keras-applications 1.0.8 py_1
keras-preprocessing 1.1.2 pypi_0 pypi
kiwisolver 1.3.0 py38hd77b12b_0
libpng 1.6.37 h2a8f88b_0
libprotobuf 3.13.0.1 h200bbdf_0
libtiff 4.1.0 h56a325e_1
lz4-c 1.9.2 hf4a77e7_3
markdown 3.3.3 py38haa95532_0
matplotlib 3.2.2 0
matplotlib-base 3.2.2 py38h64f37c6_0
mkl 2020.2 256
mkl-service 2.3.0 py38h196d8e1_0
mkl_fft 1.2.0 py38h45dec08_0
mkl_random 1.1.1 py38h47e9c7a_0
multidict 4.7.6 py38he774522_1
numpy 1.19.2 py38hadc3359_0
numpy-base 1.19.2 py38ha3acd2a_0
nvidia-ml-py3 7.352.1 pypi_0 pypi
oauthlib 3.1.0 py_0
olefile 0.46 py_0
opencv-python 4.5.1.48 pypi_0 pypi
openssl 1.1.1h he774522_0 anaconda
opt-einsum 3.3.0 pypi_0 pypi
opt_einsum 3.1.0 py_0 anaconda
pathlib 1.0.1 py_1
pillow 8.1.0 py38h4fa10fc_0
pip 20.3.3 py38haa95532_0
protobuf 3.13.0.1 py38ha925a31_1
psutil 5.7.2 py38he774522_0
pyasn1 0.4.8 py_0
pyasn1-modules 0.2.8 py_0
pycparser 2.20 py_2
pyjwt 2.0.0 py38haa95532_0
pynvml 8.0.4 pypi_0 pypi
pyopenssl 20.0.1 pyhd3eb1b0_1
pyparsing 2.4.7 py_0
pyqt 5.9.2 py38ha925a31_4
pyreadline 2.1 py38_1
pysocks 1.7.1 py38haa95532_0
python 3.8.5 h5fd99cc_1
python-dateutil 2.8.1 py_0
python_abi 3.8 1_cp38 conda-forge
pywin32 227 py38he774522_1
qt 5.9.7 vc14h73c81de_0
requests 2.25.1 pyhd3eb1b0_0
requests-oauthlib 1.3.0 py_0
rsa 4.7 pyhd3eb1b0_1
scikit-learn 0.23.2 py38h47e9c7a_0
scipy 1.5.2 py38h14eb087_0
setuptools 51.1.2 py38haa95532_4
sip 4.19.13 py38ha925a31_0
six 1.15.0 py38haa95532_0
sqlite 3.33.0 h2a8f88b_0
tensorboard 2.4.1 pypi_0 pypi
tensorboard-plugin-wit 1.6.0 py_0
tensorflow 2.4.0 pypi_0 pypi
tensorflow-base 2.3.0 gpu_py38h7339f5a_0
tensorflow-estimator 2.4.0 pypi_0 pypi
tensorflow-gpu 2.3.0 he13fc11_0
termcolor 1.1.0 py38_1
threadpoolctl 2.1.0 pyh5ca1d4c_0
tk 8.6.10 he774522_0
tornado 6.1 py38h2bbff1b_0
tqdm 4.55.1 pyhd3eb1b0_0
typing-extensions 3.7.4.3 0
typing_extensions 3.7.4.3 py_0
urllib3 1.26.2 pyhd3eb1b0_0
vc 14.2 h21ff451_1
vs2015_runtime 14.27.29016 h5e58377_2
werkzeug 1.0.1 py_0
wheel 0.36.2 pyhd3eb1b0_0
win_inet_pton 1.1.0 py38haa95532_0
wincertstore 0.2 py38_0
wrapt 1.12.1 py38he774522_1
xz 5.2.5 h62dcd97_0
yarl 1.5.1 py38he774522_0
zipp 3.4.0 pyhd3eb1b0_0
zlib 1.2.11 h62dcd97_4
zstd 1.4.5 h04227a9_0
================= Configs ==================
--------- .faceswap ---------
backend: nvidia
--------- convert.ini ---------
[color.color_transfer]
clip: True
preserve_paper: True
[color.manual_balance]
colorspace: HSV
balance_1: 0.0
balance_2: 0.0
balance_3: 0.0
contrast: 0.0
brightness: 0.0
[color.match_hist]
threshold: 99.0
[mask.box_blend]
type: gaussian
distance: 11.0
radius: 5.0
passes: 1
[mask.mask_blend]
type: normalized
kernel_size: 3
passes: 4
threshold: 4
erosion: 0.0
[scaling.sharpen]
method: none
amount: 150
radius: 0.3
threshold: 5.0
[writer.ffmpeg]
container: mp4
codec: libx264
crf: 23
preset: medium
tune: none
profile: auto
level: auto
skip_mux: False
[writer.gif]
fps: 25
loop: 0
palettesize: 256
subrectangles: False
[writer.opencv]
format: png
draw_transparent: False
jpg_quality: 75
png_compress_level: 3
[writer.pillow]
format: png
draw_transparent: False
optimize: False
gif_interlace: True
jpg_quality: 75
png_compress_level: 3
tif_compression: tiff_deflate
--------- extract.ini ---------
[global]
allow_growth: False
[align.fan]
batch-size: 12
[detect.cv2_dnn]
confidence: 50
[detect.mtcnn]
minsize: 20
threshold_1: 0.6
threshold_2: 0.7
threshold_3: 0.7
scalefactor: 0.709
batch-size: 8
[detect.s3fd]
confidence: 70
batch-size: 4
[mask.unet_dfl]
batch-size: 8
[mask.vgg_clear]
batch-size: 6
[mask.vgg_obstructed]
batch-size: 2
--------- gui.ini ---------
[global]
fullscreen: False
tab: extract
options_panel_width: 30
console_panel_height: 20
icon_size: 14
font: default
font_size: 9
autosave_last_session: prompt
timeout: 120
auto_load_model_stats: True
--------- train.ini ---------
[global]
centering: face
coverage: 68.75
icnr_init: False
conv_aware_init: False
optimizer: adam
learning_rate: 5e-05
reflect_padding: False
allow_growth: False
mixed_precision: False
convert_batchsize: 16
[global.loss]
loss_function: ssim
mask_loss_function: mse
l2_reg_term: 100
eye_multiplier: 3
mouth_multiplier: 2
penalized_mask_loss: True
mask_type: extended
mask_blur_kernel: 3
mask_threshold: 4
learn_mask: False
[model.dfaker]
output_size: 128
[model.dfl_h128]
lowmem: False
[model.dfl_sae]
input_size: 128
clipnorm: True
architecture: df
autoencoder_dims: 0
encoder_dims: 42
decoder_dims: 21
multiscale_decoder: False
[model.dlight]
features: best
details: good
output_size: 256
[model.original]
lowmem: False
[model.realface]
input_size: 64
output_size: 128
dense_nodes: 1536
complexity_encoder: 128
complexity_decoder: 512
[model.unbalanced]
input_size: 128
lowmem: False
clipnorm: True
nodes: 1024
complexity_encoder: 128
complexity_decoder_a: 384
complexity_decoder_b: 512
[model.villain]
lowmem: False
[trainer.original]
preview_images: 14
zoom_amount: 5
rotation_range: 10
shift_range: 5
flip_chance: 50
disable_warp: False
color_lightness: 30
color_ab: 8
color_clahe_chance: 50
color_clahe_max_size: 4
BTW, here is the crash report.
Code: Select all
01/18/2021 19:21:22 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:22 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_011111_0.png'
01/18/2021 19:21:22 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:22 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_011111_0.png'
01/18/2021 19:21:22 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:22 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\[720P] 騰訊專訪鄧紫棋談成長：要做情緒的主人 2017-04-16_017161_0.png'
01/18/2021 19:21:22 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:22 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\[720P] 騰訊專訪鄧紫棋談成長：要做情緒的主人 2017-04-16_017161_0.png'
01/18/2021 19:21:22 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:23 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\google_0096_2_1.jpg'
01/18/2021 19:21:23 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:23 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\google_0096_2_1.jpg'
01/18/2021 19:21:23 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:23 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_021021_0.png'
01/18/2021 19:21:23 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:23 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_021021_0.png'
01/18/2021 19:21:23 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:23 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\[720P] 騰訊專訪鄧紫棋談成長：要做情緒的主人 2017-04-16_011431_0.png'
01/18/2021 19:21:23 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:23 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\[720P] 騰訊專訪鄧紫棋談成長：要做情緒的主人 2017-04-16_011431_0.png'
01/18/2021 19:21:23 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:24 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_009451_0.png'
01/18/2021 19:21:24 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:24 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_009451_0.png'
01/18/2021 19:21:24 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:24 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\google_0025_1_0.jpg'
01/18/2021 19:21:24 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:24 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\google_0025_1_0.jpg'
01/18/2021 19:21:24 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:24 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_010951_0.png'
01/18/2021 19:21:24 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:24 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_010951_0.png'
01/18/2021 19:21:24 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:24 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\Raw_016261_0_0_0.png'
01/18/2021 19:21:24 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:24 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\Raw_016261_0_0_0.png'
01/18/2021 19:21:24 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:25 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_002651_0.png'
01/18/2021 19:21:25 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:25 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_002651_0.png'
01/18/2021 19:21:25 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:25 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\google_0300_0_0.jpg'
01/18/2021 19:21:25 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:25 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\google_0300_0_0.jpg'
01/18/2021 19:21:25 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:25 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_002191_0.png'
01/18/2021 19:21:25 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:25 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_002191_0.png'
01/18/2021 19:21:25 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:25 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\[720P] 騰訊專訪鄧紫棋談成長：要做情緒的主人 2017-04-16_026731_0.png'
01/18/2021 19:21:25 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:25 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\[720P] 騰訊專訪鄧紫棋談成長：要做情緒的主人 2017-04-16_026731_0.png'
01/18/2021 19:21:25 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:25 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_012831_0 (2).png'
01/18/2021 19:21:25 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:26 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_012831_0 (2).png'
01/18/2021 19:21:26 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:26 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\2020-12-09《我們的街拍時刻》G.E.M.鄧紫棋採訪_000541_0.png'
01/18/2021 19:21:26 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:26 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\2020-12-09《我們的街拍時刻》G.E.M.鄧紫棋採訪_000541_0.png'
01/18/2021 19:21:26 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:26 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_008371_0.png'
01/18/2021 19:21:26 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:26 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_008371_0.png'
01/18/2021 19:21:26 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:26 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\[720P] 騰訊專訪鄧紫棋談成長：要做情緒的主人 2017-04-16_013381_0.png'
01/18/2021 19:21:26 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:26 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\[720P] 騰訊專訪鄧紫棋談成長：要做情緒的主人 2017-04-16_013381_0.png'
01/18/2021 19:21:26 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:26 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_004661_0.png'
01/18/2021 19:21:26 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:26 MainProcess _run_0 training_data _expand_partials DEBUG Generating mask. side: 'a', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\Faces2\Raw2_004661_0.png'
01/18/2021 19:21:26 MainProcess _run_0 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:27 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\google_0048 (2)_1_0.jpg'
01/18/2021 19:21:27 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:27 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\google_0048 (2)_1_0.jpg'
01/18/2021 19:21:27 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:27 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\2020-12-09《我們的街拍時刻》G.E.M.鄧紫棋採訪_001309_0.png'
01/18/2021 19:21:27 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:27 MainProcess _run_1 training_data _expand_partials DEBUG Generating mask. side: 'b', filename: 'C:\Users\Joshua_Lin940508\Videos\GE\facesg\2020-12-09《我們的街拍時刻》G.E.M.鄧紫棋採訪_001309_0.png'
01/18/2021 19:21:27 MainProcess _run_1 aligned_face extract_face DEBUG _extract_face called without a loaded image. Returning empty face.
01/18/2021 19:21:27 MainProcess _run_0 multithreading run DEBUG Error in thread (_run_0): could not broadcast input array from shape (5,0,3) into shape (5,137,3)
01/18/2021 19:21:28 MainProcess _training_0 multithreading check_and_raise_error DEBUG Thread error caught: [(<class 'ValueError'>, ValueError('could not broadcast input array from shape (5,0,3) into shape (5,137,3)'), <traceback object at 0x0000018B723C5B40>)]
01/18/2021 19:21:28 MainProcess _training_0 multithreading run DEBUG Error in thread (_training_0): could not broadcast input array from shape (5,0,3) into shape (5,137,3)
01/18/2021 19:21:28 MainProcess MainThread train _monitor DEBUG Thread error detected
01/18/2021 19:21:28 MainProcess MainThread train _monitor DEBUG Closed Monitor
01/18/2021 19:21:28 MainProcess MainThread train _end_thread DEBUG Ending Training thread
01/18/2021 19:21:28 MainProcess MainThread train _end_thread CRITICAL Error caught! Exiting...
01/18/2021 19:21:28 MainProcess MainThread multithreading join DEBUG Joining Threads: '_training'
01/18/2021 19:21:28 MainProcess MainThread multithreading join DEBUG Joining Thread: '_training_0'
01/18/2021 19:21:28 MainProcess MainThread multithreading join ERROR Caught exception in thread: '_training_0'
Traceback (most recent call last):
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\cli\launcher.py", line 182, in execute_script
process.process()
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 170, in process
self._end_thread(thread, err)
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 210, in _end_thread
thread.join()
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 121, in join
raise thread.err[1].with_traceback(thread.err[2])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 37, in run
self._target(*self._args, **self._kwargs)
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 232, in _training
raise err
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 222, in _training
self._run_training_cycle(model, trainer)
File "C:\Users\Joshua_Lin940508\Videos\GE\scripts\train.py", line 302, in _run_training_cycle
trainer.train_one_step(viewer, timelapse)
File "C:\Users\Joshua_Lin940508\Videos\GE\plugins\train\trainer\_base.py", line 236, in train_one_step
model_inputs, model_targets = self._feeder.get_batch()
File "C:\Users\Joshua_Lin940508\Videos\GE\plugins\train\trainer\_base.py", line 450, in get_batch
batch = next(self._feeds[side])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 156, in iterator
self.check_and_raise_error()
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 84, in check_and_raise_error
raise error[1].with_traceback(error[2])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 37, in run
self._target(*self._args, **self._kwargs)
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\multithreading.py", line 145, in _run
for item in self.generator(*self._gen_args, **self._gen_kwargs):
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\training_data.py", line 206, in _minibatch
yield self._process_batch(img_paths, side)
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\training_data.py", line 215, in _process_batch
batch, landmarks = self._crop_to_center(filenames, batch, side)
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\training_data.py", line 319, in _crop_to_center
cropped = np.array([align.extract_face(img) for align, img in zip(aligned, batch)])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\training_data.py", line 319, in <listcomp>
cropped = np.array([align.extract_face(img) for align, img in zip(aligned, batch)])
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\align\aligned_face.py", line 341, in extract_face
image = self._convert_centering(image)
File "C:\Users\Joshua_Lin940508\Videos\GE\lib\align\aligned_face.py", line 380, in _convert_centering
out[slices["out"][0], slices["out"][1], :] = image[slices["in"][0], slices["in"][1], :]
ValueError: could not broadcast input array from shape (5,0,3) into shape (5,137,3)
============ System Information ============
encoding: cp65001
git_branch: master
git_commits: 15bbc95 Update Dockerfile (#1112). 163b8fe sysinfo/setup - Standardize cuda/cudnn checks. f9a5b72 Bugfix - setup.py. Explicitly install cudatoolkit in Conda. b1420a6 Merge pull request #1096 from deepfakes/dev-tf2.4. 29667b4 Expand support for tf2.2-2.4
gpu_cuda: No global version found. Check Conda packages for Conda Cuda
gpu_cudnn: No global version found. Check Conda packages for Conda cuDNN
gpu_devices: GPU_0: GeForce GTX 1650 SUPER
gpu_devices_active: GPU_0
gpu_driver: 456.71
gpu_vram: GPU_0: 4096MB
os_machine: AMD64
os_platform: Windows-10-10.0.19041-SP0
os_release: 10
py_command: C:\Users\Joshua_Lin940508\Videos\GE\faceswap.py train -A C:/Users/Joshua_Lin940508/Videos/GE/Faces2 -B C:/Users/Joshua_Lin940508/Videos/GE/facesg -m C:/Users/Joshua_Lin940508/Videos/GE/switch -t original -bs 1 -it 1000000 -s 1000 -ss 25000 -ps 100 -L INFO -gui
py_conda_version: conda 4.9.2
py_implementation: CPython
py_version: 3.8.5
py_virtual_env: True
sys_cores: 8
sys_processor: AMD64 Family 23 Model 113 Stepping 0, AuthenticAMD
sys_ram: Total: 16315MB, Available: 8844MB, Used: 7471MB, Free: 8844MB
=============== Pip Packages ===============
absl-py @ file:///tmp/build/80754af9/absl-py_1607439979954/work
aiohttp @ file:///C:/ci/aiohttp_1607109697839/work
astunparse==1.6.3
async-timeout==3.0.1
attrs @ file:///tmp/build/80754af9/attrs_1604765588209/work
blinker==1.4
brotlipy==0.7.0
cachetools @ file:///tmp/build/80754af9/cachetools_1607706694405/work
certifi==2020.6.20
cffi @ file:///C:/ci/cffi_1606255208697/work
chardet @ file:///C:/ci/chardet_1605303225733/work
click==7.1.2
cryptography==2.9.2
cycler==0.10.0
fastcluster==1.1.26
ffmpy==0.2.3
flatbuffers==1.12
gast @ file:///tmp/build/80754af9/gast_1597433534803/work
google-auth @ file:///tmp/build/80754af9/google-auth_1607969906642/work
google-auth-oauthlib @ file:///tmp/build/80754af9/google-auth-oauthlib_1603929124518/work
google-pasta==0.2.0
grpcio==1.32.0
h5py==2.10.0
idna @ file:///tmp/build/80754af9/idna_1593446292537/work
imageio @ file:///tmp/build/80754af9/imageio_1594161405741/work
imageio-ffmpeg @ file:///home/conda/feedstock_root/build_artifacts/imageio-ffmpeg_1609799311556/work
importlib-metadata @ file:///tmp/build/80754af9/importlib-metadata_1602276842396/work
joblib @ file:///tmp/build/80754af9/joblib_1607970656719/work
Keras-Applications @ file:///tmp/build/80754af9/keras-applications_1594366238411/work
Keras-Preprocessing==1.1.2
kiwisolver @ file:///C:/ci/kiwisolver_1604014703538/work
Markdown @ file:///C:/ci/markdown_1605111189761/work
matplotlib @ file:///C:/ci/matplotlib-base_1592837548929/work
mkl-fft==1.2.0
mkl-random==1.1.1
mkl-service==2.3.0
multidict @ file:///C:/ci/multidict_1600456481656/work
numpy @ file:///C:/ci/numpy_and_numpy_base_1603466732592/work
nvidia-ml-py3 @ git+https://github.com/deepfakes/nvidia-ml-py3.git@6fc29ac84b32bad877f078cb4a777c1548a00bf6
oauthlib==3.1.0
olefile==0.46
opencv-python==4.5.1.48
opt-einsum==3.3.0
pathlib==1.0.1
Pillow @ file:///C:/ci/pillow_1609786840597/work
protobuf==3.13.0
psutil @ file:///C:/ci/psutil_1598370330503/work
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser @ file:///tmp/build/80754af9/pycparser_1594388511720/work
PyJWT @ file:///C:/ci/pyjwt_1608658192037/work
pynvml==8.0.4
pyOpenSSL @ file:///tmp/build/80754af9/pyopenssl_1608057966937/work
pyparsing==2.4.7
pyreadline==2.1
PySocks @ file:///C:/ci/pysocks_1605287845585/work
python-dateutil==2.8.1
pywin32==227
requests @ file:///tmp/build/80754af9/requests_1608241421344/work
requests-oauthlib==1.3.0
rsa @ file:///tmp/build/80754af9/rsa_1610483308194/work
scikit-learn @ file:///C:/ci/scikit-learn_1598377018496/work
scipy @ file:///C:/ci/scipy_1604596260408/work
sip==4.19.13
six @ file:///C:/ci/six_1605187374963/work
tensorboard==2.4.1
tensorboard-plugin-wit==1.6.0
tensorflow==2.4.0
tensorflow-estimator==2.4.0
termcolor==1.1.0
threadpoolctl @ file:///tmp/tmp9twdgx9k/threadpoolctl-2.1.0-py3-none-any.whl
tornado @ file:///C:/ci/tornado_1606942392901/work
tqdm @ file:///tmp/build/80754af9/tqdm_1609788246169/work
typing-extensions @ file:///tmp/build/80754af9/typing_extensions_1598376058250/work
urllib3 @ file:///tmp/build/80754af9/urllib3_1606938623459/work
Werkzeug==1.0.1
win-inet-pton @ file:///C:/ci/win_inet_pton_1605306167264/work
wincertstore==0.2
wrapt==1.12.1
yarl @ file:///C:/ci/yarl_1598045274898/work
zipp @ file:///tmp/build/80754af9/zipp_1604001098328/work
============== Conda Packages ==============
# packages in environment at C:\Users\Joshua_Lin940508\anaconda3\envs\GEM:
#
# Name Version Build Channel
_tflow_select 2.3.0 gpu
absl-py 0.11.0 pyhd3eb1b0_1
aiohttp 3.7.3 py38h2bbff1b_1
astunparse 1.6.3 py_0
async-timeout 3.0.1 py38_0
attrs 20.3.0 pyhd3eb1b0_0
blas 1.0 mkl
blinker 1.4 py38_0
brotlipy 0.7.0 py38h2bbff1b_1003
ca-certificates 2020.10.14 0 anaconda
cachetools 4.2.0 pyhd3eb1b0_0
certifi 2020.6.20 py38_0 anaconda
cffi 1.14.4 py38hcd4344a_0
chardet 3.0.4 py38haa95532_1003
click 7.1.2 py_0
cryptography 2.9.2 py38h7a1dbc1_0
cudatoolkit 10.1.243 h74a9793_0
cudnn 7.6.5 cuda10.1_0 anaconda
cycler 0.10.0 py38_0
fastcluster 1.1.26 py38h251f6bf_2 conda-forge
ffmpeg 4.3.1 ha925a31_0 conda-forge
ffmpy 0.2.3 pypi_0 pypi
flatbuffers 1.12 pypi_0 pypi
freetype 2.10.4 hd328e21_0
gast 0.3.3 pypi_0 pypi
google-auth 1.24.0 pyhd3eb1b0_0
google-auth-oauthlib 0.4.2 pyhd3eb1b0_2
google-pasta 0.2.0 py_0
grpcio 1.32.0 pypi_0 pypi
h5py 2.10.0 py38h5e291fa_0
hdf5 1.10.4 h7ebc959_0
icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha925a31_3
idna 2.10 py_0
imageio 2.9.0 py_0
imageio-ffmpeg 0.4.3 pyhd8ed1ab_0 conda-forge
importlib-metadata 2.0.0 py_1
intel-openmp 2020.2 254
joblib 1.0.0 pyhd3eb1b0_0
jpeg 9b hb83a4c4_2
keras-applications 1.0.8 py_1
keras-preprocessing 1.1.2 pypi_0 pypi
kiwisolver 1.3.0 py38hd77b12b_0
libpng 1.6.37 h2a8f88b_0
libprotobuf 3.13.0.1 h200bbdf_0
libtiff 4.1.0 h56a325e_1
lz4-c 1.9.2 hf4a77e7_3
markdown 3.3.3 py38haa95532_0
matplotlib 3.2.2 0
matplotlib-base 3.2.2 py38h64f37c6_0
mkl 2020.2 256
mkl-service 2.3.0 py38h196d8e1_0
mkl_fft 1.2.0 py38h45dec08_0
mkl_random 1.1.1 py38h47e9c7a_0
multidict 4.7.6 py38he774522_1
numpy 1.19.2 py38hadc3359_0
numpy-base 1.19.2 py38ha3acd2a_0
nvidia-ml-py3 7.352.1 pypi_0 pypi
oauthlib 3.1.0 py_0
olefile 0.46 py_0
opencv-python 4.5.1.48 pypi_0 pypi
openssl 1.1.1h he774522_0 anaconda
opt-einsum 3.3.0 pypi_0 pypi
opt_einsum 3.1.0 py_0 anaconda
pathlib 1.0.1 py_1
pillow 8.1.0 py38h4fa10fc_0
pip 20.3.3 py38haa95532_0
protobuf 3.13.0.1 py38ha925a31_1
psutil 5.7.2 py38he774522_0
pyasn1 0.4.8 py_0
pyasn1-modules 0.2.8 py_0
pycparser 2.20 py_2
pyjwt 2.0.0 py38haa95532_0
pynvml 8.0.4 pypi_0 pypi
pyopenssl 20.0.1 pyhd3eb1b0_1
pyparsing 2.4.7 py_0
pyqt 5.9.2 py38ha925a31_4
pyreadline 2.1 py38_1
pysocks 1.7.1 py38haa95532_0
python 3.8.5 h5fd99cc_1
python-dateutil 2.8.1 py_0
python_abi 3.8 1_cp38 conda-forge
pywin32 227 py38he774522_1
qt 5.9.7 vc14h73c81de_0
requests 2.25.1 pyhd3eb1b0_0
requests-oauthlib 1.3.0 py_0
rsa 4.7 pyhd3eb1b0_1
scikit-learn 0.23.2 py38h47e9c7a_0
scipy 1.5.2 py38h14eb087_0
setuptools 51.1.2 py38haa95532_4
sip 4.19.13 py38ha925a31_0
six 1.15.0 py38haa95532_0
sqlite 3.33.0 h2a8f88b_0
tensorboard 2.4.1 pypi_0 pypi
tensorboard-plugin-wit 1.6.0 py_0
tensorflow 2.4.0 pypi_0 pypi
tensorflow-base 2.3.0 gpu_py38h7339f5a_0
tensorflow-estimator 2.4.0 pypi_0 pypi
tensorflow-gpu 2.3.0 he13fc11_0
termcolor 1.1.0 py38_1
threadpoolctl 2.1.0 pyh5ca1d4c_0
tk 8.6.10 he774522_0
tornado 6.1 py38h2bbff1b_0
tqdm 4.55.1 pyhd3eb1b0_0
typing-extensions 3.7.4.3 0
typing_extensions 3.7.4.3 py_0
urllib3 1.26.2 pyhd3eb1b0_0
vc 14.2 h21ff451_1
vs2015_runtime 14.27.29016 h5e58377_2
werkzeug 1.0.1 py_0
wheel 0.36.2 pyhd3eb1b0_0
win_inet_pton 1.1.0 py38haa95532_0
wincertstore 0.2 py38_0
wrapt 1.12.1 py38he774522_1
xz 5.2.5 h62dcd97_0
yarl 1.5.1 py38he774522_0
zipp 3.4.0 pyhd3eb1b0_0
zlib 1.2.11 h62dcd97_4
zstd 1.4.5 h04227a9_0
=============== State File =================
{
"name": "original",
"sessions": {
"1": {
"timestamp": 1610849849.2481372,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 260,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"2": {
"timestamp": 1610850907.9756474,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 3494,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"3": {
"timestamp": 1610869519.1516976,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 2688,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"4": {
"timestamp": 1610905083.3388257,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"5": {
"timestamp": 1610906638.8802373,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 2827,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"6": {
"timestamp": 1610953259.2869298,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 500,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"7": {
"timestamp": 1610956073.349984,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1500,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"8": {
"timestamp": 1611008311.8579595,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 3414,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"9": {
"timestamp": 1611010666.9361603,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"10": {
"timestamp": 1611011044.6943486,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"11": {
"timestamp": 1611011139.1939986,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"12": {
"timestamp": 1611011187.4571025,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"13": {
"timestamp": 1611011263.5128891,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 12,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"14": {
"timestamp": 1611011389.4677298,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 8,
"iterations": 188,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"15": {
"timestamp": 1611011493.6893003,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 8,
"iterations": 211,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"16": {
"timestamp": 1611012441.6006858,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 8,
"iterations": 250,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"17": {
"timestamp": 1611012576.4945493,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 4,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"18": {
"timestamp": 1611012709.245524,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 1,
"iterations": 1564,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"19": {
"timestamp": 1611013116.3942432,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 308,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"20": {
"timestamp": 1611013614.4827292,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"21": {
"timestamp": 1611013675.8896644,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 35,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"22": {
"timestamp": 1611013806.672315,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"23": {
"timestamp": 1611013843.1152723,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"24": {
"timestamp": 1611016014.155714,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 1000,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"25": {
"timestamp": 1611017105.1809356,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 500,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"26": {
"timestamp": 1611017813.0716429,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 1000,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"27": {
"timestamp": 1611018753.7901354,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 1000,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"28": {
"timestamp": 1611019849.3907197,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 1000,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"29": {
"timestamp": 1611020397.6719413,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 1250,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"30": {
"timestamp": 1611020849.106451,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 2,
"iterations": 750,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"31": {
"timestamp": 1611024258.0929525,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 15,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"32": {
"timestamp": 1611024293.6042101,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 15,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"33": {
"timestamp": 1611024353.0100744,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 1,
"iterations": 267,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"34": {
"timestamp": 1611024453.8737142,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 1,
"iterations": 1000,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"35": {
"timestamp": 1611025347.1421616,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 1,
"iterations": 1000,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"36": {
"timestamp": 1611025892.908899,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 1,
"iterations": 2000,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
}
},
"lowest_avg_loss": {
"a": 0.02039390243589878,
"b": 0.036241110414266586
},
"iterations": 28018,
"config": {
"centering": "face",
"coverage": 68.75,
"optimizer": "adam",
"learning_rate": 5e-05,
"allow_growth": false,
"mixed_precision": false,
"convert_batchsize": 16,
"loss_function": "ssim",
"mask_loss_function": "mse",
"l2_reg_term": 100,
"eye_multiplier": 3,
"mouth_multiplier": 2,
"penalized_mask_loss": true,
"mask_type": "extended",
"mask_blur_kernel": 3,
"mask_threshold": 4,
"learn_mask": false,
"lowmem": false
}
}
================= Configs ==================
--------- .faceswap ---------
backend: nvidia
--------- convert.ini ---------
[color.color_transfer]
clip: True
preserve_paper: True
[color.manual_balance]
colorspace: HSV
balance_1: 0.0
balance_2: 0.0
balance_3: 0.0
contrast: 0.0
brightness: 0.0
[color.match_hist]
threshold: 99.0
[mask.box_blend]
type: gaussian
distance: 11.0
radius: 5.0
passes: 1
[mask.mask_blend]
type: normalized
kernel_size: 3
passes: 4
threshold: 4
erosion: 0.0
[scaling.sharpen]
method: none
amount: 150
radius: 0.3
threshold: 5.0
[writer.ffmpeg]
container: mp4
codec: libx264
crf: 23
preset: medium
tune: none
profile: auto
level: auto
skip_mux: False
[writer.gif]
fps: 25
loop: 0
palettesize: 256
subrectangles: False
[writer.opencv]
format: png
draw_transparent: False
jpg_quality: 75
png_compress_level: 3
[writer.pillow]
format: png
draw_transparent: False
optimize: False
gif_interlace: True
jpg_quality: 75
png_compress_level: 3
tif_compression: tiff_deflate
--------- extract.ini ---------
[global]
allow_growth: False
[align.fan]
batch-size: 12
[detect.cv2_dnn]
confidence: 50
[detect.mtcnn]
minsize: 20
threshold_1: 0.6
threshold_2: 0.7
threshold_3: 0.7
scalefactor: 0.709
batch-size: 8
[detect.s3fd]
confidence: 70
batch-size: 4
[mask.unet_dfl]
batch-size: 8
[mask.vgg_clear]
batch-size: 6
[mask.vgg_obstructed]
batch-size: 2
--------- gui.ini ---------
[global]
fullscreen: False
tab: extract
options_panel_width: 30
console_panel_height: 20
icon_size: 14
font: default
font_size: 9
autosave_last_session: prompt
timeout: 120
auto_load_model_stats: True
--------- train.ini ---------
[global]
centering: face
coverage: 68.75
icnr_init: False
conv_aware_init: False
optimizer: adam
learning_rate: 5e-05
reflect_padding: False
allow_growth: False
mixed_precision: False
convert_batchsize: 16
[global.loss]
loss_function: ssim
mask_loss_function: mse
l2_reg_term: 100
eye_multiplier: 3
mouth_multiplier: 2
penalized_mask_loss: True
mask_type: extended
mask_blur_kernel: 3
mask_threshold: 4
learn_mask: False
[model.dfaker]
output_size: 128
[model.dfl_h128]
lowmem: False
[model.dfl_sae]
input_size: 128
clipnorm: True
architecture: df
autoencoder_dims: 0
encoder_dims: 42
decoder_dims: 21
multiscale_decoder: False
[model.dlight]
features: best
details: good
output_size: 256
[model.original]
lowmem: False
[model.realface]
input_size: 64
output_size: 128
dense_nodes: 1536
complexity_encoder: 128
complexity_decoder: 512
[model.unbalanced]
input_size: 128
lowmem: False
clipnorm: True
nodes: 1024
complexity_encoder: 128
complexity_decoder_a: 384
complexity_decoder_b: 512
[model.villain]
lowmem: False
[trainer.original]
preview_images: 14
zoom_amount: 5
rotation_range: 10
shift_range: 5
flip_chance: 50
disable_warp: False
color_lightness: 30
color_ab: 8
color_clahe_chance: 50
color_clahe_max_size: 4
Hi, actually I didn't solve my issue. I will try again once there will be a fix for it, but such fixes can take time to develop, so I come back to read this post once in a while to see there is an update on this issue.
Finally, I start a new one, which I lower the number of the pictures from around 20000 to 9000, and the error won’t come out.
Everything works fine and good.
Thanks for finding the solution
Just FYI, I have not solved this yet. It is an edge case which happens very rarely on some images, so you just do not have an image which triggers this in your current data set.
I still plan to fix this issue so it never occurs.
My word is final
Thanks for the update! I just saw you message so I'm going to test this either tomorrow or the day after tomorrow and I will sure let you know if the issue stopped happening. Thanks again!
Hi, I tried again and I still get the issue. That said, I kept the same alignments files that I already had. Should I re-run the extraction of the images in order to regenerate a new alignments files? Or it's not the issue? The error is :
ValueError: could not broadcast input array from shape (0,384,3) into shape (9,384,3)
And here is most of the log file, it exceeded the 60000 maximum allowed characters so I had to trim a little bit :
Code: Select all
02/04/2021 23:00:45 MainProcess _training_0 _base save DEBUG Saving State
02/04/2021 23:00:45 MainProcess _training_0 serializer save DEBUG filename: D:\Faceswap\New Model\villain_state.json, data type: <class 'dict'>
02/04/2021 23:00:45 MainProcess _training_0 serializer _check_extension DEBUG Original filename: 'D:\Faceswap\New Model\villain_state.json', final filename: 'D:\Faceswap\New Model\villain_state.json'
02/04/2021 23:00:45 MainProcess _training_0 serializer marshal DEBUG data type: <class 'dict'>
02/04/2021 23:00:45 MainProcess _training_0 serializer marshal DEBUG returned data type: <class 'bytes'>
02/04/2021 23:00:45 MainProcess _training_0 _base save DEBUG Saved State
02/04/2021 23:00:45 MainProcess _training_0 _base _save INFO [Saved models] - Average loss since last save: face_a: 0.78659, face_b: 0.64502
02/04/2021 23:00:56 MainProcess _run_0 multithreading run DEBUG Error in thread (_run_0): could not broadcast input array from shape (0,384,3) into shape (9,384,3)
02/04/2021 23:00:56 MainProcess _training_0 multithreading check_and_raise_error DEBUG Thread error caught: [(<class 'ValueError'>, ValueError('could not broadcast input array from shape (0,384,3) into shape (9,384,3)'), <traceback object at 0x000001E46E611380>)]
02/04/2021 23:00:56 MainProcess _training_0 multithreading run DEBUG Error in thread (_training_0): could not broadcast input array from shape (0,384,3) into shape (9,384,3)
02/04/2021 23:00:56 MainProcess _run_1 multithreading run DEBUG Error in thread (_run_1): could not broadcast input array from shape (0,384,3) into shape (9,384,3)
02/04/2021 23:00:57 MainProcess MainThread train _monitor DEBUG Thread error detected
02/04/2021 23:00:57 MainProcess MainThread train _monitor DEBUG Closed Monitor
02/04/2021 23:00:57 MainProcess MainThread train _end_thread DEBUG Ending Training thread
02/04/2021 23:00:57 MainProcess MainThread train _end_thread CRITICAL Error caught! Exiting...
02/04/2021 23:00:57 MainProcess MainThread multithreading join DEBUG Joining Threads: '_training'
02/04/2021 23:00:57 MainProcess MainThread multithreading join DEBUG Joining Thread: '_training_0'
02/04/2021 23:00:57 MainProcess MainThread multithreading join ERROR Caught exception in thread: '_training_0'
Traceback (most recent call last):
File "C:\Program Files (x86)\faceswap\lib\cli\launcher.py", line 182, in execute_script
process.process()
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 170, in process
self._end_thread(thread, err)
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 210, in _end_thread
thread.join()
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 121, in join
raise thread.err[1].with_traceback(thread.err[2])
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 37, in run
self._target(*self._args, **self._kwargs)
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 232, in _training
raise err
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 222, in _training
self._run_training_cycle(model, trainer)
File "C:\Program Files (x86)\faceswap\scripts\train.py", line 302, in _run_training_cycle
trainer.train_one_step(viewer, timelapse)
File "C:\Program Files (x86)\faceswap\plugins\train\trainer\_base.py", line 236, in train_one_step
model_inputs, model_targets = self._feeder.get_batch()
File "C:\Program Files (x86)\faceswap\plugins\train\trainer\_base.py", line 450, in get_batch
batch = next(self._feeds[side])
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 156, in iterator
self.check_and_raise_error()
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 84, in check_and_raise_error
raise error[1].with_traceback(error[2])
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 37, in run
self._target(*self._args, **self._kwargs)
File "C:\Program Files (x86)\faceswap\lib\multithreading.py", line 145, in _run
for item in self.generator(*self._gen_args, **self._gen_kwargs):
File "C:\Program Files (x86)\faceswap\lib\training_data.py", line 206, in _minibatch
yield self._process_batch(img_paths, side)
File "C:\Program Files (x86)\faceswap\lib\training_data.py", line 215, in _process_batch
batch, landmarks = self._crop_to_center(filenames, batch, side)
File "C:\Program Files (x86)\faceswap\lib\training_data.py", line 319, in _crop_to_center
cropped = np.array([align.extract_face(img) for align, img in zip(aligned, batch)])
File "C:\Program Files (x86)\faceswap\lib\training_data.py", line 319, in <listcomp>
cropped = np.array([align.extract_face(img) for align, img in zip(aligned, batch)])
File "C:\Program Files (x86)\faceswap\lib\align\aligned_face.py", line 341, in extract_face
image = self._convert_centering(image)
File "C:\Program Files (x86)\faceswap\lib\align\aligned_face.py", line 380, in _convert_centering
out[slices["out"][0], slices["out"][1], :] = image[slices["in"][0], slices["in"][1], :]
ValueError: could not broadcast input array from shape (0,384,3) into shape (9,384,3)
============ System Information ============
encoding: cp1252
git_branch: Not Found
git_commits: Not Found
gpu_cuda: No global version found. Check Conda packages for Conda Cuda
gpu_cudnn: No global version found. Check Conda packages for Conda cuDNN
gpu_devices: GPU_0: GeForce RTX 2080 Ti
gpu_devices_active: GPU_0
gpu_driver: 457.30
gpu_vram: GPU_0: 11264MB
os_machine: AMD64
os_platform: Windows-10-10.0.18362-SP0
os_release: 10
py_command: C:\Program Files (x86)\faceswap\faceswap.py train -A D:/Faceswap/Source/Full HD Images -ala D:/Faceswap/Source Alignment/Source_alignments.fsa -B D:/Faceswap/Legault/Video 1 -alb D:/Faceswap/Legault Alignment/1_alignments.fsa -m D:/Faceswap/New Model -t villain -bs 16 -it 5000000 -s 250 -ss 25000 -tia D:/Faceswap/Source/Full HD Images -tib D:/Faceswap/Legault/Video 1 -to D:/Faceswap/Timelapse -ps 100 -L INFO -gui
py_conda_version: conda 4.9.2
py_implementation: CPython
py_version: 3.8.5
py_virtual_env: True
sys_cores: 16
sys_processor: Intel64 Family 6 Model 158 Stepping 12, GenuineIntel
sys_ram: Total: 32683MB, Available: 17927MB, Used: 14755MB, Free: 17927MB
=============== Pip Packages ===============
absl-py @ file:///tmp/build/80754af9/absl-py_1607439979954/work
aiohttp @ file:///C:/ci/aiohttp_1607109697839/work
astunparse==1.6.3
async-timeout==3.0.1
attrs @ file:///tmp/build/80754af9/attrs_1604765588209/work
blinker==1.4
brotlipy==0.7.0
cachetools @ file:///tmp/build/80754af9/cachetools_1607706694405/work
certifi==2020.12.5
cffi @ file:///C:/ci/cffi_1606255208697/work
chardet @ file:///C:/ci/chardet_1605303225733/work
click==7.1.2
cryptography==2.9.2
cycler==0.10.0
fastcluster==1.1.26
ffmpy==0.2.3
gast @ file:///tmp/build/80754af9/gast_1597433534803/work
google-auth @ file:///tmp/build/80754af9/google-auth_1607969906642/work
google-auth-oauthlib @ file:///tmp/build/80754af9/google-auth-oauthlib_1603929124518/work
google-pasta==0.2.0
grpcio @ file:///C:/ci/grpcio_1597406462198/work
h5py==2.10.0
idna @ file:///tmp/build/80754af9/idna_1593446292537/work
imageio @ file:///tmp/build/80754af9/imageio_1594161405741/work
imageio-ffmpeg @ file:///home/conda/feedstock_root/build_artifacts/imageio-ffmpeg_1589202782679/work
importlib-metadata @ file:///tmp/build/80754af9/importlib-metadata_1602276842396/work
joblib @ file:///tmp/build/80754af9/joblib_1607970656719/work
Keras-Applications @ file:///tmp/build/80754af9/keras-applications_1594366238411/work
Keras-Preprocessing==1.1.0
kiwisolver @ file:///C:/ci/kiwisolver_1604014703538/work
Markdown @ file:///C:/ci/markdown_1605111189761/work
matplotlib @ file:///C:/ci/matplotlib-base_1592837548929/work
mkl-fft==1.2.0
mkl-random==1.1.1
mkl-service==2.3.0
multidict @ file:///C:/ci/multidict_1600456481656/work
numpy @ file:///C:/ci/numpy_and_numpy_base_1603466732592/work
nvidia-ml-py3 @ git+https://github.com/deepfakes/nvidia-ml-py3.git@6fc29ac84b32bad877f078cb4a777c1548a00bf6
oauthlib==3.1.0
olefile==0.46
opencv-python==4.5.1.48
opt-einsum==3.1.0
pathlib==1.0.1
Pillow @ file:///C:/ci/pillow_1603823068645/work
protobuf==3.13.0
psutil @ file:///C:/ci/psutil_1598370330503/work
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser @ file:///tmp/build/80754af9/pycparser_1594388511720/work
PyJWT @ file:///C:/ci/pyjwt_1608658192037/work
pyOpenSSL @ file:///tmp/build/80754af9/pyopenssl_1608057966937/work
pyparsing==2.4.7
pyreadline==2.1
PySocks @ file:///C:/ci/pysocks_1605287845585/work
python-dateutil==2.8.1
pywin32==227
requests @ file:///tmp/build/80754af9/requests_1608241421344/work
requests-oauthlib==1.3.0
rsa @ file:///tmp/build/80754af9/rsa_1596998415516/work
scikit-learn @ file:///C:/ci/scikit-learn_1598377018496/work
scipy @ file:///C:/ci/scipy_1604596260408/work
sip==4.19.13
six @ file:///C:/ci/six_1605187374963/work
tensorboard @ file:///home/builder/ktietz/conda/conda-bld/tensorboard_1604313476433/work/tmp_pip_dir
tensorboard-plugin-wit==1.6.0
tensorflow==2.3.0
tensorflow-estimator @ file:///tmp/build/80754af9/tensorflow-estimator_1599136169057/work/whl_temp/tensorflow_estimator-2.3.0-py2.py3-none-any.whl
termcolor==1.1.0
threadpoolctl @ file:///tmp/tmp9twdgx9k/threadpoolctl-2.1.0-py3-none-any.whl
tornado @ file:///C:/ci/tornado_1606942392901/work
tqdm @ file:///tmp/build/80754af9/tqdm_1608922753628/work
typing-extensions @ file:///tmp/build/80754af9/typing_extensions_1598376058250/work
urllib3 @ file:///tmp/build/80754af9/urllib3_1606938623459/work
Werkzeug==1.0.1
win-inet-pton @ file:///C:/ci/win_inet_pton_1605306167264/work
wincertstore==0.2
wrapt==1.12.1
yarl @ file:///C:/ci/yarl_1598045274898/work
zipp @ file:///tmp/build/80754af9/zipp_1604001098328/work
============== Conda Packages ==============
# packages in environment at C:\Users\antoi\MiniConda3\envs\Faceswap:
#
# Name Version Build Channel
_tflow_select 2.3.0 gpu
absl-py 0.11.0 pyhd3eb1b0_1
aiohttp 3.7.3 py38h2bbff1b_1
astunparse 1.6.3 py_0
async-timeout 3.0.1 py38_0
attrs 20.3.0 pyhd3eb1b0_0
blas 1.0 mkl
blinker 1.4 py38_0
brotlipy 0.7.0 py38h2bbff1b_1003
ca-certificates 2020.12.8 haa95532_0
cachetools 4.2.0 pyhd3eb1b0_0
certifi 2020.12.5 py38haa95532_0
cffi 1.14.4 py38hcd4344a_0
chardet 3.0.4 py38haa95532_1003
click 7.1.2 py_0
cryptography 2.9.2 py38h7a1dbc1_0
cudatoolkit 10.1.243 h74a9793_0
cudnn 7.6.5 cuda10.1_0
cycler 0.10.0 py38_0
fastcluster 1.1.26 py38h251f6bf_2 conda-forge
ffmpeg 4.3.1 ha925a31_0 conda-forge
ffmpy 0.2.3 pypi_0 pypi
freetype 2.10.4 hd328e21_0
gast 0.4.0 py_0
git 2.23.0 h6bb4b03_0
google-auth 1.24.0 pyhd3eb1b0_0
google-auth-oauthlib 0.4.2 pyhd3eb1b0_2
google-pasta 0.2.0 py_0
grpcio 1.31.0 py38he7da953_0
h5py 2.10.0 py38h5e291fa_0
hdf5 1.10.4 h7ebc959_0
icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha925a31_3
idna 2.10 py_0
imageio 2.9.0 py_0
imageio-ffmpeg 0.4.2 py_0 conda-forge
importlib-metadata 2.0.0 py_1
intel-openmp 2020.2 254
joblib 1.0.0 pyhd3eb1b0_0
jpeg 9b hb83a4c4_2
keras-applications 1.0.8 py_1
keras-preprocessing 1.1.0 py_1
kiwisolver 1.3.0 py38hd77b12b_0
libpng 1.6.37 h2a8f88b_0
libprotobuf 3.13.0.1 h200bbdf_0
libtiff 4.1.0 h56a325e_1
lz4-c 1.9.2 hf4a77e7_3
markdown 3.3.3 py38haa95532_0
matplotlib 3.2.2 0
matplotlib-base 3.2.2 py38h64f37c6_0
mkl 2020.2 256
mkl-service 2.3.0 py38h196d8e1_0
mkl_fft 1.2.0 py38h45dec08_0
mkl_random 1.1.1 py38h47e9c7a_0
multidict 4.7.6 py38he774522_1
numpy 1.19.2 py38hadc3359_0
numpy-base 1.19.2 py38ha3acd2a_0
nvidia-ml-py3 7.352.1 pypi_0 pypi
oauthlib 3.1.0 py_0
olefile 0.46 py_0
opencv-python 4.5.1.48 pypi_0 pypi
openssl 1.1.1i h2bbff1b_0
opt_einsum 3.1.0 py_0
pathlib 1.0.1 py_1
pillow 8.0.1 py38h4fa10fc_0
pip 20.3.3 py38haa95532_0
protobuf 3.13.0.1 py38ha925a31_1
psutil 5.7.2 py38he774522_0
pyasn1 0.4.8 py_0
pyasn1-modules 0.2.8 py_0
pycparser 2.20 py_2
pyjwt 2.0.0 py38haa95532_0
pyopenssl 20.0.1 pyhd3eb1b0_1
pyparsing 2.4.7 py_0
pyqt 5.9.2 py38ha925a31_4
pyreadline 2.1 py38_1
pysocks 1.7.1 py38haa95532_0
python 3.8.5 h5fd99cc_1
python-dateutil 2.8.1 py_0
python_abi 3.8 1_cp38 conda-forge
pywin32 227 py38he774522_1
qt 5.9.7 vc14h73c81de_0
requests 2.25.1 pyhd3eb1b0_0
requests-oauthlib 1.3.0 py_0
rsa 4.6 py_0
scikit-learn 0.23.2 py38h47e9c7a_0
scipy 1.5.2 py38h14eb087_0
setuptools 51.0.0 py38haa95532_2
sip 4.19.13 py38ha925a31_0
six 1.15.0 py38haa95532_0
sqlite 3.33.0 h2a8f88b_0
tensorboard 2.3.0 pyh4dce500_0
tensorboard-plugin-wit 1.6.0 py_0
tensorflow 2.3.0 mkl_py38h1fcfbd6_0
tensorflow-base 2.3.0 gpu_py38h7339f5a_0
tensorflow-estimator 2.3.0 pyheb71bc4_0
tensorflow-gpu 2.3.0 he13fc11_0
termcolor 1.1.0 py38_1
threadpoolctl 2.1.0 pyh5ca1d4c_0
tk 8.6.10 he774522_0
tornado 6.1 py38h2bbff1b_0
tqdm 4.55.0 pyhd3eb1b0_0
typing-extensions 3.7.4.3 0
typing_extensions 3.7.4.3 py_0
urllib3 1.26.2 pyhd3eb1b0_0
vc 14.2 h21ff451_1
vs2015_runtime 14.27.29016 h5e58377_2
werkzeug 1.0.1 py_0
wheel 0.36.2 pyhd3eb1b0_0
win_inet_pton 1.1.0 py38haa95532_0
wincertstore 0.2 py38_0
wrapt 1.12.1 py38he774522_1
xz 5.2.5 h62dcd97_0
yarl 1.5.1 py38he774522_0
zipp 3.4.0 pyhd3eb1b0_0
zlib 1.2.11 h62dcd97_4
zstd 1.4.5 h04227a9_0
=============== State File =================
{
"name": "villain",
"sessions": {
"1": {
"timestamp": 1610069504.3544455,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"2": {
"timestamp": 1610069832.2736046,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"3": {
"timestamp": 1610072398.4454982,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"4": {
"timestamp": 1610080597.7570343,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 250,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"5": {
"timestamp": 1610082056.5735295,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 240,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"6": {
"timestamp": 1612497443.6003044,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 109,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
},
"7": {
"timestamp": 1612497582.2549694,
"no_logs": false,
"loss_names": [
"total",
"face_a",
"face_b"
],
"batchsize": 16,
"iterations": 1,
"config": {
"learning_rate": 5e-05,
"allow_growth": false,
"convert_batchsize": 16,
"eye_multiplier": 3,
"mouth_multiplier": 2
}
}
},
"lowest_avg_loss": {
"a": 0.8744818409283955,
"b": 0.587505845228831
},
"iterations": 603,
"config": {
"centering": "face",
"coverage": 68.75,
"optimizer": "adam",
"learning_rate": 5e-05,
"allow_growth": false,
"mixed_precision": true,
"convert_batchsize": 16,
"loss_function": "ssim",
"mask_loss_function": "mse",
"l2_reg_term": 100,
"eye_multiplier": 3,
"mouth_multiplier": 2,
"penalized_mask_loss": false,
"mask_type": "extended",
"mask_blur_kernel": 3,
"mask_threshold": 4,
"learn_mask": false,
"lowmem": false
}
}
================= Configs ==================
--------- .faceswap ---------
backend: nvidia
--------- convert.ini ---------
[color.color_transfer]
clip: True
preserve_paper: True
[color.manual_balance]
colorspace: HSV
balance_1: 0.0
balance_2: 0.0
balance_3: 0.0
contrast: 0.0
brightness: 0.0
[color.match_hist]
threshold: 99.0
[mask.box_blend]
type: gaussian
distance: 11.0
radius: 5.0
passes: 1
[mask.mask_blend]
type: normalized
kernel_size: 3
passes: 4
threshold: 4
erosion: 0.0
[scaling.sharpen]
method: none
amount: 150
radius: 0.3
threshold: 5.0
[writer.ffmpeg]
container: mp4
codec: libx264
crf: 23
preset: medium
tune: none
profile: auto
level: auto
skip_mux: False
[writer.gif]
fps: 25
loop: 0
palettesize: 256
subrectangles: False
[writer.opencv]
format: png
draw_transparent: False
jpg_quality: 75
png_compress_level: 3
[writer.pillow]
format: png
draw_transparent: False
optimize: False
gif_interlace: True
jpg_quality: 75
png_compress_level: 3
tif_compression: tiff_deflate
--------- extract.ini ---------
[global]
allow_growth: False
[align.fan]
batch-size: 12
[detect.cv2_dnn]
confidence: 50
[detect.mtcnn]
minsize: 20
threshold_1: 0.6
threshold_2: 0.7
threshold_3: 0.7
scalefactor: 0.709
batch-size: 8
[detect.s3fd]
confidence: 70
batch-size: 4
[mask.unet_dfl]
batch-size: 8
[mask.vgg_clear]
batch-size: 6
[mask.vgg_obstructed]
batch-size: 2
--------- gui.ini ---------
[global]
fullscreen: False
tab: extract
options_panel_width: 30
console_panel_height: 20
icon_size: 14
font: default
font_size: 9
autosave_last_session: prompt
timeout: 120
auto_load_model_stats: True
--------- train.ini ---------
[global]
centering: face
coverage: 68.75
icnr_init: False
conv_aware_init: False
optimizer: adam
learning_rate: 5e-05
reflect_padding: False
allow_growth: False
mixed_precision: True
convert_batchsize: 16
[global.loss]
loss_function: ssim
mask_loss_function: mse
l2_reg_term: 100
eye_multiplier: 3
mouth_multiplier: 2
penalized_mask_loss: False
mask_type: extended
mask_blur_kernel: 3
mask_threshold: 4
learn_mask: False
[model.dfaker]
output_size: 128
[model.dfl_h128]
lowmem: False
[model.dfl_sae]
input_size: 128
clipnorm: True
architecture: df
autoencoder_dims: 0
encoder_dims: 42
decoder_dims: 21
multiscale_decoder: False
[model.dlight]
features: best
details: good
output_size: 256
[model.original]
lowmem: False
[model.realface]
input_size: 64
output_size: 128
dense_nodes: 1536
complexity_encoder: 128
complexity_decoder: 512
[model.unbalanced]
input_size: 128
lowmem: False
clipnorm: True
nodes: 1024
complexity_encoder: 128
complexity_decoder_a: 384
complexity_decoder_b: 512
[model.villain]
lowmem: False
[trainer.original]
preview_images: 14
zoom_amount: 5
rotation_range: 10
shift_range: 5
flip_chance: 50
disable_warp: False
color_lightness: 30
color_ab: 8
color_clahe_chance: 50
color_clahe_max_size: 4No, you don't need a new alignments file.
Unfortunately, for whatever reason, you logs are not telling me what commit/branch you are on, so I cannot confirm that you are updated:
Code: Select all
git_branch: Not Found
git_commits: Not FoundYou are the first person to report that this issue is still occurring (not to say that it isn't for anyone else, just no one else has reported since I pushed a fix). My suspicion would be that your Faceswap has not updated, but could be wrong. I would remove the faceswap folder then re-run the installer just to confirm.
Beyond that, I would need the face set and alignments file to be able to diagnose this any further.
My word is final
Hello All,
I want to report an issue and hoping to get a support.
I tried to sort the images which have been successfully extracted before.
But during the sorting process, I encountered an "ERROR Got Exception on main handler" / "CRITICAL An unexpected crash has occurred", with "ValueError: could not broadcast input array from shape (224,0,3) into shape (224,131,3)".
I've tried to search similar topic before.
But nothing found on the extract subforum.
Below is the crash log file I obtained,
Code: Select all
02/05/2021 20:37:56 MainProcess MainThread serializer unmarshal DEBUG returned data type: <class 'dict'>
02/05/2021 20:37:56 MainProcess MainThread serializer load DEBUG data type: <class 'dict'>
02/05/2021 20:37:56 MainProcess MainThread alignments _load DEBUG Loaded alignments
02/05/2021 20:37:56 MainProcess MainThread alignments _has_legacy_structure DEBUG legacy structure: False
02/05/2021 20:37:56 MainProcess MainThread alignments _has_legacy_landmarksxy DEBUG checking legacy landmarksXY
02/05/2021 20:37:56 MainProcess MainThread alignments _has_legacy_landmarksxy DEBUG legacy landmarksXY: False
02/05/2021 20:37:56 MainProcess MainThread alignments _has_legacy_landmarks_list DEBUG checking legacy landmarks as list
02/05/2021 20:37:56 MainProcess MainThread alignments __init__ DEBUG Initializing Thumbnails: (alignments: <lib.align.alignments.Alignments object at 0x0000022AFA425FD0>)
02/05/2021 20:37:56 MainProcess MainThread alignments __init__ DEBUG Initialized Thumbnails
02/05/2021 20:37:56 MainProcess MainThread alignments __init__ DEBUG Initialized Alignments
02/05/2021 20:37:56 MainProcess MainThread sort process VERBOSE No output directory provided. Using input dir as output dir.
02/05/2021 20:37:56 MainProcess MainThread vgg_face2_keras __init__ DEBUG Initializing VGGFace2
02/05/2021 20:37:56 MainProcess MainThread _base __init__ DEBUG Initializing VGGFace2: (git_model_id: 10, model_filename: ['vggface2_resnet50_v2.h5'], exclude_gpus: None, configfile: None, instance: 0, )
02/05/2021 20:37:56 MainProcess MainThread config __init__ DEBUG Initializing: Config
02/05/2021 20:37:56 MainProcess MainThread config get_config_file DEBUG Config File location: 'E:\ProgramFiles\faceswap\config\extract.ini'
02/05/2021 20:37:56 MainProcess MainThread _config set_defaults DEBUG Setting defaults
02/05/2021 20:37:56 MainProcess MainThread _config set_globals DEBUG Setting global config
02/05/2021 20:37:56 MainProcess MainThread config add_section DEBUG Add section: (title: 'global', info: 'Options that apply to all extraction plugins')
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'global', title: 'allow_growth', datatype: '<class 'bool'>', default: 'False', info: '[Nvidia Only]. Enable the Tensorflow GPU `allow_growth` configuration option. This option prevents Tensorflow from allocating all of the GPU VRAM at launch but can lead to higher VRAM fragmentation and slower performance. Should only be enabled if you are having problems running extraction.', rounding: 'None', min_max: None, choices: None, gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Adding defaults: (filename: fan_defaults.py, module_path: plugins.extract.align, plugin_type: align
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Importing defaults module: plugins.extract.align.fan_defaults
02/05/2021 20:37:56 MainProcess MainThread config add_section DEBUG Add section: (title: 'align.fan', info: 'FAN Aligner options.\nFast on GPU, slow on CPU. Best aligner.')
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'align.fan', title: 'batch-size', datatype: '<class 'int'>', default: '12', info: 'The batch size to use. To a point, higher batch sizes equal better performance, but setting it too high can harm performance.\n\n Nvidia users: If the batchsize is set higher than the your GPU can accomodate then this will automatically be lowered.\n AMD users: A batchsize of 8 requires about 4 GB vram.', rounding: '1', min_max: (1, 64), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Added defaults: align.fan
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Adding defaults: (filename: cv2_dnn_defaults.py, module_path: plugins.extract.detect, plugin_type: detect
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Importing defaults module: plugins.extract.detect.cv2_dnn_defaults
02/05/2021 20:37:56 MainProcess MainThread config add_section DEBUG Add section: (title: 'detect.cv2_dnn', info: 'CV2 DNN Detector options.\nA CPU only extractor, is the least reliable, but uses least resources and runs fast on CPU. Use this if not using a GPU and time is important')
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'detect.cv2_dnn', title: 'confidence', datatype: '<class 'int'>', default: '50', info: 'The confidence level at which the detector has succesfully found a face.\nHigher levels will be more discriminating, lower levels will have more false positives.', rounding: '5', min_max: (25, 100), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Added defaults: detect.cv2_dnn
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Adding defaults: (filename: mtcnn_defaults.py, module_path: plugins.extract.detect, plugin_type: detect
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Importing defaults module: plugins.extract.detect.mtcnn_defaults
02/05/2021 20:37:56 MainProcess MainThread config add_section DEBUG Add section: (title: 'detect.mtcnn', info: 'MTCNN Detector options.\nFast on GPU, slow on CPU. Uses fewer resources than other GPU detectors but can often return more false positives.')
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'detect.mtcnn', title: 'minsize', datatype: '<class 'int'>', default: '20', info: 'The minimum size of a face (in pixels) to be accepted as a positive match.\nLower values use significantly more VRAM and will detect more false positives.', rounding: '10', min_max: (20, 1000), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'detect.mtcnn', title: 'threshold_1', datatype: '<class 'float'>', default: '0.6', info: 'First stage threshold for face detection. This stage obtains face candidates.', rounding: '2', min_max: (0.1, 0.9), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'detect.mtcnn', title: 'threshold_2', datatype: '<class 'float'>', default: '0.7', info: 'Second stage threshold for face detection. This stage refines face candidates.', rounding: '2', min_max: (0.1, 0.9), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'detect.mtcnn', title: 'threshold_3', datatype: '<class 'float'>', default: '0.7', info: 'Third stage threshold for face detection. This stage further refines face candidates.', rounding: '2', min_max: (0.1, 0.9), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'detect.mtcnn', title: 'scalefactor', datatype: '<class 'float'>', default: '0.709', info: 'The scale factor for the image pyramid.', rounding: '3', min_max: (0.1, 0.9), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'detect.mtcnn', title: 'batch-size', datatype: '<class 'int'>', default: '8', info: 'The batch size to use. To a point, higher batch sizes equal better performance, but setting it too high can harm performance.\n\n Nvidia users: If the batchsize is set higher than the your GPU can accomodate then this will automatically be lowered.', rounding: '1', min_max: (1, 64), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Added defaults: detect.mtcnn
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Adding defaults: (filename: s3fd_defaults.py, module_path: plugins.extract.detect, plugin_type: detect
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Importing defaults module: plugins.extract.detect.s3fd_defaults
02/05/2021 20:37:56 MainProcess MainThread config add_section DEBUG Add section: (title: 'detect.s3fd', info: 'S3FD Detector options.\nFast on GPU, slow on CPU. Can detect more faces and fewer false positives than other GPU detectors, but is a lot more resource intensive.')
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'detect.s3fd', title: 'confidence', datatype: '<class 'int'>', default: '70', info: 'The confidence level at which the detector has succesfully found a face.\nHigher levels will be more discriminating, lower levels will have more false positives.', rounding: '5', min_max: (25, 100), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'detect.s3fd', title: 'batch-size', datatype: '<class 'int'>', default: '4', info: 'The batch size to use. To a point, higher batch sizes equal better performance, but setting it too high can harm performance.\n\n Nvidia users: If the batchsize is set higher than the your GPU can accomodate then this will automatically be lowered.\n AMD users: A batchsize of 8 requires about 2 GB vram.', rounding: '1', min_max: (1, 64), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Added defaults: detect.s3fd
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Adding defaults: (filename: unet_dfl_defaults.py, module_path: plugins.extract.mask, plugin_type: mask
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Importing defaults module: plugins.extract.mask.unet_dfl_defaults
02/05/2021 20:37:56 MainProcess MainThread config add_section DEBUG Add section: (title: 'mask.unet_dfl', info: 'UNET_DFL options. Mask designed to provide smart segmentation of mostly frontal faces.\nThe mask model has been trained by community members. Insert more commentary on testing here. Profile faces may result in sub-par performance.')
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'mask.unet_dfl', title: 'batch-size', datatype: '<class 'int'>', default: '8', info: 'The batch size to use. To a point, higher batch sizes equal better performance, but setting it too high can harm performance.\n\n Nvidia users: If the batchsize is set higher than the your GPU can accomodate then this will automatically be lowered.', rounding: '1', min_max: (1, 64), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Added defaults: mask.unet_dfl
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Adding defaults: (filename: vgg_clear_defaults.py, module_path: plugins.extract.mask, plugin_type: mask
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Importing defaults module: plugins.extract.mask.vgg_clear_defaults
02/05/2021 20:37:56 MainProcess MainThread config add_section DEBUG Add section: (title: 'mask.vgg_clear', info: 'VGG_Clear options. Mask designed to provide smart segmentation of mostly frontal faces clear of obstructions.\nProfile faces and obstructions may result in sub-par performance.')
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'mask.vgg_clear', title: 'batch-size', datatype: '<class 'int'>', default: '6', info: 'The batch size to use. To a point, higher batch sizes equal better performance, but setting it too high can harm performance.\n\n Nvidia users: If the batchsize is set higher than the your GPU can accomodate then this will automatically be lowered.', rounding: '1', min_max: (1, 64), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Added defaults: mask.vgg_clear
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Adding defaults: (filename: vgg_obstructed_defaults.py, module_path: plugins.extract.mask, plugin_type: mask
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Importing defaults module: plugins.extract.mask.vgg_obstructed_defaults
02/05/2021 20:37:56 MainProcess MainThread config add_section DEBUG Add section: (title: 'mask.vgg_obstructed', info: 'VGG_Obstructed options. Mask designed to provide smart segmentation of mostly frontal faces.\nThe mask model has been specifically trained to recognize some facial obstructions (hands and eyeglasses). Profile faces may result in sub-par performance.')
02/05/2021 20:37:56 MainProcess MainThread config add_item DEBUG Add item: (section: 'mask.vgg_obstructed', title: 'batch-size', datatype: '<class 'int'>', default: '2', info: 'The batch size to use. To a point, higher batch sizes equal better performance, but setting it too high can harm performance.\n\n Nvidia users: If the batchsize is set higher than the your GPU can accomodate then this will automatically be lowered.', rounding: '1', min_max: (1, 64), choices: [], gui_radio: False, fixed: True, group: None)
02/05/2021 20:37:56 MainProcess MainThread _config load_module DEBUG Added defaults: mask.vgg_obstructed
02/05/2021 20:37:56 MainProcess MainThread config handle_config DEBUG Handling config
02/05/2021 20:37:56 MainProcess MainThread config check_exists DEBUG Config file exists: 'E:\ProgramFiles\faceswap\config\extract.ini'
02/05/2021 20:37:56 MainProcess MainThread config load_config VERBOSE Loading config: 'E:\ProgramFiles\faceswap\config\extract.ini'
02/05/2021 20:37:56 MainProcess MainThread config validate_config DEBUG Validating config
02/05/2021 20:37:56 MainProcess MainThread config check_config_change DEBUG Default config has not changed
02/05/2021 20:37:56 MainProcess MainThread config check_config_choices DEBUG Checking config choices
02/05/2021 20:37:56 MainProcess MainThread config check_config_choices DEBUG Checked config choices
02/05/2021 20:37:56 MainProcess MainThread config validate_config DEBUG Validated config
02/05/2021 20:37:56 MainProcess MainThread config handle_config DEBUG Handled config
02/05/2021 20:37:56 MainProcess MainThread config __init__ DEBUG Initialized: Config
02/05/2021 20:37:56 MainProcess MainThread config get DEBUG Getting config item: (section: 'global', option: 'allow_growth')
02/05/2021 20:37:56 MainProcess MainThread config get DEBUG Returning item: (type: <class 'bool'>, value: False)
02/05/2021 20:37:56 MainProcess MainThread utils _get DEBUG Model exists: E:\ProgramFiles\faceswap\plugins\extract\recognition\.cache\vggface2_resnet50_v2.h5
02/05/2021 20:37:56 MainProcess MainThread _base __init__ DEBUG Initialized _base VGGFace2
02/05/2021 20:37:56 MainProcess MainThread vgg_face2_keras __init__ DEBUG Initialized VGGFace2
02/05/2021 20:37:56 MainProcess MainThread session load_model VERBOSE Initializing plugin model: VGG_Face2
02/05/2021 20:38:01 MainProcess MainThread sort sort_face INFO Sorting by identity similarity...
02/05/2021 20:38:01 MainProcess MainThread image __init__ DEBUG Initializing FacesLoader: (path: E:\Project\Faceswap\Sephora\Source Video\Source_Video_Output, count: None)
02/05/2021 20:38:01 MainProcess MainThread image __init__ DEBUG Initializing FacesLoader: (path: E:\Project\Faceswap\Sephora\Source Video\Source_Video_Output, queue_size: 8, fast_count: True, skip_list: None, count: None)
02/05/2021 20:38:01 MainProcess MainThread image __init__ DEBUG Initializing FacesLoader: (path: E:\Project\Faceswap\Sephora\Source Video\Source_Video_Output, queue_size: 8, args: None)
02/05/2021 20:38:01 MainProcess MainThread queue_manager get_queue DEBUG QueueManager getting: 'FacesLoader'
02/05/2021 20:38:01 MainProcess MainThread queue_manager add_queue DEBUG QueueManager adding: (name: 'FacesLoader', maxsize: 8)
02/05/2021 20:38:01 MainProcess MainThread queue_manager add_queue DEBUG QueueManager added: (name: 'FacesLoader')
02/05/2021 20:38:01 MainProcess MainThread queue_manager get_queue DEBUG QueueManager got: 'FacesLoader'
02/05/2021 20:38:01 MainProcess MainThread image _check_for_video DEBUG Input 'E:\Project\Faceswap\Sephora\Source Video\Source_Video_Output' is_video: False
02/05/2021 20:38:01 MainProcess MainThread image _get_fps DEBUG 25.0
02/05/2021 20:38:01 MainProcess MainThread utils get_image_paths DEBUG Scanned Folder contains 33522 files
02/05/2021 20:38:01 MainProcess MainThread utils get_image_paths DEBUG Returning 33522 images
02/05/2021 20:38:01 MainProcess MainThread image _get_count_and_filelist DEBUG count: 33522
02/05/2021 20:38:01 MainProcess MainThread image load DEBUG Initializing Load Generator
02/05/2021 20:38:01 MainProcess MainThread image _set_thread DEBUG Setting thread
02/05/2021 20:38:01 MainProcess MainThread multithreading __init__ DEBUG Initializing MultiThread: (target: 'FacesLoader', thread_count: 1)
02/05/2021 20:38:01 MainProcess MainThread multithreading __init__ DEBUG Initialized MultiThread: 'FacesLoader'
02/05/2021 20:38:01 MainProcess MainThread image _set_thread DEBUG Set thread: <lib.multithreading.MultiThread object at 0x0000022A8C040310>
02/05/2021 20:38:01 MainProcess MainThread multithreading start DEBUG Starting thread(s): 'FacesLoader'
02/05/2021 20:38:01 MainProcess MainThread multithreading start DEBUG Starting thread 1 of 1: 'FacesLoader_0'
02/05/2021 20:38:01 MainProcess FacesLoader_0 image _process DEBUG Load iterator: <bound method FacesLoader._from_folder of <lib.image.FacesLoader object at 0x0000022A8C016FD0>>
02/05/2021 20:38:01 MainProcess FacesLoader_0 image _from_folder DEBUG Loading images from folder: 'E:\Project\Faceswap\Sephora\Source Video\Source_Video_Output'
02/05/2021 20:38:01 MainProcess MainThread multithreading start DEBUG Started all threads 'FacesLoader': 1
02/05/2021 20:38:01 MainProcess MainThread alignments hashes_to_alignment DEBUG Generating hashes to alignment
Traceback (most recent call last):
File "E:\ProgramFiles\faceswap\lib\cli\launcher.py", line 182, in execute_script
process.process()
File "E:\ProgramFiles\faceswap\tools\sort\sort.py", line 112, in process
self.sort_process()
File "E:\ProgramFiles\faceswap\tools\sort\sort.py", line 167, in sort_process
img_list = getattr(self, sort_method)()
File "E:\ProgramFiles\faceswap\tools\sort\sort.py", line 209, in sort_face
image = AlignedFace(face["landmarks_xy"],
File "E:\ProgramFiles\faceswap\lib\align\aligned_face.py", line 169, in __init__
self._face = self.extract_face(image)
File "E:\ProgramFiles\faceswap\lib\align\aligned_face.py", line 341, in extract_face
image = self._convert_centering(image)
File "E:\ProgramFiles\faceswap\lib\align\aligned_face.py", line 380, in _convert_centering
out[slices["out"][0], slices["out"][1], :] = image[slices["in"][0], slices["in"][1], :]
ValueError: could not broadcast input array from shape (224,0,3) into shape (224,131,3)
============ System Information ============
encoding: cp1252
git_branch: master
git_commits: daaf6d4 Merge branch 'master' into staging
gpu_cuda: 10.1
gpu_cudnn: No global version found. Check Conda packages for Conda cuDNN
gpu_devices: GPU_0: GeForce GTX 1050 Ti
gpu_devices_active: GPU_0
gpu_driver: 461.40
gpu_vram: GPU_0: 4096MB
os_machine: AMD64
os_platform: Windows-10-10.0.19041-SP0
os_release: 10
py_command: E:\ProgramFiles\faceswap\tools.py sort -i E:/Project/Faceswap/Sephora/Source Video/Source_Video_Output -a E:/Project/Faceswap/Sephora/Source Video/Source Video_edit_alignments.fsa -s face -t -1.0 -fp rename -g hist -b 5 -lf sort_log.json -L INFO -gui
py_conda_version: conda 4.9.2
py_implementation: CPython
py_version: 3.8.5
py_virtual_env: True
sys_cores: 12
sys_processor: Intel64 Family 6 Model 158 Stepping 10, GenuineIntel
sys_ram: Total: 32688MB, Available: 23377MB, Used: 9310MB, Free: 23377MB
=============== Pip Packages ===============
absl-py @ file:///tmp/build/80754af9/absl-py_1607439979954/work
aiohttp @ file:///C:/ci/aiohttp_1607109697839/work
astunparse==1.6.3
async-timeout==3.0.1
attrs @ file:///tmp/build/80754af9/attrs_1604765588209/work
blinker==1.4
brotlipy==0.7.0
cachetools @ file:///tmp/build/80754af9/cachetools_1611600262290/work
certifi==2020.12.5
cffi @ file:///C:/ci/cffi_1606255208697/work
chardet @ file:///C:/ci/chardet_1605303225733/work
click @ file:///home/linux1/recipes/ci/click_1610990599742/work
cryptography==2.9.2
cycler==0.10.0
fastcluster==1.1.26
ffmpy==0.2.3
gast @ file:///tmp/build/80754af9/gast_1597433534803/work
google-auth @ file:///tmp/build/80754af9/google-auth_1607969906642/work
google-auth-oauthlib @ file:///tmp/build/80754af9/google-auth-oauthlib_1603929124518/work
google-pasta==0.2.0
grpcio @ file:///C:/ci/grpcio_1597406462198/work
h5py==2.10.0
idna @ file:///home/linux1/recipes/ci/idna_1610986105248/work
imageio @ file:///tmp/build/80754af9/imageio_1594161405741/work
imageio-ffmpeg @ file:///home/conda/feedstock_root/build_artifacts/imageio-ffmpeg_1609799311556/work
importlib-metadata @ file:///tmp/build/80754af9/importlib-metadata_1602276842396/work
joblib @ file:///tmp/build/80754af9/joblib_1607970656719/work
Keras-Applications @ file:///tmp/build/80754af9/keras-applications_1594366238411/work
Keras-Preprocessing @ file:///tmp/build/80754af9/keras-preprocessing_1612283640596/work
kiwisolver @ file:///C:/ci/kiwisolver_1612282606037/work
Markdown @ file:///C:/ci/markdown_1605111189761/work
matplotlib @ file:///C:/ci/matplotlib-base_1592837548929/work
mkl-fft==1.2.0
mkl-random==1.1.1
mkl-service==2.3.0
multidict @ file:///C:/ci/multidict_1600456481656/work
numpy @ file:///C:/ci/numpy_and_numpy_base_1603466732592/work
nvidia-ml-py3 @ git+https://github.com/deepfakes/nvidia-ml-py3.git@6fc29ac84b32bad877f078cb4a777c1548a00bf6
oauthlib==3.1.0
olefile==0.46
opencv-python==4.5.1.48
opt-einsum==3.1.0
pathlib==1.0.1
Pillow @ file:///C:/ci/pillow_1609786840597/work
protobuf==3.14.0
psutil @ file:///C:/ci/psutil_1612298324802/work
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser @ file:///tmp/build/80754af9/pycparser_1594388511720/work
PyJWT @ file:///C:/ci/pyjwt_1610893382614/work
pyOpenSSL @ file:///tmp/build/80754af9/pyopenssl_1608057966937/work
pyparsing @ file:///home/linux1/recipes/ci/pyparsing_1610983426697/work
pyreadline==2.1
PySocks @ file:///C:/ci/pysocks_1605287845585/work
python-dateutil @ file:///home/ktietz/src/ci/python-dateutil_1611928101742/work
pywin32==227
requests @ file:///tmp/build/80754af9/requests_1608241421344/work
requests-oauthlib==1.3.0
rsa @ file:///tmp/build/80754af9/rsa_1610483308194/work
scikit-learn @ file:///C:/ci/scikit-learn_1598377018496/work
scipy @ file:///C:/ci/scipy_1612469693242/work
sip==4.19.13
six @ file:///C:/ci/six_1605187374963/work
tensorboard @ file:///home/builder/ktietz/conda/conda-bld/tensorboard_1604313476433/work/tmp_pip_dir
tensorboard-plugin-wit==1.6.0
tensorflow==2.3.0
tensorflow-estimator @ file:///tmp/build/80754af9/tensorflow-estimator_1599136169057/work/whl_temp/tensorflow_estimator-2.3.0-py2.py3-none-any.whl
termcolor==1.1.0
threadpoolctl @ file:///tmp/tmp9twdgx9k/threadpoolctl-2.1.0-py3-none-any.whl
tornado @ file:///C:/ci/tornado_1606942392901/work
tqdm @ file:///tmp/build/80754af9/tqdm_1611857934208/work
typing-extensions @ file:///tmp/build/80754af9/typing_extensions_1611751222202/work
urllib3 @ file:///tmp/build/80754af9/urllib3_1611694770489/work
Werkzeug @ file:///home/ktietz/src/ci/werkzeug_1611932622770/work
win-inet-pton @ file:///C:/ci/win_inet_pton_1605306167264/work
wincertstore==0.2
wrapt==1.12.1
yarl @ file:///C:/ci/yarl_1598045274898/work
zipp @ file:///tmp/build/80754af9/zipp_1604001098328/work
============== Conda Packages ==============
# packages in environment at E:\ProgramFiles\anaconda3\envs\faceswap:
#
# Name Version Build Channel
_tflow_select 2.3.0 gpu
absl-py 0.11.0 pyhd3eb1b0_1
aiohttp 3.7.3 py38h2bbff1b_1
astunparse 1.6.3 py_0
async-timeout 3.0.1 py38haa95532_0
attrs 20.3.0 pyhd3eb1b0_0
blas 1.0 mkl
blinker 1.4 py38haa95532_0
brotlipy 0.7.0 py38h2bbff1b_1003
ca-certificates 2021.1.19 haa95532_0
cachetools 4.2.1 pyhd3eb1b0_0
certifi 2020.12.5 py38haa95532_0
cffi 1.14.4 py38hcd4344a_0
chardet 3.0.4 py38haa95532_1003
click 7.1.2 pyhd3eb1b0_0
cryptography 2.9.2 py38h7a1dbc1_0
cudatoolkit 10.1.243 h74a9793_0
cudnn 7.6.5 cuda10.1_0
cycler 0.10.0 py38_0
fastcluster 1.1.26 py38h251f6bf_2 conda-forge
ffmpeg 4.3.1 ha925a31_0 conda-forge
ffmpy 0.2.3 pypi_0 pypi
freetype 2.10.4 hd328e21_0
gast 0.4.0 py_0
git 2.23.0 h6bb4b03_0
google-auth 1.24.0 pyhd3eb1b0_0
google-auth-oauthlib 0.4.2 pyhd3eb1b0_2
google-pasta 0.2.0 py_0
grpcio 1.31.0 py38he7da953_0
h5py 2.10.0 py38h5e291fa_0
hdf5 1.10.4 h7ebc959_0
icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha925a31_3
idna 2.10 pyhd3eb1b0_0
imageio 2.9.0 py_0
imageio-ffmpeg 0.4.3 pyhd8ed1ab_0 conda-forge
importlib-metadata 2.0.0 py_1
intel-openmp 2020.2 254
joblib 1.0.0 pyhd3eb1b0_0
jpeg 9b hb83a4c4_2
keras-applications 1.0.8 py_1
keras-preprocessing 1.1.2 pyhd3eb1b0_0
kiwisolver 1.3.1 py38hd77b12b_0
libpng 1.6.37 h2a8f88b_0
libprotobuf 3.14.0 h23ce68f_0
libtiff 4.1.0 h56a325e_1
lz4-c 1.9.3 h2bbff1b_0
markdown 3.3.3 py38haa95532_0
matplotlib 3.2.2 0
matplotlib-base 3.2.2 py38h64f37c6_0
mkl 2020.2 256
mkl-service 2.3.0 py38h196d8e1_0
mkl_fft 1.2.0 py38h45dec08_0
mkl_random 1.1.1 py38h47e9c7a_0
multidict 4.7.6 py38he774522_1
numpy 1.19.2 py38hadc3359_0
numpy-base 1.19.2 py38ha3acd2a_0
nvidia-ml-py3 7.352.1 pypi_0 pypi
oauthlib 3.1.0 py_0
olefile 0.46 py_0
opencv-python 4.5.1.48 pypi_0 pypi
openssl 1.1.1i h2bbff1b_0
opt_einsum 3.1.0 py_0
pathlib 1.0.1 py_1
pillow 8.1.0 py38h4fa10fc_0
pip 20.3.3 py38haa95532_0
protobuf 3.14.0 py38hd77b12b_1
psutil 5.8.0 py38h2bbff1b_1
pyasn1 0.4.8 py_0
pyasn1-modules 0.2.8 py_0
pycparser 2.20 py_2
pyjwt 2.0.1 py38haa95532_0
pyopenssl 20.0.1 pyhd3eb1b0_1
pyparsing 2.4.7 pyhd3eb1b0_0
pyqt 5.9.2 py38ha925a31_4
pyreadline 2.1 py38_1
pysocks 1.7.1 py38haa95532_0
python 3.8.5 h5fd99cc_1
python-dateutil 2.8.1 pyhd3eb1b0_0
python_abi 3.8 1_cp38 conda-forge
pywin32 227 py38he774522_1
qt 5.9.7 vc14h73c81de_0
requests 2.25.1 pyhd3eb1b0_0
requests-oauthlib 1.3.0 py_0
rsa 4.7 pyhd3eb1b0_1
scikit-learn 0.23.2 py38h47e9c7a_0
scipy 1.6.0 py38h14eb087_0
setuptools 52.0.0 py38haa95532_0
sip 4.19.13 py38ha925a31_0
six 1.15.0 py38haa95532_0
sqlite 3.33.0 h2a8f88b_0
tensorboard 2.3.0 pyh4dce500_0
tensorboard-plugin-wit 1.6.0 py_0
tensorflow 2.3.0 mkl_py38h1fcfbd6_0
tensorflow-base 2.3.0 gpu_py38h7339f5a_0
tensorflow-estimator 2.3.0 pyheb71bc4_0
tensorflow-gpu 2.3.0 he13fc11_0
termcolor 1.1.0 py38_1
threadpoolctl 2.1.0 pyh5ca1d4c_0
tk 8.6.10 he774522_0
tornado 6.1 py38h2bbff1b_0
tqdm 4.56.0 pyhd3eb1b0_0
typing-extensions 3.7.4.3 hd3eb1b0_0
typing_extensions 3.7.4.3 pyh06a4308_0
urllib3 1.26.3 pyhd3eb1b0_0
vc 14.2 h21ff451_1
vs2015_runtime 14.27.29016 h5e58377_2
werkzeug 1.0.1 pyhd3eb1b0_0
wheel 0.36.2 pyhd3eb1b0_0
win_inet_pton 1.1.0 py38haa95532_0
wincertstore 0.2 py38_0
wrapt 1.12.1 py38he774522_1
xz 5.2.5 h62dcd97_0
yarl 1.5.1 py38he774522_0
zipp 3.4.0 pyhd3eb1b0_0
zlib 1.2.11 h62dcd97_4
zstd 1.4.5 h04227a9_0
================= Configs ==================
--------- .faceswap ---------
backend: nvidia
--------- convert.ini ---------
[color.color_transfer]
clip: True
preserve_paper: True
[color.manual_balance]
colorspace: HSV
balance_1: 0.0
balance_2: 0.0
balance_3: 0.0
contrast: 0.0
brightness: 0.0
[color.match_hist]
threshold: 99.0
[mask.box_blend]
type: gaussian
distance: 11.0
radius: 5.0
passes: 1
[mask.mask_blend]
type: normalized
kernel_size: 3
passes: 4
threshold: 4
erosion: 0.0
[scaling.sharpen]
method: none
amount: 150
radius: 0.3
threshold: 5.0
[writer.ffmpeg]
container: mp4
codec: libx264
crf: 23
preset: medium
tune: none
profile: auto
level: auto
skip_mux: False
[writer.gif]
fps: 25
loop: 0
palettesize: 256
subrectangles: False
[writer.opencv]
format: png
draw_transparent: False
jpg_quality: 75
png_compress_level: 3
[writer.pillow]
format: png
draw_transparent: False
optimize: False
gif_interlace: True
jpg_quality: 75
png_compress_level: 3
tif_compression: tiff_deflate
--------- extract.ini ---------
[global]
allow_growth: False
[align.fan]
batch-size: 12
[detect.cv2_dnn]
confidence: 50
[detect.mtcnn]
minsize: 20
threshold_1: 0.6
threshold_2: 0.7
threshold_3: 0.7
scalefactor: 0.709
batch-size: 8
[detect.s3fd]
confidence: 70
batch-size: 4
[mask.unet_dfl]
batch-size: 8
[mask.vgg_clear]
batch-size: 6
[mask.vgg_obstructed]
batch-size: 2
--------- gui.ini ---------
[global]
fullscreen: False
tab: extract
options_panel_width: 30
console_panel_height: 20
icon_size: 14
font: default
font_size: 9
autosave_last_session: prompt
timeout: 120
auto_load_model_stats: True
--------- train.ini ---------
[global]
centering: face
coverage: 68.75
icnr_init: False
conv_aware_init: False
optimizer: adam
learning_rate: 5e-05
reflect_padding: False
allow_growth: False
mixed_precision: False
convert_batchsize: 16
[global.loss]
loss_function: ssim
mask_loss_function: mse
l2_reg_term: 100
eye_multiplier: 3
mouth_multiplier: 2
penalized_mask_loss: True
mask_type: extended
mask_blur_kernel: 3
mask_threshold: 4
learn_mask: False
[model.dfaker]
output_size: 128
[model.dfl_h128]
lowmem: False
[model.dfl_sae]
input_size: 128
clipnorm: True
architecture: df
autoencoder_dims: 0
encoder_dims: 42
decoder_dims: 21
multiscale_decoder: False
[model.dlight]
features: best
details: good
output_size: 256
[model.original]
lowmem: False
[model.realface]
input_size: 64
output_size: 128
dense_nodes: 1536
complexity_encoder: 128
complexity_decoder: 512
[model.unbalanced]
input_size: 128
lowmem: False
clipnorm: True
nodes: 1024
complexity_encoder: 128
complexity_decoder_a: 384
complexity_decoder_b: 512
[model.villain]
lowmem: False
[trainer.original]
preview_images: 14
zoom_amount: 5
rotation_range: 10
shift_range: 5
flip_chance: 50
disable_warp: False
color_lightness: 30
color_ab: 8
color_clahe_chance: 50
color_clahe_max_size: 4
Thank you very much for the help.
Have a nice day