Error when extracting

The Extraction process failing on you, and you aren't getting an error back with clear instructions? Tell us about it here


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for reporting errors with the Extraction process. If you want to get tips, or better understand the Extract process, then you should look in the Extract Discussion forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
kholik
Posts: 4
Joined: Sat Aug 31, 2019 6:00 pm
Answers: 1

Sorting Tool - Critical Crash ?

Post by kholik »

Whenever I try to sort my faces folder, at the very end it produces this error. I looked up this issue on the forums, found a post and tried their solution (to provide an output directory) but that produced no different result. Is there something I'm doing incorrectly? I updated Faceswap to the latest version, as well. Any help is much appreciated.

Here is the crash report:

08/31/2019 14:04:28 MainProcess MainThread sort sort_face INFO Sorting. Depending on ths size of your dataset, this may take a few minutes...
08/31/2019 14:04:28 MainProcess MainThread vgg_face2_keras sorted_similarity INFO Sorting face distances. Depending on your dataset this may take some time...
Traceback (most recent call last):
File "C:\Users\ADMIN\faceswap\lib\cli.py", line 125, in execute_script
process.process()
File "C:\Users\ADMIN\faceswap\tools\sort.py", line 86, in process
self.sort_process()
File "C:\Users\ADMIN\faceswap\tools\sort.py", line 152, in sort_process
img_list = getattr(self, sort_method)()
File "C:\Users\ADMIN\faceswap\tools\sort.py", line 193, in sort_face
indices = self.vgg_face.sorted_similarity(preds, method="ward")
File "C:\Users\ADMIN\faceswap\lib\vgg_face2_keras.py", line 104, in sorted_similarity
result_linkage = linkage(predictions, method=method, preserve_input=False)
File "C:\Users\ADMIN\MiniConda3\envs\faceswap\lib\site-packages\fastcluster.py", line 243, in linkage
X = pdist(X, metric)
File "C:\Users\ADMIN\MiniConda3\envs\faceswap\lib\site-packages\scipy\spatial\distance.py", line 2004, in pdist
dm = np.empty((m * (m - 1)) // 2, dtype=np.double)
MemoryError

============ System Information ============
encoding: cp1252
git_branch: master
git_commits: feedd2a More robust Crash Report messaging. 5bf54d9 Add configs and state file to crash report. 7184ae3 Merge branch 'master' of https://github.com/deepfakes/faceswap. 1a18241 Revert "Delete align_eyes.py". e6f17cd Delete align_eyes.py
gpu_cuda: No global version found. Check Conda packages for Conda Cuda
gpu_cudnn: No global version found. Check Conda packages for Conda cuDNN
gpu_devices: GPU_0: GeForce RTX 2060
gpu_devices_active: GPU_0
gpu_driver: 436.15
gpu_vram: GPU_0: 6144MB
os_machine: AMD64
os_platform: Windows-10-10.0.18362-SP0
os_release: 10
py_command: C:\Users\ADMIN\faceswap\tools.py sort -i A:/Videos/Deepfakes/my face OUTPUT -o A:/Videos/Deepfakes/my face OUTPUT -s face -t -1.0 -fp rename -g hist -b 5 -be GPU -lf sort_log.json -L INFO -gui
py_conda_version: conda 4.7.11
py_implementation: CPython
py_version: 3.6.9
py_virtual_env: True
sys_cores: 16
sys_processor: AMD64 Family 23 Model 8 Stepping 2, AuthenticAMD
sys_ram: Total: 32714MB, Available: 25350MB, Used: 7364MB, Free: 25350MB

=============== Pip Packages ===============
absl-py==0.7.1
astor==0.8.0
certifi==2019.6.16
cloudpickle==1.2.1
cycler==0.10.0
cytoolz==0.10.0
dask==2.3.0
decorator==4.4.0
fastcluster==1.1.25
ffmpy==0.2.2
gast==0.2.2
grpcio==1.16.1
h5py==2.9.0
imageio==2.5.0
imageio-ffmpeg==0.3.0
joblib==0.13.2
Keras==2.2.4
Keras-Applications==1.0.8
Keras-Preprocessing==1.1.0
kiwisolver==1.1.0
Markdown==3.1.1
matplotlib==2.2.2
mkl-fft==1.0.14
mkl-random==1.0.2
mkl-service==2.0.2
networkx==2.3
numpy==1.16.2
nvidia-ml-py3==7.352.1
olefile==0.46
opencv-python==4.1.0.25
pathlib==1.0.1
Pillow==6.1.0
protobuf==3.8.0
psutil==5.6.3
pyparsing==2.4.2
pyreadline==2.1
python-dateutil==2.8.0
pytz==2019.2
PyWavelets==1.0.3
pywin32==223
PyYAML==5.1.2
scikit-image==0.15.0
scikit-learn==0.21.2
scipy==1.3.1
six==1.12.0
tensorboard==1.14.0
tensorflow==1.14.0
tensorflow-estimator==1.14.0
termcolor==1.1.0
toolz==0.10.0
toposort==1.5
tornado==6.0.3
tqdm==4.32.1
Werkzeug==0.15.5
wincertstore==0.2
wrapt==1.11.2

============== Conda Packages ==============

packages in environment at C:\Users\ADMIN\MiniConda3\envs\faceswap:

#

Name Version Build Channel

_tflow_select 2.1.0 gpu
absl-py 0.7.1 py36_0
astor 0.8.0 py36_0
blas 1.0 mkl
ca-certificates 2019.5.15 1
certifi 2019.6.16 py36_1
cloudpickle 1.2.1 py_0
cudatoolkit 10.0.130 0
cudnn 7.6.0 cuda10.0_0
cycler 0.10.0 py36h009560c_0
cytoolz 0.10.0 py36he774522_0
dask-core 2.3.0 py_0
decorator 4.4.0 py36_1
fastcluster 1.1.25 py36h830ac7b_1000 conda-forge
ffmpeg 4.2 h6538335_0 conda-forge
ffmpy 0.2.2 pypi_0 pypi
freetype 2.9.1 ha9979f8_1
gast 0.2.2 py36_0
grpcio 1.16.1 py36h351948d_1
h5py 2.9.0 py36h5e291fa_0
hdf5 1.10.4 h7ebc959_0
icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha66f8fd_1
imageio 2.5.0 py36_0
imageio-ffmpeg 0.3.0 py_0 conda-forge
intel-openmp 2019.4 245
joblib 0.13.2 py36_0
jpeg 9b hb83a4c4_2
keras 2.2.4 0
keras-applications 1.0.8 py_0
keras-base 2.2.4 py36_0
keras-preprocessing 1.1.0 py_1
kiwisolver 1.1.0 py36ha925a31_0
libmklml 2019.0.5 0
libpng 1.6.37 h2a8f88b_0
libprotobuf 3.8.0 h7bd577a_0
libtiff 4.0.10 hb898794_2
markdown 3.1.1 py36_0
matplotlib 2.2.2 py36had4c4a9_2
mkl 2019.4 245
mkl-service 2.0.2 py36he774522_0
mkl_fft 1.0.14 py36h14836fe_0
mkl_random 1.0.2 py36h343c172_0
networkx 2.3 py_0
numpy 1.16.2 py36h19fb1c0_0
numpy-base 1.16.2 py36hc3f5095_0
nvidia-ml-py3 7.352.1 pypi_0 pypi
olefile 0.46 py36_0
opencv-python 4.1.0.25 pypi_0 pypi
openssl 1.1.1c he774522_1
pathlib 1.0.1 py36_1
pillow 6.1.0 py36hdc69c19_0
pip 19.2.2 py36_0
protobuf 3.8.0 py36h33f27b4_0
psutil 5.6.3 py36he774522_0
pyparsing 2.4.2 py_0
pyqt 5.9.2 py36h6538335_2
pyreadline 2.1 py36_1
python 3.6.9 h5500b2f_0
python-dateutil 2.8.0 py36_0
pytz 2019.2 py_0
pywavelets 1.0.3 py36h8c2d366_1
pywin32 223 py36hfa6e2cd_1
pyyaml 5.1.2 py36he774522_0
qt 5.9.7 vc14h73c81de_0
scikit-image 0.15.0 py36ha925a31_0
scikit-learn 0.21.2 py36h6288b17_0
scipy 1.3.1 py36h29ff71c_0
setuptools 41.0.1 py36_0
sip 4.19.8 py36h6538335_0
six 1.12.0 py36_0
sqlite 3.29.0 he774522_0
tensorboard 1.14.0 py36he3c9ec2_0
tensorflow 1.14.0 gpu_py36h305fd99_0
tensorflow-base 1.14.0 gpu_py36h55fc52a_0
tensorflow-estimator 1.14.0 py_0
tensorflow-gpu 1.14.0 h0d30ee6_0
termcolor 1.1.0 py36_1
tk 8.6.8 hfa6e2cd_0
toolz 0.10.0 py_0
toposort 1.5 py_3 conda-forge
tornado 6.0.3 py36he774522_0
tqdm 4.32.1 py_0
vc 14.1 h0510ff6_4
vs2015_runtime 14.15.26706 h3a45250_4
werkzeug 0.15.5 py_0
wheel 0.33.4 py36_0
wincertstore 0.2 py36h7fe50ca_0
wrapt 1.11.2 py36he774522_0
xz 5.2.4 h2fa13f4_4
yaml 0.1.7 hc54c509_2
zlib 1.2.11 h62dcd97_3
zstd 1.3.7 h508b16e_0

by torzdf » Fri Nov 29, 2019 11:30 am

There was a memory leak in extract. Latest code should have fixed this.

Go to full post
User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Sorting Tool - Critical Crash ?

Post by torzdf »

Yes. You've run out of system RAM. How many images are you processing?

If you check the sort section of the extraction guide you will see specific mention of this.

My word is final

User avatar
kholik
Posts: 4
Joined: Sat Aug 31, 2019 6:00 pm
Answers: 1

Re: Sorting Tool - Critical Crash ?

Post by kholik »

Thank you! I actually tried smaller batches and that works perfectly fine.
Appreciate the response, I knew I was missing something.

User avatar
Lexzaviel
Posts: 1
Joined: Sun Sep 22, 2019 8:17 am

Crital error when i was sorting faces

Post by Lexzaviel »

Here is the log file

Code: Select all

11/06/2019 14:33:15 MainProcess     MainThread      logger          log_setup                 INFO     Log level set to: INFO
11/06/2019 14:33:15 MainProcess     MainThread      cli             execute_script            DEBUG    Executing: sort. PID: 4988
11/06/2019 14:33:21 MainProcess     MainThread      cli             test_for_tf_version       DEBUG    Installed Tensorflow Version: 1.14
11/06/2019 14:33:21 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initializing QueueManager
11/06/2019 14:33:21 MainProcess     MainThread      queue_manager   __init__                  DEBUG    Initialized QueueManager
11/06/2019 14:33:21 MainProcess     MainThread      vgg_face2_keras __init__                  DEBUG    Initializing VGGFace2: (backend: GPU, loglevel: INFO)
11/06/2019 14:33:21 MainProcess     MainThread      utils           set_system_verbosity      DEBUG    System Verbosity level: 2
11/06/2019 14:33:21 MainProcess     MainThread      utils           download_model            INFO     Downloading model: 'vggface2_resnet50' from: https://github.com/deepfakes-models/faceswap-models/releases/download/v1.10.2/vggface2_resnet50_v2.zip
11/06/2019 14:33:23 MainProcess     MainThread      utils           download_model            DEBUG    header info: {x-amz-id-2: SwLpL5jns1PmnJ+n2nKj1PnNOvzeZp9OEA0aXkqj1W6tPBXjD41MAIdurae6CnG0wpVsiq2NLPI=\nx-amz-request-id: 1C052E2B130D0889\nDate: Wed, 06 Nov 2019 13:33:24 GMT\nLast-Modified: Fri, 12 Jul 2019 22:26:21 GMT\nETag: "838180971b59b95f51d2fd6eaea5dc2d"\nContent-Disposition: attachment; filename=vggface2_resnet50_v2.zip\nAccept-Ranges: bytes\nContent-Type: application/octet-stream\nContent-Length: 91407875\nServer: AmazonS3\nConnection: close\n\n}
11/06/2019 14:33:23 MainProcess     MainThread      utils           download_model            DEBUG    Return Code: 200
11/06/2019 14:33:28 MainProcess     MainThread      utils           unzip_model               INFO     Extracting: 'vggface2_resnet50'
11/06/2019 14:33:28 MainProcess     MainThread      utils           write_model               DEBUG    Zipfile: Filenames: ['vggface2_resnet50_v2.h5'], Total Size: 98979928
11/06/2019 14:33:28 MainProcess     MainThread      utils           write_model               DEBUG    Extracting from: 'C:\Users\Shadow\faceswap\plugins\extract\recognition\.cache\vggface2_resnet50_v2.zip' to 'C:\Users\Shadow\faceswap\plugins\extract\recognition\.cache\vggface2_resnet50_v2.h5'
11/06/2019 14:33:30 MainProcess     MainThread      deprecation_wrapper __getattr__               WARNING  From C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\keras\backend\tensorflow_backend.py:517: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.\n
11/06/2019 14:33:30 MainProcess     MainThread      deprecation_wrapper __getattr__               WARNING  From C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\keras\backend\tensorflow_backend.py:245: The name tf.get_default_graph is deprecated. Please use tf.compat.v1.get_default_graph instead.\n
11/06/2019 14:33:30 MainProcess     MainThread      deprecation_wrapper __getattr__               WARNING  From C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\keras\backend\tensorflow_backend.py:174: The name tf.get_default_session is deprecated. Please use tf.compat.v1.get_default_session instead.\n
11/06/2019 14:33:30 MainProcess     MainThread      deprecation_wrapper __getattr__               WARNING  From C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\keras\backend\tensorflow_backend.py:181: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.\n
11/06/2019 14:33:30 MainProcess     MainThread      deprecation_wrapper __getattr__               WARNING  From C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\keras\backend\tensorflow_backend.py:186: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.\n
11/06/2019 14:33:32 MainProcess     MainThread      deprecation_wrapper __getattr__               WARNING  From C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\keras\backend\tensorflow_backend.py:1834: The name tf.nn.fused_batch_norm is deprecated. Please use tf.compat.v1.nn.fused_batch_norm instead.\n
11/06/2019 14:33:32 MainProcess     MainThread      deprecation_wrapper __getattr__               WARNING  From C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\keras\backend\tensorflow_backend.py:3976: The name tf.nn.max_pool is deprecated. Please use tf.nn.max_pool2d instead.\n
11/06/2019 14:33:44 MainProcess     MainThread      deprecation_wrapper __getattr__               WARNING  From C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\keras\backend\tensorflow_backend.py:3980: The name tf.nn.avg_pool is deprecated. Please use tf.nn.avg_pool2d instead.\n
11/06/2019 14:33:54 MainProcess     MainThread      deprecation_wrapper __getattr__               WARNING  From C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\keras\optimizers.py:790: The name tf.train.Optimizer is deprecated. Please use tf.compat.v1.train.Optimizer instead.\n
11/06/2019 14:33:54 MainProcess     MainThread      vgg_face2_keras __init__                  DEBUG    Initialized VGGFace2
11/06/2019 14:33:54 MainProcess     MainThread      sort            sort_face                 INFO     Sorting by identity similarity...
11/06/2019 14:33:54 MainProcess     MainThread      sort            _get_images               INFO     Loading images...
11/06/2019 14:34:37 MainProcess     MainThread      sort            sort_face                 INFO     Calculating face identifiers...
11/06/2019 14:55:38 MainProcess     MainThread      sort            sort_face                 INFO     Sorting by ward linkage...
11/06/2019 14:55:38 MainProcess     MainThread      vgg_face2_keras sorted_similarity         INFO     Sorting face distances. Depending on your dataset this may take some time...
Traceback (most recent call last):
  File "C:\Users\Shadow\faceswap\lib\cli.py", line 128, in execute_script
    process.process()
  File "C:\Users\Shadow\faceswap\tools\sort.py", line 83, in process
    self.sort_process()
  File "C:\Users\Shadow\faceswap\tools\sort.py", line 143, in sort_process
    img_list = getattr(self, sort_method)()
  File "C:\Users\Shadow\faceswap\tools\sort.py", line 180, in sort_face
    indices = self.vgg_face.sorted_similarity(preds, method="ward")
  File "C:\Users\Shadow\faceswap\lib\vgg_face2_keras.py", line 104, in sorted_similarity
    result_linkage = linkage(predictions, method=method, preserve_input=False)
  File "C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\fastcluster.py", line 243, in linkage
    X = pdist(X, metric)
  File "C:\Users\Shadow\MiniConda3\envs\faceswap\lib\site-packages\scipy\spatial\distance.py", line 2004, in pdist
    dm = np.empty((m * (m - 1)) // 2, dtype=np.double)
MemoryError

============ System Information ============
encoding:            cp1252
git_branch:          master
git_commits:         61497a9 Updart INSTALL.md. 50bf8e5 .install.linux Add linux installer source code. 0dcef3c scripts.convert - add allow growth option. 48a7276 Add linux .install folder. 09250eb Merge branch 'master' into staging
gpu_cuda:            No global version found. Check Conda packages for Conda Cuda
gpu_cudnn:           No global version found. Check Conda packages for Conda cuDNN
gpu_devices:         GPU_0: Quadro P5000
gpu_devices_active:  GPU_0
gpu_driver:          436.30
gpu_vram:            GPU_0: 16384MB
os_machine:          AMD64
os_platform:         Windows-10-10.0.18362-SP0
os_release:          10
py_command:          C:\Users\Shadow\faceswap\tools.py sort -i C:/Users/Shadow/Desktop/FaceSource/FaceAlanah Rae -o C:/Users/Shadow/Desktop/FaceSource/FaceAlanah Rae/OUT -s face -t -1.0 -fp rename -g hist -b 5 -be GPU -lf sort_log.json -L INFO -gui
py_conda_version:    conda 4.7.12
py_implementation:   CPython
py_version:          3.6.9
py_virtual_env:      True
sys_cores:           8
sys_processor:       Intel64 Family 6 Model 63 Stepping 2, GenuineIntel
sys_ram:             Total: 12286MB, Available: 486MB, Used: 11800MB, Free: 486MB

=============== Pip Packages ===============
absl-py==0.8.0
astor==0.8.0
certifi==2019.9.11
cloudpickle==1.2.2
cycler==0.10.0
cytoolz==0.10.0
dask==2.6.0
decorator==4.4.1
fastcluster==1.1.25
ffmpy==0.2.2
gast==0.3.2
grpcio==1.16.1
h5py==2.9.0
imageio==2.5.0
imageio-ffmpeg==0.3.0
joblib==0.13.2
Keras==2.2.4
Keras-Applications==1.0.8
Keras-Preprocessing==1.1.0
kiwisolver==1.1.0
Markdown==3.1.1
matplotlib==2.2.2
mkl-fft==1.0.14
mkl-random==1.1.0
mkl-service==2.3.0
networkx==2.4
numpy==1.16.2
nvidia-ml-py3==7.352.1
olefile==0.46
opencv-python==4.1.1.26
pathlib==1.0.1
Pillow==6.1.0
protobuf==3.9.2
psutil==5.6.3
pyparsing==2.4.2
pyreadline==2.1
python-dateutil==2.8.0
pytz==2019.3
PyWavelets==1.1.1
pywin32==223
PyYAML==5.1.2
scikit-image==0.15.0
scikit-learn==0.21.3
scipy==1.3.1
six==1.12.0
tensorboard==1.14.0
tensorflow==1.14.0
tensorflow-estimator==1.14.0
termcolor==1.1.0
toolz==0.10.0
toposort==1.5
tornado==6.0.3
tqdm==4.36.1
Werkzeug==0.16.0
wincertstore==0.2
wrapt==1.11.2

============== Conda Packages ==============
# packages in environment at C:\Users\Shadow\MiniConda3\envs\faceswap:
#
# Name                    Version                   Build  Channel
_tflow_select             2.1.0                       gpu  
absl-py 0.8.0 py36_0
astor 0.8.0 py36_0
blas 1.0 mkl
ca-certificates 2019.10.16 0
certifi 2019.9.11 py36_0
cloudpickle 1.2.2 py_0
cudatoolkit 10.0.130 0
cudnn 7.6.0 cuda10.0_0
cycler 0.10.0 py36h009560c_0
cytoolz 0.10.0 py36he774522_0
dask-core 2.6.0 py_0
decorator 4.4.1 py_0
fastcluster 1.1.25 py36h830ac7b_1000 conda-forge ffmpeg 4.2 h6538335_0 conda-forge ffmpy 0.2.2 pypi_0 pypi freetype 2.9.1 ha9979f8_1
gast 0.3.2 py_0
grpcio 1.16.1 py36h351948d_1
h5py 2.9.0 py36h5e291fa_0
hdf5 1.10.4 h7ebc959_0
icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha66f8fd_1
imageio 2.5.0 py36_0
imageio-ffmpeg 0.3.0 py_0 conda-forge intel-openmp 2019.4 245
joblib 0.13.2 py36_0
jpeg 9b hb83a4c4_2
keras 2.2.4 0
keras-applications 1.0.8 py_0
keras-base 2.2.4 py36_0
keras-preprocessing 1.1.0 py_1
kiwisolver 1.1.0 py36ha925a31_0
libmklml 2019.0.5 0
libpng 1.6.37 h2a8f88b_0
libprotobuf 3.9.2 h7bd577a_0
libtiff 4.0.10 hb898794_2
markdown 3.1.1 py36_0
matplotlib 2.2.2 py36had4c4a9_2
mkl 2019.4 245
mkl-service 2.3.0 py36hb782905_0
mkl_fft 1.0.14 py36h14836fe_0
mkl_random 1.1.0 py36h675688f_0
networkx 2.4 py_0
numpy 1.16.2 py36h19fb1c0_0
numpy-base 1.16.2 py36hc3f5095_0
nvidia-ml-py3 7.352.1 pypi_0 pypi olefile 0.46 py36_0
opencv-python 4.1.1.26 pypi_0 pypi openssl 1.1.1d he774522_3
pathlib 1.0.1 py36_1
pillow 6.1.0 py36hdc69c19_0
pip 19.3.1 py36_0
protobuf 3.9.2 py36h33f27b4_0
psutil 5.6.3 py36he774522_0
pyparsing 2.4.2 py_0
pyqt 5.9.2 py36h6538335_2
pyreadline 2.1 py36_1
python 3.6.9 h5500b2f_0
python-dateutil 2.8.0 py36_0
pytz 2019.3 py_0
pywavelets 1.1.1 py36he774522_0
pywin32 223 py36hfa6e2cd_1
pyyaml 5.1.2 py36he774522_0
qt 5.9.7 vc14h73c81de_0
scikit-image 0.15.0 py36ha925a31_0
scikit-learn 0.21.3 py36h6288b17_0
scipy 1.3.1 py36h29ff71c_0
setuptools 41.6.0 py36_0
sip 4.19.8 py36h6538335_0
six 1.12.0 py36_0
sqlite 3.30.1 he774522_0
tensorboard 1.14.0 py36he3c9ec2_0
tensorflow 1.14.0 gpu_py36h305fd99_0
tensorflow-base 1.14.0 gpu_py36h55fc52a_0
tensorflow-estimator 1.14.0 py_0
tensorflow-gpu 1.14.0 h0d30ee6_0
termcolor 1.1.0 py36_1
tk 8.6.8 hfa6e2cd_0
toolz 0.10.0 py_0
toposort 1.5 py_3 conda-forge tornado 6.0.3 py36he774522_0
tqdm 4.36.1 py_0
vc 14.1 h0510ff6_4
vs2015_runtime 14.16.27012 hf0eaf9b_0
werkzeug 0.16.0 py_0
wheel 0.33.6 py36_0
wincertstore 0.2 py36h7fe50ca_0
wrapt 1.11.2 py36he774522_0
xz 5.2.4 h2fa13f4_4
yaml 0.1.7 hc54c509_2
zlib 1.2.11 h62dcd97_3
zstd 1.3.7 h508b16e_0 ================= Configs ================== --------- .faceswap --------- backend: nvidia --------- convert.ini --------- [color.color_transfer] clip: True preserve_paper: True [color.manual_balance] colorspace: HSV balance_1: 0.0 balance_2: 0.0 balance_3: 0.0 contrast: 0.0 brightness: 0.0 [color.match_hist] threshold: 99.0 [mask.box_blend] type: gaussian distance: 11.0 radius: 5.0 passes: 1 [mask.mask_blend] type: normalized radius: 3.0 passes: 4 erosion: 0.0 [scaling.sharpen] method: unsharp_mask amount: 150 radius: 0.3 threshold: 5.0 [writer.ffmpeg] container: mp4 codec: libx264 crf: 23 preset: medium tune: none profile: auto level: auto [writer.gif] fps: 25 loop: 0 palettesize: 256 subrectangles: False [writer.opencv] format: png draw_transparent: False jpg_quality: 75 png_compress_level: 3 [writer.pillow] format: png draw_transparent: False optimize: False gif_interlace: True jpg_quality: 75 png_compress_level: 3 tif_compression: tiff_deflate --------- extract.ini --------- [global] allow_growth: False [align.fan] batch-size: 12 [detect.cv2_dnn] confidence: 50 [detect.mtcnn] minsize: 20 threshold_1: 0.6 threshold_2: 0.7 threshold_3: 0.7 scalefactor: 0.709 batch-size: 8 [detect.s3fd] confidence: 50 batch-size: 4 [mask.unet_dfl] batch-size: 8 [mask.vgg_clear] batch-size: 6 [mask.vgg_obstructed] batch-size: 2 --------- gui.ini --------- [global] fullscreen: False tab: extract options_panel_width: 30 console_panel_height: 20 font: default font_size: 9 --------- train.ini --------- [global] coverage: 68.75 mask_type: none mask_blur: False icnr_init: False conv_aware_init: False subpixel_upscaling: False reflect_padding: False penalized_mask_loss: True loss_function: mae learning_rate: 5e-05 [model.dfl_h128] lowmem: False [model.dfl_sae] input_size: 128 clipnorm: True architecture: df autoencoder_dims: 0 encoder_dims: 42 decoder_dims: 21 multiscale_decoder: False [model.dlight] features: best details: good output_size: 256 [model.original] lowmem: False [model.realface] input_size: 64 output_size: 128 dense_nodes: 1536 complexity_encoder: 128 complexity_decoder: 512 [model.unbalanced] input_size: 128 lowmem: False clipnorm: True nodes: 1024 complexity_encoder: 128 complexity_decoder_a: 384 complexity_decoder_b: 512 [model.villain] lowmem: False [trainer.original] preview_images: 14 zoom_amount: 5 rotation_range: 10 shift_range: 5 flip_chance: 50 color_lightness: 30 color_ab: 8 color_clahe_chance: 50 color_clahe_max_size: 4
User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Crital error when i was sorting faces

Post by torzdf »

MemoryError

This means that you have run out of System Ram. Sorting faces is memory intensive (this is warned about in the guide).

Split your faceset up into smaller batches.

My word is final

User avatar
randomanonymous
Posts: 1
Joined: Tue Nov 19, 2019 9:11 pm

Error when extracting

Post by randomanonymous »

11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:09 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:09 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:09 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:09 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:09 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:09 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:09 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:09 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:09 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:09 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:09 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:09 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:09 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:09 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:09 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:09 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:09 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:09 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:09 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:09 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:09 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:09 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:09 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:09 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:09 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:10 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:10 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:10 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:10 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:10 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:10 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:10 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:10 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:10 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:10 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:10 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:10 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:10 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:10 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:10 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:10 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:10 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:10 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:10 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:10 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_predict_0 fan predict DEBUG Predicting Landmarks
11/20/2019 05:04:10 MainProcess align_output_0 fan get_pts_from_predict DEBUG Obtain points from prediction
11/20/2019 05:04:10 MainProcess align_output_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan process_input DEBUG Aligning faces around center
11/20/2019 05:04:10 MainProcess align_input_0 fan get_center_scale DEBUG Calculating center and scale
11/20/2019 05:04:10 MainProcess align_input_0 fan crop DEBUG Cropping images
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 fan transform DEBUG Transforming Points
11/20/2019 05:04:10 MainProcess align_input_0 multithreading run DEBUG Error in thread (align_input_0):
11/20/2019 05:04:10 MainProcess align_predict_0 multithreading run DEBUG Error in thread (align_predict_0):
11/20/2019 05:04:11 MainProcess MainThread multithreading check_and_raise_error DEBUG Thread error caught: [(<class 'MemoryError'>, MemoryError(), <traceback object at 0x0000022F0B3A7448>)]
Traceback (most recent call last):
File "C:\Users\yuyup\faceswap\lib\cli.py", line 128, in execute_script
process.process()
File "C:\Users\yuyup\faceswap\scripts\extract.py", line 116, in process
self._run_extraction()
File "C:\Users\yuyup\faceswap\scripts\extract.py", line 212, in run_extraction
for idx, faces in enumerate(status_bar):
File "C:\Users\yuyup\MiniConda3\envs\faceswap\lib\site-packages\tqdm\std.py", line 1091, in iter
for obj in iterable:
File "C:\Users\yuyup\faceswap\plugins\extract\pipeline.py", line 217, in detected_faces
if self.
check_and_raise_error():
File "C:\Users\yuyup\faceswap\plugins\extract\pipeline.py", line 482, in check_and_raise_error
if plugin.check_and_raise_error():
File "C:\Users\yuyup\faceswap\plugins\extract\_base.py", line 292, in check_and_raise_error
err = thread.check_and_raise_error()
File "C:\Users\yuyup\faceswap\lib\multithreading.py", line 84, in check_and_raise_error
raise error[1].with_traceback(error[2])
File "C:\Users\yuyup\faceswap\lib\multithreading.py", line 37, in run
self.
target(*self.args, **self.kwargs)
File "C:\Users\yuyup\faceswap\plugins\extract\_base.py", line 405, in _thread_process
batch = function(batch)
File "C:\Users\yuyup\faceswap\plugins\extract\align\fan.py", line 47, in process_input
faces = self.crop(batch)
File "C:\Users\yuyup\faceswap\plugins\extract\align\fan.py", line 88, in crop
new_img = np.empty(new_dim, dtype=np.uint8)
MemoryError
Exception occured trying to retrieve sysinfo: [WinError 1455] The paging file is too small for this operation to complete

User avatar
bryanlyon
Site Admin
Posts: 793
Joined: Fri Jul 12, 2019 12:49 am
Answers: 44
Location: San Francisco
Has thanked: 4 times
Been thanked: 218 times
Contact:

Re: Error when extracting

Post by bryanlyon »

MemoryError
Exception occured trying to retrieve sysinfo: [WinError 1455] The paging file is too small for this operation to complete

The problem is that you don't have enough RAM for the operation. We're currently tracking some reports of increased RAM usage on some situations and if you could post your crash log we can look into this more. You can try different options or split your extract to see if you can reduce the RAM needed so that it completes successfully..

User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 622 times

Re: Error when extracting

Post by torzdf »

There was a memory leak in extract. Latest code should have fixed this.

My word is final

Locked