Help Please! AttributeError: 'Model' object has no attribute 'distribute_strategy'

[Ethanfox]

Hi there,

I'm completely new to this fascinating process and am trying to make my own video, I've been reading through all the forums to try and find a solution but am stuck.

When I Train, I immediately get an error - AttributeError: 'Model' object has no attribute 'distribute_strategy' - I'm assuming I've done something stupid as I can't find anything online about this error.

Totally newbie to this so please go easy on me!

Many thanks in advance,

Ethan

Code: Select all

12/20/2020 11:09:51 CRITICAL Error caught! Exiting...
12/20/2020 11:09:51 ERROR    Caught exception in thread: '_training_0'
12/20/2020 11:09:53 ERROR    Got Exception on main handler:
Traceback (most recent call last):
File "C:\Users\ethan\faceswap\lib\cli\launcher.py", line 182, in execute_script
process.process()
File "C:\Users\ethan\faceswap\scripts\train.py", line 170, in process
self._end_thread(thread, err)
File "C:\Users\ethan\faceswap\scripts\train.py", line 210, in _end_thread
thread.join()
File "C:\Users\ethan\faceswap\lib\multithreading.py", line 121, in join
raise thread.err[1].with_traceback(thread.err[2])
File "C:\Users\ethan\faceswap\lib\multithreading.py", line 37, in run
self._target(*self._args, **self._kwargs)
File "C:\Users\ethan\faceswap\scripts\train.py", line 232, in _training
raise err
File "C:\Users\ethan\faceswap\scripts\train.py", line 221, in _training
trainer = self._load_trainer(model)
File "C:\Users\ethan\faceswap\scripts\train.py", line 267, in _load_trainer
trainer = trainer(model,
File "C:\Users\ethan\faceswap\plugins\train\trainer\original.py", line 10, in __init__
super().__init__(*args, **kwargs)
File "C:\Users\ethan\faceswap\plugins\train\trainer\_base.py", line 88, in __init__
self._tensorboard = self._set_tensorboard()
File "C:\Users\ethan\faceswap\plugins\train\trainer\_base.py", line 191, in _set_tensorboard
tensorboard.set_model(self._model.model)
File "C:\Users\ethan\MiniConda3\envs\faceswap\lib\site-packages\tensorflow\python\keras\callbacks.py", line 1969, in set_model
self._log_write_dir = self._get_log_write_dir()
File "C:\Users\ethan\MiniConda3\envs\faceswap\lib\site-packages\tensorflow\python\keras\callbacks.py", line 2000, in _get_log_write_dir
self.model.distribute_strategy)
AttributeError: 'Model' object has no attribute 'distribute_strategy'

[torzdf]

Can you please post the output of your system info:

GUI Users: Go to Help -> Output system information

CLI Users: From inside your virtual environment, inside your faceswap folder, run:

Code: Select all

python -c "from lib.sysinfo import sysinfo ;  print(sysinfo)"

[Ethanfox]

Many thanks for your quick reply...

Code: Select all

============ System Information ============
encoding:            cp1252
git_branch:          master
git_commits:         399df98 jobs.alignments - fix memory leak on sparse alignments extract
gpu_cuda:            No global version found. Check Conda packages for Conda Cuda
gpu_cudnn:           No global version found. Check Conda packages for Conda cuDNN
gpu_devices:         GPU_0: Advanced Micro Devices, Inc. - Baffin (experimental)
gpu_devices_active:  GPU_0
gpu_driver:          ['3188.4']
gpu_vram:            GPU_0: 4096MB
os_machine:          AMD64
os_platform:         Windows-10-10.0.18362-SP0
os_release:          10
py_command:          C:\Users\ethan\faceswap/faceswap.py gui
py_conda_version:    conda 4.9.2
py_implementation:   CPython
py_version:          3.8.5
py_virtual_env:      True
sys_cores:           6
sys_processor:       Intel64 Family 6 Model 63 Stepping 2, GenuineIntel
sys_ram:             Total: 65448MB, Available: 60180MB, Used: 5268MB, Free: 60180MB

=============== Pip Packages ===============
absl-py @ file:///tmp/build/80754af9/absl-py_1607439979954/work
aiohttp @ file:///C:/ci/aiohttp_1607109697839/work
astunparse==1.6.3
async-timeout==3.0.1
attrs @ file:///tmp/build/80754af9/attrs_1604765588209/work
blinker==1.4
brotlipy==0.7.0
cachetools @ file:///tmp/build/80754af9/cachetools_1607706694405/work
certifi==2020.12.5
cffi @ file:///C:/ci/cffi_1606255208697/work
chardet @ file:///C:/ci/chardet_1605303225733/work
click==7.1.2
cryptography @ file:///C:/ci/cryptography_1607637849569/work
cycler==0.10.0
enum34==1.1.10
fastcluster==1.1.26
ffmpy==0.2.3
gast @ file:///tmp/build/80754af9/gast_1597433534803/work
google-auth @ file:///tmp/build/80754af9/google-auth_1607969906642/work
google-auth-oauthlib @ file:///tmp/build/80754af9/google-auth-oauthlib_1603929124518/work
google-pasta==0.2.0
grpcio @ file:///C:/ci/grpcio_1597406462198/work
h5py==2.10.0
idna @ file:///tmp/build/80754af9/idna_1593446292537/work
imageio @ file:///tmp/build/80754af9/imageio_1594161405741/work
imageio-ffmpeg @ file:///home/conda/feedstock_root/build_artifacts/imageio-ffmpeg_1589202782679/work
importlib-metadata @ file:///tmp/build/80754af9/importlib-metadata_1602276842396/work
joblib @ file:///tmp/build/80754af9/joblib_1607970656719/work
Keras==2.2.4
Keras-Applications @ file:///tmp/build/80754af9/keras-applications_1594366238411/work
Keras-Preprocessing==1.1.0
kiwisolver @ file:///C:/ci/kiwisolver_1604014703538/work
Markdown @ file:///C:/ci/markdown_1605111189761/work
matplotlib @ file:///C:/ci/matplotlib-base_1592837548929/work
mkl-fft==1.2.0
mkl-random==1.1.1
mkl-service==2.3.0
multidict @ file:///C:/ci/multidict_1600456481656/work
numpy @ file:///C:/ci/numpy_and_numpy_base_1603466732592/work
nvidia-ml-py3 @ git+https://github.com/deepfakes/nvidia-ml-py3.git@6fc29ac84b32bad877f078cb4a777c1548a00bf6
oauthlib==3.1.0
olefile==0.46
opencv-python==4.4.0.46
opt-einsum==3.1.0
pathlib==1.0.1
Pillow @ file:///C:/ci/pillow_1603823068645/work
plaidml==0.7.0
plaidml-keras==0.7.0
protobuf==3.13.0
psutil @ file:///C:/ci/psutil_1598370330503/work
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser @ file:///tmp/build/80754af9/pycparser_1594388511720/work
PyJWT==1.7.1
pyOpenSSL @ file:///tmp/build/80754af9/pyopenssl_1608057966937/work
pyparsing==2.4.7
pyreadline==2.1
PySocks @ file:///C:/ci/pysocks_1605287845585/work
python-dateutil==2.8.1
pywin32==227
PyYAML==5.3.1
requests @ file:///tmp/build/80754af9/requests_1608241421344/work
requests-oauthlib==1.3.0
rsa @ file:///tmp/build/80754af9/rsa_1596998415516/work
scikit-learn @ file:///C:/ci/scikit-learn_1598377018496/work
scipy @ file:///C:/ci/scipy_1604596260408/work
sip==4.19.13
six @ file:///C:/ci/six_1605187374963/work
tensorboard @ file:///home/builder/ktietz/conda/conda-bld/tensorboard_1604313476433/work/tmp_pip_dir
tensorboard-plugin-wit==1.6.0
tensorflow==2.3.0
tensorflow-estimator @ file:///tmp/build/80754af9/tensorflow-estimator_1599136169057/work/whl_temp/tensorflow_estimator-2.3.0-py2.py3-none-any.whl
termcolor==1.1.0
threadpoolctl @ file:///tmp/tmp9twdgx9k/threadpoolctl-2.1.0-py3-none-any.whl
tornado @ file:///C:/ci/tornado_1606942392901/work
tqdm @ file:///tmp/build/80754af9/tqdm_1607369919789/work
typing-extensions @ file:///tmp/build/80754af9/typing_extensions_1598376058250/work
urllib3 @ file:///tmp/build/80754af9/urllib3_1606938623459/work
Werkzeug==1.0.1
win-inet-pton @ file:///C:/ci/win_inet_pton_1605306167264/work
wincertstore==0.2
wrapt==1.12.1
yarl @ file:///C:/ci/yarl_1598045274898/work
zipp @ file:///tmp/build/80754af9/zipp_1604001098328/work

============== Conda Packages ==============
# packages in environment at C:\Users\ethan\MiniConda3\envs\faceswap:
#
# Name                    Version                   Build  Channel
_tflow_select             2.3.0                     eigen  

absl-py                   0.11.0             pyhd3eb1b0_1  

aiohttp                   3.7.3            py38h2bbff1b_1  

astunparse                1.6.3                      py_0  

async-timeout             3.0.1                    py38_0  

attrs                     20.3.0             pyhd3eb1b0_0  

blas                      1.0                         mkl  

blinker                   1.4                      py38_0  

brotlipy                  0.7.0           py38h2bbff1b_1003  

ca-certificates           2020.12.8            haa95532_0  

cachetools                4.2.0              pyhd3eb1b0_0  

certifi                   2020.12.5        py38haa95532_0  

cffi                      1.14.4           py38hcd4344a_0  

chardet                   3.0.4           py38haa95532_1003  

click                     7.1.2                      py_0  

cryptography              3.3.1            py38hcd4344a_0  

cycler                    0.10.0                   py38_0  

enum34                    1.1.10                   pypi_0    pypi
fastcluster               1.1.26           py38h251f6bf_2    conda-forge
ffmpeg                    4.3.1                ha925a31_0    conda-forge
ffmpy                     0.2.3                    pypi_0    pypi
freetype                  2.10.4               hd328e21_0  

gast                      0.4.0                      py_0  

git                       2.23.0               h6bb4b03_0  

google-auth               1.24.0             pyhd3eb1b0_0  

google-auth-oauthlib      0.4.2              pyhd3eb1b0_2  

google-pasta              0.2.0                      py_0  

grpcio                    1.31.0           py38he7da953_0  

h5py                      2.10.0           py38h5e291fa_0  

hdf5                      1.10.4               h7ebc959_0  

icc_rt                    2019.0.0             h0cc432a_1  

icu                       58.2                 ha925a31_3  

idna                      2.10                       py_0  

imageio                   2.9.0                      py_0  

imageio-ffmpeg            0.4.2                      py_0    conda-forge
importlib-metadata        2.0.0                      py_1  

intel-openmp              2020.2                      254  

joblib                    1.0.0              pyhd3eb1b0_0  

jpeg                      9b                   hb83a4c4_2  

keras                     2.2.4                    pypi_0    pypi
keras-applications        1.0.8                      py_1  

keras-preprocessing       1.1.0                      py_1  

kiwisolver                1.3.0            py38hd77b12b_0  

libpng                    1.6.37               h2a8f88b_0  

libprotobuf               3.13.0.1             h200bbdf_0  

libtiff                   4.1.0                h56a325e_1  

lz4-c                     1.9.2                hf4a77e7_3  

markdown                  3.3.3            py38haa95532_0  

matplotlib                3.2.2                         0  

matplotlib-base           3.2.2            py38h64f37c6_0  

mkl                       2020.2                      256  

mkl-service               2.3.0            py38h196d8e1_0  

mkl_fft                   1.2.0            py38h45dec08_0  

mkl_random                1.1.1            py38h47e9c7a_0  

multidict                 4.7.6            py38he774522_1  

numpy                     1.19.2           py38hadc3359_0  

numpy-base                1.19.2           py38ha3acd2a_0  

nvidia-ml-py3             7.352.1                  pypi_0    pypi
oauthlib                  3.1.0                      py_0  

olefile                   0.46                       py_0  

opencv-python             4.4.0.46                 pypi_0    pypi
openssl                   1.1.1i               h2bbff1b_0  

opt_einsum                3.1.0                      py_0  

pathlib                   1.0.1                      py_1  

pillow                    8.0.1            py38h4fa10fc_0  

pip                       20.3.3           py38haa95532_0  

plaidml                   0.7.0                    pypi_0    pypi
plaidml-keras             0.7.0                    pypi_0    pypi
protobuf                  3.13.0.1         py38ha925a31_1  

psutil                    5.7.2            py38he774522_0  

pyasn1                    0.4.8                      py_0  

pyasn1-modules            0.2.8                      py_0  

pycparser                 2.20                       py_2  

pyjwt                     1.7.1                    py38_0  

pyopenssl                 20.0.1             pyhd3eb1b0_1  

pyparsing                 2.4.7                      py_0  

pyqt                      5.9.2            py38ha925a31_4  

pyreadline                2.1                      py38_1  

pysocks                   1.7.1            py38haa95532_0  

python                    3.8.5                h5fd99cc_1  

python-dateutil           2.8.1                      py_0  

python_abi                3.8                      1_cp38    conda-forge
pywin32                   227              py38he774522_1  

pyyaml                    5.3.1                    pypi_0    pypi
qt                        5.9.7            vc14h73c81de_0  

requests                  2.25.1             pyhd3eb1b0_0  

requests-oauthlib         1.3.0                      py_0  

rsa                       4.6                        py_0  

scikit-learn              0.23.2           py38h47e9c7a_0  

scipy                     1.5.2            py38h14eb087_0  

setuptools                51.0.0           py38haa95532_2  

sip                       4.19.13          py38ha925a31_0  

six                       1.15.0           py38haa95532_0  

sqlite                    3.33.0               h2a8f88b_0  

tensorboard               2.3.0              pyh4dce500_0  

tensorboard-plugin-wit    1.6.0                      py_0  

tensorflow                2.3.0           mkl_py38h8c0d9a2_0  

tensorflow-base           2.3.0           eigen_py38h75a453f_0  

tensorflow-estimator      2.3.0              pyheb71bc4_0  

termcolor                 1.1.0                    py38_1  

threadpoolctl             2.1.0              pyh5ca1d4c_0  

tk                        8.6.10               he774522_0  

tornado                   6.1              py38h2bbff1b_0  

tqdm                      4.54.1             pyhd3eb1b0_0  

typing-extensions         3.7.4.3                       0  

typing_extensions         3.7.4.3                    py_0  

urllib3                   1.26.2             pyhd3eb1b0_0  

vc                        14.2                 h21ff451_1  

vs2015_runtime            14.27.29016          h5e58377_2  

werkzeug                  1.0.1                      py_0  

wheel                     0.36.2             pyhd3eb1b0_0  

win_inet_pton             1.1.0            py38haa95532_0  

wincertstore              0.2                      py38_0  

wrapt                     1.12.1           py38he774522_1  

xz                        5.2.5                h62dcd97_0  

yarl                      1.5.1            py38he774522_0  

zipp                      3.4.0              pyhd3eb1b0_0  

zlib                      1.2.11               h62dcd97_4  

zstd                      1.4.5                h04227a9_0  

================= Configs ==================
--------- .faceswap ---------
backend:                  amd

--------- convert.ini ---------

[color.color_transfer]
clip:                     True
preserve_paper:           True

[color.manual_balance]
colorspace:               HSV
balance_1:                0.0
balance_2:                0.0
balance_3:                0.0
contrast:                 0.0
brightness:               0.0

[color.match_hist]
threshold:                99.0

[mask.box_blend]
type:                     gaussian
distance:                 11.0
radius:                   5.0
passes:                   1

[mask.mask_blend]
type:                     normalized
kernel_size:              3
passes:                   4
threshold:                4
erosion:                  0.0

[scaling.sharpen]
method:                   none
amount:                   150
radius:                   0.3
threshold:                5.0

[writer.ffmpeg]
container:                mp4
codec:                    libx264
crf:                      23
preset:                   medium
tune:                     none
profile:                  auto
level:                    auto
skip_mux:                 False

[writer.gif]
fps:                      25
loop:                     0
palettesize:              256
subrectangles:            False

[writer.opencv]
format:                   png
draw_transparent:         False
jpg_quality:              75
png_compress_level:       3

[writer.pillow]
format:                   png
draw_transparent:         False
optimize:                 False
gif_interlace:            True
jpg_quality:              75
png_compress_level:       3
tif_compression:          tiff_deflate

--------- extract.ini ---------

[global]
allow_growth:             False

[align.fan]
batch-size:               12

[detect.cv2_dnn]
confidence:               50

[detect.mtcnn]
minsize:                  20
threshold_1:              0.6
threshold_2:              0.7
threshold_3:              0.7
scalefactor:              0.709
batch-size:               8

[detect.s3fd]
confidence:               70
batch-size:               4

[mask.unet_dfl]
batch-size:               8

[mask.vgg_clear]
batch-size:               6

[mask.vgg_obstructed]
batch-size:               2

--------- gui.ini ---------

[global]
fullscreen:               False
tab:                      extract
options_panel_width:      30
console_panel_height:     20
icon_size:                14
font:                     default
font_size:                9
autosave_last_session:    prompt
timeout:                  120
auto_load_model_stats:    True

--------- train.ini ---------

[global]
centering:                legacy
coverage:                 68.75
icnr_init:                False
conv_aware_init:          False
optimizer:                adam
learning_rate:            5e-05
reflect_padding:          False
allow_growth:             False
mixed_precision:          False
convert_batchsize:        16

[global.loss]
loss_function:            ssim
mask_loss_function:       mse
l2_reg_term:              100
eye_multiplier:           3
mouth_multiplier:         2
penalized_mask_loss:      True
mask_type:                extended
mask_blur_kernel:         3
mask_threshold:           4
learn_mask:               False

[model.dfaker]
output_size:              128

[model.dfl_h128]
lowmem:                   False

[model.dfl_sae]
input_size:               128
clipnorm:                 True
architecture:             df
autoencoder_dims:         0
encoder_dims:             42
decoder_dims:             21
multiscale_decoder:       False

[model.dlight]
features:                 best
details:                  good
output_size:              256

[model.original]
lowmem:                   False

[model.realface]
input_size:               64
output_size:              128
dense_nodes:              1536
complexity_encoder:       128
complexity_decoder:       512

[model.unbalanced]
input_size:               128
lowmem:                   False
clipnorm:                 True
nodes:                    1024
complexity_encoder:       128
complexity_decoder_a:     384
complexity_decoder_b:     512

[model.villain]
lowmem:                   False

[trainer.original]
preview_images:           14
zoom_amount:              5
rotation_range:           10
shift_range:              5
flip_chance:              50
disable_warp:             False
color_lightness:          30
color_ab:                 8
color_clahe_chance:       50
color_clahe_max_size:     4

[torzdf]

Ok. This may be an issue with AMD backend version on latest update. I will need to look into this in the next couple of days

[Ethanfox]

Ah ok, so I haven't done something stupid? Phew!

Thanks so much for the support and all your hard work. It's a fascinating area.

All the best,

Ethan

[torzdf]

No problem.

If you could hit the "Generate" button and post the command that is generated (that causes this error), and re-post here, that would also be useful.

[Ethanfox]

C:\Users\ethan\MiniConda3\envs\faceswap\python.exe C:\Users\ethan\faceswap\faceswap.py train -A "C:/Dropbox/My PC (MASTER)/Downloads/MY FACE" -ala C:/Users/ethan/Desktop/data_dst_alignments.fsa -B "C:/Dropbox/My PC (MASTER)/Downloads/SEAN FACE" -alb C:/Users/ethan/Desktop/data_src_alignments.fsa -m "C:/Dropbox/My PC (MASTER)/Downloads/MODEL" -t original -bs 30 -it 1000000 -s 250 -ss 25000 -tia "C:/Dropbox/My PC (MASTER)/Downloads/MY FACE" -tib "C:/Dropbox/My PC (MASTER)/Downloads/SEAN FACE" -to "C:/Dropbox/My PC (MASTER)/Downloads/TIMELAPSE" -ps 100 -L INFO

[awemazeinc]

I ran into this same issue, and looked high and low for a solution. What I ended up doing is download v1 of faceswap to do my training, it works perfectly. Any extracting, converting, etc., I still do in v2.

[Hobojones]

I'm a newbie too
Used for about 3 weeks and done a few simple videos but over the weekend getting the same error when training

I'm on amd too
Tried fresh install of Windows and still getting error but will train if exclude gpu?

[lightofhonor]

Having the same issue and error.

Code: Select all

C:\Users\light\MiniConda3\envs\faceswap\python.exe C:\Users\light\faceswap\faceswap.py train -A D:/Output2 -ala C:/Users/light/Downloads/videoplayback_alignments.fsa -B D:/Output -alb "C:/Users/light/Downloads/2014-07-26 04.05.fsa" -m D:/Output4 -t original -bs 16 -it 1000000 -s 250 -ss 25000 -ps 100 -L INFO

[torzdf]

I plan to investigate this in the coming days, so hold tight.

[MikeRediv]

Same issue on an AMD RX 470 4GB. Worked fine two weeks ago. Thank you for looking into it!

[torzdf]

Ok, this should be fixed in the latest version.

It seems that AMD backend is no longer compatible with Tensorboard logging above Tensorflow version 2.2.

As this is a dependency regression, it is best that you delete your Faceswap folder + re-run the installer. This should get things working again.