Apple Silicon: ModuleNotFoundError: No module named 'decorator'

If training is failing to start, and you are not receiving an error message telling you what to do, tell us about it here


Forum rules

Read the FAQs and search the forum before posting a new topic.

This forum is for reporting errors with the Training process. If you want to get tips, or better understand the Training process, then you should look in the Training Discussion forum.

Please mark any answers that fixed your problems so others can find the solutions.

Locked
User avatar
mrkrong
Posts: 2
Joined: Wed Sep 09, 2020 1:56 am

Apple Silicon: ModuleNotFoundError: No module named 'decorator'

Post by mrkrong »

Code: Select all

09/06/2022 15:42:37 MainProcess     MainThread                     logger          log_setup                      INFO     Log level set to: INFO
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    Initializing AppleSiliconStats
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    Initializing Metal for Apple Silicon SoC.
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    GPU Device count: 1
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    Active GPU Devices: [0]
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    GPU Handles found: [0]
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    GPU Driver: Not Applicable
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    GPU Devices: ['/physical_device:GPU:0']
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    SoC RAM: [16384]
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    SoC RAM free: [6387]
09/06/2022 15:42:37 MainProcess     MainThread                     _base           _log                           DEBUG    Initialized AppleSiliconStats
09/06/2022 15:42:37 MainProcess     MainThread                     launcher        _configure_backend             DEBUG    Executing: train. PID: 18235
09/06/2022 15:42:37 MainProcess     MainThread                     launcher        _test_for_tf_version           DEBUG    Installed Tensorflow Version: 2.9
09/06/2022 15:42:37 MainProcess     MainThread                     __init__        wrapper                        DEBUG    matplotlib data path: /Users/aaronlee/miniforge3/envs/faceswap/lib/python3.9/site-packages/matplotlib/mpl-data
09/06/2022 15:42:37 MainProcess     MainThread                     __init__        wrapper                        DEBUG    CONFIGDIR=/Users/aaronlee/.matplotlib
09/06/2022 15:42:37 MainProcess     MainThread                     __init__        <module>                       DEBUG    interactive is False
09/06/2022 15:42:37 MainProcess     MainThread                     __init__        <module>                       DEBUG    platform is darwin
09/06/2022 15:42:37 MainProcess     MainThread                     __init__        <module>                       DEBUG    loaded modules: ['sys', 'builtins', '_frozen_importlib', '_imp', '_thread', '_warnings', '_weakref', '_io', 'marshal', 'posix', '_frozen_importlib_external', 'time', 'zipimport', '_codecs', 'codecs', 'encodings.aliases', 'encodings', 'encodings.utf_8', '_signal', 'encodings.latin_1', '_abc', 'abc', 'io', '__main__', '_stat', 'stat', '_collections_abc', 'genericpath', 'posixpath', 'os.path', 'os', '_sitebuiltins', '_locale', '_bootlocale', '_distutils_hack', 'types', 'importlib._bootstrap', 'importlib._bootstrap_external', 'warnings', 'importlib', 'importlib.machinery', '_heapq', 'heapq', 'itertools', 'keyword', '_operator', 'operator', 'reprlib', '_collections', 'collections', 'collections.abc', '_functools', 'functools', 'contextlib', 'enum', '_sre', 'sre_constants', 'sre_parse', 'sre_compile', 'copyreg', 're', 'typing.io', 'typing.re', 'typing', 'importlib.abc', 'importlib.util', 'google', 'mpl_toolkits', 'site', 'gettext', 'lib', 'lib.cli', 'argparse', 'token', 'tokenize', 'linecache', 'traceback', '_weakrefset', 'weakref', '_string', 'string', 'threading', 'atexit', 'logging', 'textwrap', '_json', 'json.scanner', 'json.decoder', 'json.encoder', 'json', '_tkinter', 'tkinter.constants', 'tkinter', 'urllib', 'binascii', 'fnmatch', 'errno', 'zlib', '_compression', '_bz2', 'bz2', '_lzma', 'lzma', 'pwd', 'grp', 'shutil', '_struct', 'struct', 'zipfile', 'signal', 'multiprocessing.process', '_compat_pickle', '_pickle', 'pickle', '_socket', 'math', 'select', 'selectors', 'array', 'socket', 'multiprocessing.reduction', 'multiprocessing.context', '__mp_main__', 'multiprocessing', 'numpy._globals', 'numpy.__config__', 'numpy._distributor_init', '__future__', 'numpy._version', 'numpy.version', '_datetime', 'datetime', 'numpy.core._multiarray_umath', 'numpy.compat._inspect', 'ntpath', 'urllib.parse', 'pathlib', 'numpy.compat.py3k', 'numpy.compat', 'numpy.core.overrides', 'numpy.core.multiarray', 'numpy.core.umath', 'numbers', 'numpy.core._string_helpers', 'numpy.core._dtype', 'numpy.core._type_aliases', 'numpy.core.numerictypes', 'numpy.core._exceptions', 'numpy.core._methods', 'numpy.core.fromnumeric', 'numpy.core.shape_base', 'numpy.core._ufunc_config', 'numpy.core.arrayprint', 'numpy.core._asarray', 'numpy.core.numeric', 'numpy.core.defchararray', 'numpy.core.records', 'numpy.core.memmap', 'numpy.core.function_base', 'numpy.core._machar', 'numpy.core.getlimits', 'numpy.core.einsumfunc', 'numpy.core._multiarray_tests', 'numpy.core._add_newdocs', '_posixsubprocess', 'subprocess', 'platform', 'numpy.core._add_newdocs_scalars', 'numpy.core._dtype_ctypes', '_ast', 'ast', '_ctypes', 'ctypes._endian', 'ctypes', 'numpy.core._internal', 'numpy._pytesttester', 'numpy.core', 'numpy.lib.mixins', 'numpy.lib.ufunclike', 'numpy.lib.type_check', 'numpy.lib.scimath', 'numpy.lib.stride_tricks', 'numpy.lib.twodim_base', 'numpy.linalg._umath_linalg', 'numpy.linalg.linalg', 'numpy.linalg', 'numpy.matrixlib.defmatrix', 'numpy.matrixlib', 'numpy.lib.histograms', 'numpy.lib.function_base', 'numpy.lib.index_tricks', 'numpy.lib.nanfunctions', 'numpy.lib.shape_base', 'numpy.lib.polynomial', 'numpy.lib.utils', 'numpy.lib.arraysetops', 'numpy.lib.format', 'numpy.lib._datasource', 'numpy.lib._iotools', 'numpy.lib.npyio', 'numpy.lib.arrayterator', 'numpy.lib.arraypad', 'numpy.lib._version', 'numpy.lib', 'numpy.fft._pocketfft_internal', 'numpy.fft._pocketfft', 'numpy.fft.helper', 'numpy.fft', 'numpy.polynomial.polyutils', 'numpy.polynomial._polybase', 'numpy.polynomial.polynomial', 'numpy.polynomial.chebyshev', 'numpy.polynomial.legendre', 'numpy.polynomial.hermite', 'numpy.polynomial.hermite_e', 'numpy.polynomial.laguerre', 'numpy.polynomial', 'cython_runtime', '_cython_0_29_30', 'numpy.random._common', 'base64', '_hashlib', '_blake2', 'hashlib', 'hmac', '_bisect', 'bisect', '_random', '_sha512', 'random', 'secrets', 'numpy.random.bit_generator', 'numpy.random._bounded_integers', 'numpy.random._mt19937', 'numpy.random.mtrand', 'numpy.random._philox', 'numpy.random._pcg64', 'numpy.random._sfc64', 'numpy.random._generator', 'numpy.random._pickle', 'numpy.random', 'numpy.ctypeslib', '_opcode', 'opcode', 'dis', 'inspect', 'numpy.ma.core', 'numpy.ma.extras', 'numpy.ma', 'numpy', 'tqdm._monitor', 'tqdm._tqdm_pandas', 'unicodedata', 'tqdm.utils', 'tqdm.std', 'tqdm._dist_ver', 'tqdm.version', 'tqdm.cli', 'tqdm.gui', 'tqdm', 'lib.utils', 'lib.gpu_stats._base', 'psutil._common', 'psutil._compat', 'glob', 'psutil._psposix', 'psutil._psutil_osx', 'psutil._psutil_posix', 'psutil._psosx', 'psutil', 'setuptools._distutils', 'distutils.debug', 'distutils.errors', 'email', 'getopt', 'distutils.fancy_getopt', 'sysconfig', 'distutils.dep_util', 'distutils.log', 'distutils.spawn', 'distutils.util', 'distutils.dist', 'distutils.dir_util', 'distutils.file_util', 'distutils.archive_util', 'distutils.cmd', 'configparser', 'distutils.config', 'distutils.extension', 'distutils.core', '_distutils_hack.override', 'setuptools._deprecation_warning', 'pkgutil', 'xml', 'xml.parsers', 'pyexpat.errors', 'pyexpat.model', 'pyexpat', 'xml.parsers.expat.model', 'xml.parsers.expat.errors', 'xml.parsers.expat', 'plistlib', 'email.errors', 'email.quoprimime', 'email.base64mime', 'quopri', 'email.encoders', 'email.charset', 'email.header', 'locale', 'calendar', 'email._parseaddr', 'email.utils', 'email._policybase', 'email.feedparser', 'email.parser', 'tempfile', 'pkg_resources.extern', 'pkg_resources._vendor', 'pkg_resources._vendor.jaraco', 'pkg_resources.extern.jaraco', 'importlib._common', 'importlib.resources', '_queue', 'queue', 'pkg_resources._vendor.more_itertools.recipes', 'pkg_resources._vendor.more_itertools.more', 'pkg_resources._vendor.more_itertools', 'pkg_resources.extern.more_itertools', 'pkg_resources.extern.jaraco.functools', 'pkg_resources.extern.jaraco.context', 'pkg_resources.extern.jaraco.text', 'pkg_resources._vendor.appdirs', 'pkg_resources.extern.appdirs', 'pkg_resources._vendor.packaging.__about__', 'pkg_resources._vendor.packaging', 'pkg_resources.extern.packaging', 'pkg_resources.extern.packaging._structures', 'pkg_resources.extern.packaging.version', 'pkg_resources._vendor.packaging._manylinux', 'pkg_resources._vendor.packaging._musllinux', 'pkg_resources.extern.packaging.tags', 'pkg_resources.extern.packaging.utils', 'pkg_resources.extern.packaging.specifiers', 'pkg_resources._vendor.pyparsing.util', 'pkg_resources._vendor.pyparsing.unicode', 'pkg_resources._vendor.pyparsing.exceptions', 'pkg_resources._vendor.pyparsing.actions', 'copy', 'pprint', 'pkg_resources._vendor.pyparsing.results', 'pkg_resources._vendor.pyparsing.core', 'html.entities', 'html', 'pkg_resources._vendor.pyparsing.helpers', 'pkg_resources._vendor.pyparsing.testing', 'pkg_resources._vendor.pyparsing.common', 'pkg_resources._vendor.pyparsing', 'pkg_resources.extern.pyparsing', 'pkg_resources.extern.packaging.markers', 'pkg_resources.extern.packaging.requirements', '_osx_support', '_sysconfigdata__darwin_darwin', 'pkg_resources', 'setuptools.version', 'distutils.filelist', 'setuptools.monkey', 'setuptools.extension', 'distutils.command', 'setuptools.extern', 'setuptools._vendor', 'setuptools._vendor.packaging.__about__', 'setuptools._vendor.packaging', 'setuptools.extern.packaging', 'setuptools._vendor.ordered_set', 'setuptools.extern.ordered_set', 'setuptools._vendor.more_itertools.recipes', 'setuptools._vendor.more_itertools.more', 'setuptools._vendor.more_itertools', 'setuptools.extern.more_itertools', '_csv', 'csv', 'setuptools._vendor.zipp', 'uu', 'email._encoded_words', 'email.iterators', 'email.message', 'setuptools._vendor.importlib_metadata._functools', 'setuptools._vendor.importlib_metadata._text', 'setuptools._vendor.importlib_metadata._adapters', 'setuptools._vendor.importlib_metadata._compat', 'setuptools._vendor.importlib_metadata._meta', 'setuptools._vendor.importlib_metadata._collections', 'setuptools._vendor.importlib_metadata._itertools', 'setuptools._vendor.importlib_metadata', 'setuptools.extern.importlib_metadata', 'zipp', 'importlib_metadata._functools', 'importlib_metadata._text', 'importlib_metadata._adapters', 'importlib_metadata._compat', 'importlib_metadata._meta', 'importlib_metadata._collections', 'importlib_metadata._itertools', 'importlib_metadata', 'setuptools._importlib', 'distutils.command.bdist', 'setuptools.command', 'setuptools.windows_support', 'setuptools._vendor.pyparsing.util', 'setuptools._vendor.pyparsing.unicode', 'setuptools._vendor.pyparsing.exceptions', 'setuptools._vendor.pyparsing.actions', 'setuptools._vendor.pyparsing.results', 'setuptools._vendor.pyparsing.core', 'setuptools._vendor.pyparsing.helpers', 'setuptools._vendor.pyparsing.testing', 'setuptools._vendor.pyparsing.common', 'setuptools._vendor.pyparsing', 'setuptools.extern.pyparsing', 'setuptools._vendor.packaging._manylinux', 'setuptools._vendor.packaging._musllinux', 'setuptools.extern.packaging.tags', 'setuptools.extern.packaging._structures', 'setuptools.extern.packaging.version', 'setuptools.extern.packaging.utils', 'setuptools.extern.packaging.specifiers', 'setuptools.extern.packaging.markers', 'setuptools.extern.packaging.requirements', 'setuptools._path', 'setuptools.config.expand', 'setuptools.config.setupcfg', 'setuptools.config', 'setuptools.errors', 'email._header_value_parser', 'email.headerregistry', 'setuptools.config._apply_pyprojecttoml', 'setuptools.config.pyprojecttoml', 'setuptools.discovery', 'setuptools._vendor.jaraco', 'setuptools.extern.jaraco', 'setuptools.extern.jaraco.functools', 'setuptools.extern.jaraco.context', 'setuptools.extern.jaraco.text', 'setuptools._reqs', 'setuptools._itertools', 'setuptools._entry_points', 'setuptools.dist', 'setuptools.py34compat', 'setuptools._imp', 'setuptools.depends', 'setuptools.logging', 'setuptools.msvc', 'setuptools', 'distutils', 'tensorflow.python.platform', 'tensorflow.python.platform.build_info', 'tensorflow.python.platform.self_check', 'tensorflow.python._pywrap_tensorflow_internal', 'tensorflow.python.pywrap_tensorflow', 'tensorflow.python.eager', 'gc', 'absl', 'termios', 'getpass', 'timeit', 'fcntl', 'absl.flags._helpers', 'absl.flags._argument_parser', 'absl.flags._exceptions', 'absl.flags._flag', 'xml.dom.domreg', 'xml.dom', 'xml.dom.minicompat', 'xml.dom.NodeFilter', 'xml.dom.xmlbuilder', 'xml.dom.minidom', 'absl.flags._validators_classes', 'absl.flags._flagvalues', 'absl.flags._validators', 'absl.flags._defines', 'absl.flags', 'absl.logging.converter', 'absl.logging', 'six', 'tensorflow.core', 'tensorflow.core.framework', 'google.protobuf', 'google.protobuf.internal', 'google.protobuf.internal._api_implementation', 'google.protobuf.internal.api_implementation', 'google.protobuf.pyext', 'google.protobuf.internal.enum_type_wrapper', 'google.protobuf.message', 'google.protobuf.pyext._message', 'google.protobuf.descriptor', 'google.protobuf.descriptor_database', 'google.protobuf.text_encoding', 'google.protobuf.descriptor_pool', 'google.protobuf.pyext.cpp_message', 'google.protobuf.message_factory', 'google.protobuf.symbol_database', 'google.protobuf.reflection', 'google.protobuf.internal.well_known_types', 'tensorflow.core.framework.tensor_shape_pb2', 'tensorflow.core.framework.types_pb2', 'tensorflow.core.framework.resource_handle_pb2', 'tensorflow.core.framework.tensor_pb2', 'tensorflow.core.framework.attr_value_pb2', 'tensorflow.core.framework.full_type_pb2', 'tensorflow.core.framework.node_def_pb2', 'tensorflow.core.framework.op_def_pb2', 'tensorflow.core.framework.function_pb2', 'tensorflow.core.protobuf', 'tensorflow.core.framework.cost_graph_pb2', 'tensorflow.core.framework.versions_pb2', 'tensorflow.core.framework.graph_pb2', 'tensorflow.core.framework.allocation_description_pb2', 'tensorflow.core.framework.tensor_description_pb2', 'tensorflow.core.framework.step_stats_pb2', 'tensorflow.core.protobuf.cluster_pb2', 'tensorflow.core.protobuf.coordination_config_pb2', 'tensorflow.core.protobuf.debug_pb2', 'tensorflow.core.protobuf.verifier_config_pb2', 'tensorflow.core.protobuf.rewriter_config_pb2', 'tensorflow.core.protobuf.config_pb2', 'tensorflow.python._pywrap_tfe', 'tensorflow.python.pywrap_tfe', 'tensorflow.python.platform._pywrap_tf2', 'tensorflow.python.util', 'tensorflow.python.util.tf_decorator', 'tensorflow.python.util.tf_inspect', 'tensorflow.python.util.tf_export', 'tensorflow.python.tf2', 'tensorflow.python.client', 'tensorflow.python.client._pywrap_tf_session', 'tensorflow.python.client.pywrap_tf_session', 'tensorflow.python.eager.executor', 'tensorflow.core.framework.summary_pb2', 'tensorflow.python.framework', 'tensorflow.core.framework.api_def_pb2', 'tensorflow.python.util.compat', 'tensorflow.python.util.tf_contextlib', 'tensorflow.python.framework.c_api_util', 'tensorflow.python.eager.monitoring', 'tensorflow.python.framework.device_spec', 'tensorflow.python.framework.device', 'tensorflow.python.framework.tfrt_utils', 'tensorflow.python.util.is_in_graph_mode', 'tensorflow.python.platform.tf_logging', 'tensorflow.python.util.decorator_utils', 'tensorflow.tools', 'tensorflow.tools.docs', 'tensorflow.tools.docs.doc_controls', 'tensorflow.python.util.deprecation', 'tensorflow.python.eager.context', 'tensorflow.python.data.experimental.ops', 'tensorflow.core.protobuf.data_service_pb2', 'tensorflow.python.data.util', 'wrapt._wrappers', 'wrapt.wrappers', 'wrapt.arguments', 'wrapt.decorators', 'wrapt.importer', 'wrapt', 'tensorflow.python.util._pywrap_utils', 'tensorflow.python.util._pywrap_nest', 'tensorflow.python.util.nest', 'tensorflow.python.framework.composite_tensor', 'encodings.raw_unicode_escape', 'encodings.unicode_escape', 'google.protobuf.internal.containers', 'google.protobuf.internal.wire_format', 'google.protobuf.internal.encoder', 'google.protobuf.internal.decoder', 'google.protobuf.internal.type_checkers', 'google.protobuf.text_format', 'tensorflow.core.lib', 'tensorflow.core.lib.core', 'tensorflow.core.protobuf.error_codes_pb2', 'tensorflow.core.lib.core.error_codes_pb2', 'tensorflow.python._pywrap_py_exception_registry', 'tensorflow.python.framework.errors_impl', 'tensorflow.python.framework.errors', 'tensorflow.python.eager.core', 'six.moves', 'tensorflow.python.framework._dtypes', 'tensorflow.python.types', 'tensorflow.python.types.doc_typealias', 'tensorflow.python.lib', 'tensorflow.python.lib.core', 'tensorflow.python.lib.core._pywrap_bfloat16', 'tensorflow.python.framework.dtypes', 'cmd', 'bdb', 'codeop', 'code', 'pdb', 'absl.command_name', 'faulthandler', 'absl.app', 'tensorflow.python.util.lazy_loader', 'tensorflow.python.eager.tape', 'tensorflow.python.framework.cpp_shape_inference_pb2', 'tensorflow.python.framework.tensor_conversion_registry', 'typing_extensions', 'tensorflow.python.types.trace', 'tensorflow.python.framework.tensor_shape', 'tensorflow.python.framework.type_spec', 'tensorflow.python.types.internal', 'tensorflow.python.framework.indexed_slices', 'tensorflow.python.framework.registry', 'tensorflow.python.framework.traceable_stack', 'tensorflow.python.framework.versions', 'tensorflow.python.ops', 'tensorflow.python.ops.control_flow_util', 'tensorflow.python.profiler', 'tensorflow.python.profiler.internal', 'tensorflow.python.profiler.internal._pywrap_traceme', 'tensorflow.python.profiler.trace', 'tensorflow.python.types.core', 'tensorflow.python.framework._pywrap_python_api_dispatcher', 'tensorflow.python.util.traceback_utils', 'tensorflow.python.util.type_annotations', 'tensorflow.python.util.dispatch', 'tensorflow.python.util.function_utils', 'tensorflow.python.util.lock_util', 'tensorflow.python.util.memory', 'tensorflow.python.util.object_identity', 'tensorflow.python.util._tf_stack', 'tensorflow.python.util.tf_stack', 'tensorflow.python.framework.ops', 'tensorflow.python.eager.execute', 'tensorflow.python.framework.op_callbacks', 'tensorflow.python.framework.fast_tensor_util', 'tensorflow.python.framework.tensor_util', 'tensorflow.python.framework.constant_op', 'tensorflow.python.framework.common_shapes', 'tensorflow.python.framework.tensor_spec', 'tensorflow.python.framework._op_def_registry', 'tensorflow.python.framework.op_def_registry', 'tensorflow.core.config', 'tensorflow.python.flags_pybind', 'tensorflow.core.config.flags', 'tensorflow.python.framework._op_def_library_pybind', 'tensorflow.python.framework.op_def_library_pybind', 'tensorflow.python.framework.op_def_library', 'tensorflow.python.ops.gen_sparse_ops', 'tensorflow.python.framework.sparse_tensor', 'tensorflow.python.data.util.nest', 'tensorflow.python.compat', 'tensorflow.python.compat.compat', 'tensorflow.python.util._pywrap_determinism', 'tensorflow.python.util._pywrap_tensor_float_32_execution', 'tensorflow.python.framework.config', 'tensorflow.python.ops.gen_array_ops', 'tensorflow.python.ops.gen_math_ops', 'tensorflow.python.ops.array_ops', 'tensorflow.python.ops.gen_control_flow_ops', 'tensorflow.python.ops.gen_data_flow_ops', 'tensorflow.python.ops.gen_list_ops', 'tensorflow.python.ops.handle_data_util', 'tensorflow.python.ops.list_ops', 'tensorflow.python.framework._proto_comparators', 'tensorflow.python.framework.graph_util_impl', 'tensorflow.python.framework.graph_util', 'tensorflow.python.ops.gen_bitwise_ops', 'tensorflow.python.ops.gen_nn_ops', 'tensorflow.python.ops.math_ops', 'tensorflow.python.util.tf_should_use', 'tensorflow.python.ops.tensor_array_ops', 'tensorflow.python.ops.ragged', 'tensorflow.core.protobuf.graph_debug_info_pb2', 'tensorflow.python.framework.error_interpolation', 'tensorflow.python.ops.session_ops', 'tensorflow.python.training', 'tensorflow.python.training.experimental', 'tensorflow.python.training.experimental.mixed_precision_global_state', 'tensorflow.python.client.session', 'tensorflow.python.eager.backprop_util', 'tensorflow.python.framework.composite_tensor_gradient', 'tensorflow.core.protobuf.control_flow_pb2', 'tensorflow.python.ops.gen_functional_ops', 'tensorflow.python.ops.gen_logging_ops', 'tensorflow.python.ops.control_flow_ops', 'tensorflow.python.ops.check_ops', 'tensorflow.python.ops.gen_ragged_conversion_ops', 'tensorflow.python.ops.ragged.ragged_config', 'tensorflow.python.ops.gen_ragged_math_ops', 'tensorflow.python.ops.ragged.ragged_util', 'tensorflow.python.ops.ragged.segment_id_ops', 'tensorflow.python.ops.ragged.row_partition', 'tensorflow.python.ops.ragged.ragged_tensor_value', 'tensorflow.python.ops.ragged.ragged_tensor', 'tensorflow.python.data.util.structure', 'tensorflow.python.ops.gen_experimental_dataset_ops', 'tensorflow.python.data.experimental.ops.compression_ops', 'tensorflow.python.data.experimental.service._pywrap_server_lib', 'tensorflow.python.data.experimental.service._pywrap_utils', 'tensorflow.python.data.ops', 'tensorflow.core.framework.dataset_metadata_pb2', 'tensorflow.core.framework.model_pb2', 'tensorflow.core.framework.dataset_options_pb2', 'tensorflow.python.ops.gen_dataset_ops', 'tensorflow.python.data.ops.optional_ops', 'tensorflow.python.data.util.options', 'tensorflow.python.data.ops.options', 'google.protobuf.any_pb2', 'tensorflow.core.framework.variable_pb2', 'tensorflow.core.protobuf.struct_pb2', 'google.protobuf.wrappers_pb2', 'tensorflow.core.protobuf.trackable_object_graph_pb2', 'tensorflow.core.protobuf.saved_object_graph_pb2', 'tensorflow.core.protobuf.saver_pb2', 'tensorflow.core.protobuf.meta_graph_pb2', 'packaging.__about__', 'packaging', 'packaging._structures', 'packaging.version', 'tensorflow.python.lib.io', '_uuid', 'uuid', 'tensorflow.python.lib.io._pywrap_file_io', 'tensorflow.python.lib.io.file_io', 'tensorflow.python.framework.graph_io', 'tensorflow.python.framework.graph_to_function_def', 'tensorflow.python.framework.auto_control_deps_utils', 'tensorflow.python.ops.gen_resource_variable_ops', 'tensorflow.python.ops.gen_state_ops', 'tensorflow.python.ops.state_ops', 'tensorflow.python.training.tracking', 'tensorflow.python.ops.gen_io_ops', 'tensorflow.python.saved_model', 'tensorflow.python.saved_model.registration.registration', 'tensorflow.python.saved_model.registration', 'tensorflow.python.training.saving', 'tensorflow.python.training.saving.saveable_object', 'tensorflow.python.training.tracking.checkpoint_util', 'tensorflow.python.training.tracking.base', 'tensorflow.python.ops.variables', 'tensorflow.python.ops.resource_variable_ops', 'tensorflow.python.ops.gen_linalg_ops', 'tensorflow.python.ops.linalg_ops_impl', 'tensorflow.python.framework.random_seed', 'tensorflow.python.ops.gen_random_ops', 'tensorflow.python.ops.bitwise_ops', 'tensorflow.python.ops.gen_random_index_shuffle_ops', 'tensorflow.python.ops.gen_stateless_random_ops', 'tensorflow.python.ops.gen_stateless_random_ops_v2', 'tensorflow.python.ops.stateless_random_ops', 'tensorflow.python.ops.random_ops', 'tensorflow.python.ops.init_ops', 'tensorflow.python.ops.variable_scope', 'tensorflow.python.framework.function', 'tensorflow.python.framework.importer', 'tensorflow.python.framework.meta_graph', 'tensorflow.python.lib.io._pywrap_record_io', 'tensorflow.python.lib.io.tf_record', 'tensorflow.python.lib.io.python_io', 'tensorflow.python.ops.gen_parsing_ops', 'tensorflow.python.ops.io_ops', 'tensorflow.python.ops.gen_string_ops', 'tensorflow.python.ops.string_ops', 'tensorflow.python.platform.gfile', 'tensorflow.python.saved_model.pywrap_saved_model.constants', 'tensorflow.python.saved_model.pywrap_saved_model.metrics', 'tensorflow.python.saved_model.pywrap_saved_model', 'tensorflow.python.training.training_util', 'tensorflow.python.training.checkpoint_state_pb2', 'tensorflow.python.training.checkpoint_management', 'tensorflow.python.util._pywrap_checkpoint_reader', 'tensorflow.python.training.py_checkpoint_reader', 'tensorflow.python.distribute', 'tensorflow.python.distribute.parallel_device', 'tensorflow.python._pywrap_parallel_device', 'tensorflow.python.distribute.device_util', 'tensorflow.python.tpu', 'tensorflow.python.tpu.ops', 'tensorflow.python.ops.gen_tpu_ops', 'tensorflow.python.tpu.tpu_function', 'tensorflow.python.tpu.ops.tpu_ops', 'tensorflow.python.distribute.parallel_device.parallel_device', 'tensorflow.core.function', 'tensorflow.core.function.polymorphism', 'tensorflow.core.function.trace_type.default_types', 'tensorflow.core.function.trace_type.util', 'tensorflow.core.function.trace_type.signature_builder', 'tensorflow.core.function.trace_type', 'tensorflow.core.function.polymorphism.type_dispatch', 'tensorflow.core.function.polymorphism.function_cache', 'tensorflow.python.ops.unconnected_gradients', 'tensorflow.python.eager.imperative_grad', 'tensorflow.python.ops.default_gradient', 'tensorflow.python.eager.backprop', 'tensorflow.python.eager.forwardprop_util', 'tensorflow.python.eager.graph_only_ops', 'tensorflow.python.framework.auto_control_deps', 'tensorflow.python.saved_model.save_context', 'tensorflow.python.framework.func_graph', 'tensorflow.python.eager.function_context', 'tensorflow.python.eager.function_spec', 'tensorflow.python.ops.functional_ops', 'tensorflow.python.ops.control_flow_v2_func_graphs', 'tensorflow.python.ops.control_flow_state', 'tensorflow.python.ops.gradients_util', 'tensorflow.python.eager.function', 'tensorflow.python.ops.op_selector', 'tensorflow.python.eager.lift_to_graph', 'tensorflow.python.eager.def_function', 'tensorflow.python.training.tracking.trackable_utils', 'tensorflow.python.training.saving.saveable_object_util', 'tensorflow.python.training.saver', 'tensorflow.python.data.ops.iterator_ops', 'tensorflow.python.lib.core._pywrap_py_func', 'tensorflow.python.ops.gen_script_ops', 'tensorflow.python.ops.script_ops', 'tensorflow.python.data.ops.structured_function', 'tensorflow.python.data.util.random_seed', 'tensorflow.python.data.util.traverse', 'tensorflow.python.framework.smart_cond', 'tensorflow.python.ops.logging_ops', 'tensorflow.python.training.tracking.asset', 'tensorflow.python.saved_model.revived_types', 'tensorflow.python.training.tracking.layer_utils', 'tensorflow.python.training.tracking.data_structures', 'tensorflow.python.training.tracking.autotrackable', 'tensorflow.python.training.tracking.resource', 'tensorflow.python.training.tracking.tracking', 'tensorflow.python.data.ops.dataset_ops', 'tensorflow.python.data.experimental.ops.data_service_ops', 'tensorflow.core.protobuf.service_config_pb2', 'tensorflow.python.data.experimental.service.server_lib', 'tensorflow.python.data.experimental.service', 'tensorflow.python.data.util.convert', 'tensorflow.python.data.experimental.ops.batching', 'tensorflow.python.data.experimental.ops.cardinality', 'tensorflow.python.data.experimental.ops.counter', 'tensorflow.python.data.experimental.ops.distribute', 'tensorflow.python.data.experimental.ops.enumerate_ops', 'tensorflow.python.data.experimental.ops.error_ops', 'tensorflow.python.data.experimental.ops.get_single_element', 'tensorflow.python.data.experimental.ops.grouping', 'tensorflow.python.data.ops.readers', 'tensorflow.python.data.experimental.ops.interleave_ops', 'tensorflow.python.data.experimental.ops.io', 'tensorflow.core.util', 'tensorflow.core.util.event_pb2', 'tensorflow.python.client.timeline', 'tensorflow.python.training.session_run_hook', 'tensorflow.python.summary', 'tensorflow.python.summary.summary_iterator', 'tensorflow.python.summary.writer', 'tensorflow.python.summary.plugin_asset', 'tensorflow.python.client._pywrap_events_writer', 'tensorflow.python.summary.writer.event_file_writer', 'tensorflow.python.profiler.internal._pywrap_profiler', 'tensorflow.python.eager.profiler', 'tensorflow.python.ops.gen_summary_ops', 'tensorflow.python.ops.summary_op_util', 'tensorflow.python.ops.summary_ops_v2', 'tensorflow.python.summary.writer.event_file_writer_v2', 'tensorflow.python.summary.writer.writer', 'tensorflow.python.summary.writer.writer_cache', 'tensorflow.python.training.summary_io', 'tensorflow.python.training.basic_session_run_hooks', 'tensorflow.python.data.experimental.ops.iterator_ops', 'tensorflow.python.ops.gen_lookup_ops', 'tensorflow.python.ops.lookup_ops', 'tensorflow.python.data.experimental.ops.lookup_ops', 'opt_einsum.parser', 'opt_einsum.helpers', 'opt_einsum.blas', 'opt_einsum.paths', 'opt_einsum.path_random', '_decimal', 'decimal', 'opt_einsum.sharing', 'opt_einsum.backends.cupy', 'opt_einsum.backends.object_arrays', 'opt_einsum.backends.jax', 'opt_einsum.backends.tensorflow', 'opt_einsum.backends.theano', 'opt_einsum.backends.torch', 'opt_einsum.backends.dispatch', 'opt_einsum.backends', 'opt_einsum.contract', 'opt_einsum._version', 'opt_einsum', 'tensorflow.compiler', 'tensorflow.compiler.tf2xla', 'tensorflow.compiler.tf2xla.ops', 'tensorflow.compiler.tf2xla.ops.gen_xla_ops', 'tensorflow.python.ops.gen_special_math_ops', 'tensorflow.python.ops.special_math_ops', 'tensorflow.python.ops.sparse_ops', 'tensorflow.python.autograph.utils.context_managers', 'tensorflow.python.autograph.utils.misc', 'tensorflow.python.autograph.utils.py_func', 'tensorflow.python.autograph.utils.tensor_list', 'tensorflow.python.autograph.utils', 'tensorflow.python.autograph.utils.tensors', 'tensorflow.python.platform.device_context', 'tensorflow.python.ops.nn_ops', 'tensorflow.python.ops.sort_ops', 'tensorflow.python.autograph.operators.py_builtins', 'tensorflow.python.autograph.operators.variables', 'tensorflow.python.autograph.utils.ag_logging', 'tensorflow.python.data.experimental.ops.take_while_ops', 'tensorflow.python.types.distribute', 'tensorflow.python.autograph.operators.control_flow', 'tensorflow.python.autograph.operators.conditional_expressions', 'tensorflow.python.autograph.operators.data_structures', 'tensorflow.python.autograph.operators.exceptions', 'tensorflow.python.autograph.operators.logical', 'tensorflow.python.autograph.operators.slices', 'tensorflow.python.autograph.operators', 'tensorflow.python.autograph.core', 'tensorflow.python.autograph.pyct', 'gast.astn', 'gast.ast3', 'gast.gast', 'gast', 'tensorflow.python.autograph.pyct.anno', 'astunparse.unparser', 'astunparse.printer', 'astunparse', 'tensorflow.python.autograph.pyct.errors', 'tensorflow.python.autograph.pyct.inspect_utils', 'tensorflow.python.autograph.pyct.parser', 'tensorflow.python.autograph.pyct.qual_names', 'tensorflow.python.autograph.pyct.ast_util', 'tensorflow.python.autograph.pyct.templates', 'termcolor', 'tensorflow.python.autograph.pyct.pretty_printer', 'tensorflow.python.autograph.pyct.transformer', 'tensorflow.python.autograph.core.converter', 'tensorflow.python.autograph.impl', 'tensorflow.python.autograph.converters', 'tensorflow.python.autograph.converters.asserts', 'tensorflow.python.autograph.pyct.static_analysis', 'tensorflow.python.autograph.pyct.static_analysis.annos', 'tensorflow.python.autograph.pyct.static_analysis.activity', 'tensorflow.python.autograph.converters.break_statements', 'tensorflow.python.autograph.converters.call_trees', 'tensorflow.python.autograph.converters.conditional_expressions', 'tensorflow.python.autograph.converters.continue_statements', 'tensorflow.python.autograph.lang', 'tensorflow.python.autograph.lang.directives', 'tensorflow.python.autograph.pyct.cfg', 'difflib', 'tensorflow.python.autograph.pyct.origin_info', 'tensorflow.python.autograph.pyct.static_analysis.liveness', 'tensorflow.python.autograph.pyct.static_analysis.reaching_definitions', 'tensorflow.python.autograph.pyct.static_analysis.reaching_fndefs', 'tensorflow.python.autograph.converters.control_flow', 'tensorflow.python.autograph.converters.directives', 'tensorflow.python.autograph.converters.functions', 'tensorflow.python.autograph.converters.lists', 'tensorflow.python.autograph.converters.logical_expressions', 'tensorflow.python.autograph.converters.return_statements', 'tensorflow.python.autograph.converters.slices', 'tensorflow.python.autograph.converters.variables', 'tensorflow.python.autograph.core.ag_ctx', 'tensorflow.python.autograph.core.function_wrappers', 'tensorflow.python.autograph.core.unsupported_features_checker', 'unittest.util', 'unittest.result', 'unittest.case', 'unittest.suite', 'unittest.loader', 'unittest.signals', 'unittest.runner', 'unittest.main', 'unittest', 'tensorflow.python.autograph.core.config_lib', 'tensorflow.python.autograph.core.config', 'tensorflow.python.autograph.pyct.cache', 'tensorflow.python.autograph.impl.conversion', 'tensorflow.python.autograph.lang.special_functions', 'tensorflow.python.autograph.pyct.error_utils', 'tensorflow.python.autograph.pyct.loader', 'tensorflow.python.autograph.pyct.naming', 'tensorflow.python.autograph.pyct.transpiler', 'tensorflow.python.autograph.impl.api', 'tensorflow.python.util.all_util', 'tensorflow.python.autograph', 'tensorflow.python.ops.map_fn', 'tensorflow.python.ops.ragged.ragged_functional_ops', 'tensorflow.python.ops.ragged.ragged_math_ops', 'tensorflow.python.ops.parsing_config', 'tensorflow.python.ops.parsing_ops', 'tensorflow.python.data.experimental.ops.parsing_ops', 'tensorflow.python.data.experimental.ops.prefetching_ops', 'tensorflow.python.data.experimental.ops.random_ops', 'gzip', 'tensorflow.python.data.experimental.ops.readers', 'tensorflow.python.data.experimental.ops.resampling', 'tensorflow.python.data.experimental.ops.scan_ops', 'tensorflow.python.data.experimental.ops.shuffle_ops', 'tensorflow.python.data.experimental.ops.snapshot', 'tensorflow.python.data.experimental.ops.unique', 'tensorflow.python.data.experimental.ops.writers', 'tensorflow.python.data.experimental', 'tensorflow.python.data', 'tensorflow.python.feature_column', 'tensorflow.python.feature_column.utils', 'tensorflow.python.layers', 'tensorflow.python.distribute.distribution_strategy_context', 'tensorflow.python.training.checkpoint_utils', 'tensorflow.python.saved_model.constants', 'tensorflow.python.distribute.collective_util', 'tensorflow.python.distribute.numpy_dataset', 'tensorflow.python.distribute.reduce_util', 'tensorflow.python.ops.custom_gradient', 'tensorflow.python.ops.losses', 'tensorflow.python.ops.confusion_matrix', 'tensorflow.python.ops.gen_ctc_ops', 'tensorflow.python.ops.inplace_ops', 'tensorflow.python.ops.linalg_ops', 'tensorflow.python.ops.nn_grad', 'tensorflow.python.ops.ctc_ops', 'tensorflow.python.ops.clip_ops', 'tensorflow.python.ops.data_flow_ops', 'tensorflow.python.ops.data_flow_grad', 'tensorflow.python.ops.embedding_ops', 'tensorflow.python.ops.gen_candidate_sampling_ops', 'tensorflow.python.ops.candidate_sampling_ops', 'tensorflow.python.ops.losses.util', 'tensorflow.python.ops.nn_impl', 'tensorflow.python.ops.nn', 'tensorflow.python.ops.gen_set_ops', 'tensorflow.python.ops.sets_impl', 'tensorflow.python.ops.sets', 'tensorflow.python.ops.weights_broadcast_ops', 'tensorflow.python.ops.losses.losses_impl', 'tensorflow.python.distribute.distribute_lib', 'tensorflow.python.distribute.packed_distributed_variable', 'tensorflow.python.saved_model.save_options', 'tensorflow.python.distribute.values_util', 'tensorflow.python.distribute.values', 'tensorflow.python.framework.immutable_dict', 'tensorflow.python.framework.extension_type_field', 'tensorflow.core.protobuf.composite_tensor_variant_pb2', 'tensorflow.python.ops.gen_composite_tensor_ops', 'tensorflow.python.ops.composite_tensor_ops', 'tensorflow.python.framework.extension_type', 'tensorflow.python.saved_model.nested_structure_coder', 'tensorflow.python.saved_model.utils_impl', 'tensorflow.python.training.saving.checkpoint_options', 'tensorflow.python.training.saving.saveable_hook', 'tensorflow.python.training.saving.functional_saver', 'tensorflow.compiler.xla', 'tensorflow.compiler.xla.experimental', 'tensorflow.compiler.xla.experimental.xla_sharding', 'tensorflow.compiler.tf2xla.python', 'tensorflow.python.ops.gen_manip_ops', 'tensorflow.python.ops.manip_ops', 'tensorflow.python.ops.numpy_ops.np_export', 'tensorflow.python.ops.numpy_ops.np_dtypes', 'tensorflow.python.ops.numpy_ops.np_arrays', 'tensorflow.python.ops.numpy_ops.np_utils', 'tensorflow.python.ops.numpy_ops.np_array_ops', 'tensorflow.python.ops.numpy_ops.np_random', 'tensorflow.python.ops.numpy_ops.np_math_ops', 'tensorflow.python.ops.numpy_ops.np_config', 'tensorflow.python.ops.numpy_ops', 'tensorflow.compiler.tf2xla.python.xla', 'tensorflow.compiler.xla.xla_data_pb2', 'tensorflow.compiler.xla.experimental.xla_sharding.xla_sharding', 'tensorflow.core.protobuf.tpu', 'tensorflow.core.protobuf.tpu.dynamic_padding_pb2', 'tensorflow.compiler.xla.service', 'tensorflow.compiler.xla.service.hlo_pb2', 'tensorflow.core.protobuf.tpu.optimization_parameters_pb2', 'tensorflow.core.protobuf.tpu.tpu_embedding_configuration_pb2', 'tensorflow.python.compiler', 'tensorflow.python.compiler.xla.jit', 'tensorflow.compiler.jit', 'tensorflow.compiler.jit.ops', 'tensorflow.compiler.jit.ops.xla_ops', 'tensorflow.compiler.jit.ops.xla_ops_grad', 'tensorflow.python.distribute.summary_op_util', 'tensorflow.python.compiler.xla.xla', 'tensorflow.python.compiler.xla', 'tensorflow.core.protobuf.tpu.topology_pb2', 'tensorflow.python.tpu.topology', 'tensorflow.python.tpu.device_assignment', 'tensorflow.python.tpu.tpu_name_util', 'tensorflow.python.tpu.tpu_sharding', 'tensorflow.python.tpu.tpu_feed', 'tensorflow.python.tpu.tpu', 'tensorflow.python.distribute.tpu_util', 'tensorflow.python.ops.gen_tpu_partition_ops', 'tensorflow.python.distribute.tpu_replicated_variable', 'tensorflow.python.distribute.tpu_values', 'tensorflow.python.distribute.distribute_utils', 'tensorflow.python.ops.gen_image_ops', 'tensorflow.python.ops.gen_spectral_ops', 'tensorflow.python.platform.flags', 'tensorflow.python.ops.parallel_for.pfor', 'tensorflow.python.ops.parallel_for.control_flow_ops', 'tensorflow.python.ops.array_grad', 'tensorflow.python.ops.control_flow_grad', 'tensorflow.python.ops.image_grad', 'tensorflow.python.ops.linalg', 'tensorflow.python.ops.linalg.linalg_impl', 'tensorflow.python.ops.linalg_grad', 'tensorflow.python.ops.manip_grad', 'tensorflow.python.ops.math_grad', 'tensorflow.python.ops.optional_grad', 'tensorflow.python.ops.random_grad', 'tensorflow.python.ops.gradients_impl', 'tensorflow.python.ops.parallel_for.gradients', 'tensorflow.python.ops.parallel_for', 'tensorflow.python.eager.forwardprop', 'tensorflow.python.ops.gradients', 'tensorflow.python.training.slot_creator', 'tensorflow.python.training.optimizer', 'tensorflow.python.training.tracking.graph_view', 'tensorflow.python.training.tracking.util', 'tensorflow.python.keras.distribute.sidecar_evaluator', 'tensorflow.python.keras.distribute', 'tensorflow.python.keras.backend_config', 'tensorflow.python.distribute.distribute_coordinator_context', 'tensorflow.python.ops.resources', 'google.protobuf.json_format', 'tensorflow.python.summary.summary', 'tensorflow.python.training.coordinator', 'tensorflow.core.protobuf.queue_runner_pb2', 'tensorflow.python.training.queue_runner_impl', 'tensorflow.python.training.queue_runner', 'tensorflow.python.training.session_manager', 'tensorflow.python.training.monitored_session', 'tensorflow.core.protobuf.device_filters_pb2', 'tensorflow.core.protobuf.tensorflow_server_pb2', 'tensorflow.python.training.server_lib', 'tensorflow.python.keras.distribute.distribute_coordinator_utils', 'tensorflow.python.keras.engine', 'tensorflow.python.keras.utils', 'tensorflow.python.keras.utils.object_identity', 'tensorflow.python.ops.gen_ragged_array_ops', 'tensorflow.python.ops.ragged.dynamic_ragged_shape', 'tensorflow.python.ops.ragged.ragged_array_ops', 'tensorflow.python.ops.ragged.ragged_gather_ops', 'tensorflow.python.ops.ragged.ragged_getitem', 'tensorflow.python.ops.ragged.ragged_operators', 'tensorflow.python.keras.engine.keras_tensor', 'tensorflow.python.keras.utils.control_flow_util', 'tensorflow.python.keras.utils.tf_contextlib', 'tensorflow.python.keras.utils.tf_inspect', 'tensorflow.python.ops.image_ops_impl', 'tensorflow.python.ops.image_ops', 'tensorflow.python.ops.tensor_array_grad', 'tensorflow.python.training.moving_averages', 'tensorflow.python.util.keras_deps', 'tensorflow.python.keras.backend', 'tensorflow.python.keras.distribute.distributed_training_utils', 'tensorflow.python.keras.utils.generic_utils', 'tensorflow.python.keras.constraints', 'tensorflow.python.keras.initializers.initializers_v1', 'tensorflow.python.keras.initializers.initializers_v2', 'tensorflow.python.keras.initializers', 'tensorflow.python.keras.regularizers', 'tensorflow.python.distribute.coordinator', 'multiprocessing.dummy.connection', 'multiprocessing.dummy', 'multiprocessing.util', '_multiprocessing', 'multiprocessing.connection', 'multiprocessing.pool', 'tensorflow.core.framework.device_attributes_pb2', 'tensorflow.python.client._pywrap_device_lib', 'tensorflow.python.client.device_lib', 'tensorflow.python.ops.gen_collective_ops', 'tensorflow.python.ops.collective_ops', 'tensorflow.python.ops.gen_nccl_ops', 'tensorflow.python.ops.nccl_ops', 'tensorflow.python.distribute.cross_device_utils', 'tensorflow.python.distribute.coordinator.coordinator_context', 'tensorflow.python.distribute.ps_values', 'tensorflow.core.framework.kernel_def_pb2', 'tensorflow.python.framework.kernels', 'tensorflow.python.distribute.cross_device_ops', 'tensorflow.python.data.ops.multi_device_iterator_ops', 'tensorflow.python.distribute.input_ops', 'tensorflow.python.distribute.input_lib', 'tensorflow.python.distribute.v1', 'tensorflow.python.distribute.v1.input_lib', 'tensorflow.python.distribute.input_util', 'tensorflow.python.distribute.shared_variable_creator', 'tensorflow.python.distribute.mirrored_run', 'tensorflow.python.distribute.multi_worker_util', 'tensorflow.python.distribute.cluster_resolver.cluster_resolver', 'tensorflow.python.distribute.cluster_resolver.gce_cluster_resolver', 'tensorflow.python.distribute.cluster_resolver.kubernetes_cluster_resolver', 'tensorflow.python.distribute.cluster_resolver.slurm_cluster_resolver', 'tensorflow.python.distribute.cluster_resolver.tfconfig_cluster_resolver', 'tensorflow.python.distribute.cluster_resolver.tpu', 'tensorflow.python.tpu.tpu_system_metadata', 'tensorflow.python.tpu.client', 'concurrent', 'concurrent.futures._base', 'concurrent.futures', 'six.moves.urllib', 'six.moves.urllib.error', 'urllib.response', 'urllib.error', 'tensorflow.python.tpu.client.client', 'tensorflow.python.distribute.cluster_resolver.tpu.tpu_cluster_resolver', 'tensorflow.python.distribute.cluster_resolver.tpu_cluster_resolver', 'tensorflow.python.distribute.cluster_resolver', 'tensorflow.python.training.device_setter', 'tensorflow.python.distribute.parameter_server_strategy', 'tensorflow.python.ops.partitioned_variables', 'tensorflow.python.distribute.sharded_variable', 'tensorflow.python.platform.remote_utils', 'tensorflow.python.eager.remote', 'tensorflow.python.distribute.parameter_server_strategy_v2', 'tensorflow.python.distribute.coordinator.metric_utils', 'tensorflow.python.distribute.coordinator.values', 'tensorflow.python.distribute.coordinator.watchdog', 'tensorflow.python.eager.cancellation', 'tensorflow.python.distribute.coordinator.cluster_coordinator', 'tensorflow.python.keras.utils.tf_utils', 'tensorflow.python.keras.engine.base_layer_utils', 'tensorflow.python.keras.engine.input_spec', 'tensorflow.python.keras.saving', 'tensorflow.python.keras.saving.saved_model', 'tensorflow.python.keras.saving.saved_model.json_utils', 'tensorflow.python.keras.engine.node', 'tensorflow.python.keras.mixed_precision', 'tensorflow.python.keras.mixed_precision.autocast_variable', 'tensorflow.python.distribute.mirrored_strategy', 'tensorflow.python.tpu.tpu_strategy_util', 'tensorflow.python.distribute.collective_all_reduce_strategy', 'tensorflow.python.distribute.one_device_strategy', 'tensorflow.python.tpu.tpu_hardware_feature', 'tensorflow.python.platform.analytics', 'tensorflow.python.tpu.tensor_tracer_flags', 'tensorflow.python.tpu.tensor_tracer_pb2', 'tensorflow.python.tpu.tensor_tracer_report', 'tensorflow.python.tpu.tensor_tracer', 'tensorflow.python.tpu.training_loop', 'tensorflow.python.distribute.tpu_strategy', 'tensorflow.python.keras.optimizer_v1', 'tensorflow.python.keras.optimizer_v2', 'tensorflow.python.distribute.central_storage_strategy', 'tensorflow.python.keras.optimizer_v2.learning_rate_schedule', 'tensorflow.python.keras.optimizer_v2.utils', 'tensorflow.python.keras.utils.layer_utils', 'tensorflow.python.keras.optimizer_v2.optimizer_v2', 'tensorflow.python.ops.gen_training_ops', 'tensorflow.python.training.gen_training_ops', 'tensorflow.python.keras.optimizer_v2.adadelta', 'tensorflow.python.keras.optimizer_v2.adagrad', 'tensorflow.python.keras.optimizer_v2.adam', 'tensorflow.python.keras.optimizer_v2.adamax', 'tensorflow.python.keras.optimizer_v2.ftrl', 'tensorflow.python.keras.optimizer_v2.gradient_descent', 'tensorflow.python.keras.optimizer_v2.nadam', 'tensorflow.python.keras.optimizer_v2.rmsprop', 'tensorflow.python.keras.optimizers', 'tensorflow.python.training.experimental.loss_scale', 'tensorflow.python.keras.mixed_precision.loss_scale', 'tensorflow.python.training.experimental.loss_scale_optimizer', 'tensorflow.python.training.experimental.mixed_precision', 'tensorflow.python.training.tracking.base_delegate', 'tensorflow.python.keras.mixed_precision.loss_scale_optimizer', 'tensorflow.python.keras.mixed_precision.device_compatibility_check', 'tensorflow.python.keras.mixed_precision.policy', 'tensorflow.python.keras.saving.saved_model.utils', 'tensorflow.python.keras.saving.saved_model.base_serialization', 'tensorflow.python.keras.saving.saved_model.constants', 'tensorflow.python.keras.utils.losses_utils', 'tensorflow.python.ops.ragged.ragged_map_ops', 'tensorflow.python.keras.losses', 'tensorflow.python.keras.utils.version_utils', 'tensorflow.python.keras.utils.io_utils', 'tensorflow.python.keras.saving.saving_utils', 'tensorflow.python.keras.protobuf', 'tensorflow.python.keras.protobuf.versions_pb2', 'tensorflow.python.keras.protobuf.saved_metadata_pb2', 'tensorflow.python.keras.saving.saved_model.serialized_attributes', 'tensorflow.python.keras.utils.metrics_utils', 'tensorflow.python.eager.function_saved_model_utils', 'tensorflow.python.framework.function_def_to_graph', 'tensorflow.python.saved_model.function_deserialization', 'tensorflow.python.saved_model.load_options', 'tensorflow.python.eager.wrap_function', 'tensorflow.core.protobuf.saved_model_pb2', 'tensorflow.python.saved_model.signature_constants', 'tensorflow.python.saved_model.signature_def_utils_impl', 'tensorflow.python.saved_model.signature_def_utils', 'tensorflow.python.saved_model.loader_impl', 'tensorflow.python.saved_model.function_serialization', 'tensorflow.python.saved_model.signature_serialization', 'tensorflow.python.saved_model.load_v1_in_v2', 'tensorflow.python.saved_model.load', 'tensorflow.python.keras.saving.saved_model.load', 'tensorflow.python.keras.saving.saved_model.save_impl', 'tensorflow.python.keras.saving.saved_model.layer_serialization', 'tensorflow.python.module', 'tensorflow.python.module.module', 'tensorflow.python.keras.engine.base_layer', 'tensorflow.python.keras.engine.input_layer', 'tensorflow.python.keras.engine.training_utils', 'tarfile', 'six.moves.urllib.request', 'http', '_ssl', 'ssl', 'http.client', '_scproxy', 'urllib.request', 'tensorflow.python.keras.utils.data_utils', 'tensorflow.python.keras.utils.dataset_creator', 'tensorflow.python.keras.engine.data_adapter', 'tensorflow.python.keras.engine.base_preprocessing_layer', 'tensorflow.python.keras.layers.advanced_activations', 'tensorflow.python.keras.utils.conv_utils', 'tensorflow.python.keras.layers.pooling', 'tensorflow.python.keras.layers.convolutional', 'tensorflow.python.ops.gen_cudnn_rnn_ops', 'tensorflow.python.ops.cudnn_rnn_grad', 'tensorflow.python.ops.gen_rnn_ops', 'tensorflow.python.ops.rnn_grad', 'tensorflow.python.ops.sparse_grad', 'tensorflow.python.ops.state_grad', 'tensorflow.python.ops.gen_batch_ops', 'tensorflow.python.ops.batch_ops', 'tensorflow.python.ops.critical_section_ops', 'tensorflow.python.ops.histogram_ops', 'tensorflow.python.ops.numerics', 'tensorflow.python.ops.gen_decode_proto_ops', 'tensorflow.python.ops.gen_encode_proto_ops', 'tensorflow.python.ops.proto_ops', 'tensorflow.python.ops.ragged.ragged_tensor_shape', 'tensorflow.python.ops.ragged.ragged_dispatch', 'tensorflow.python.ops.template', 'distutils.version', 'tensorflow.compiler.tf2tensorrt', 'tensorflow.compiler.tf2tensorrt._pywrap_py_utils', 'tensorflow.python.compiler.tensorrt.utils', 'tensorflow.python.grappler', 'tensorflow.python.grappler._pywrap_tf_optimizer', 'tensorflow.core.grappler', 'tensorflow.core.grappler.costs', 'tensorflow.core.protobuf.device_properties_pb2', 'tensorflow.core.grappler.costs.op_performance_data_pb2', 'tensorflow.python.grappler._pywrap_tf_cluster', 'tensorflow.python.grappler.cluster', 'tensorflow.python.grappler.tf_optimizer', 'tensorflow.python.framework.convert_to_constants', 'tensorflow.python.saved_model.builder_impl', 'tensorflow.python.saved_model.builder', 'tensorflow.python.saved_model.loader', 'tensorflow.python.saved_model.tag_constants', 'tensorflow.python.saved_model.save', 'tensorflow.compiler.tf2tensorrt.ops', 'tensorflow.compiler.tf2tensorrt.ops.gen_trt_ops', 'tensorflow.python.compiler.tensorrt.trt_convert', 'tensorflow.python.compiler.tensorrt', 'tensorflow.python.ops.standard_ops', 'tensorflow.python.keras.layers.core', 'tensorflow.python.keras.layers.dense_attention', 'tensorflow.python.keras.layers.embeddings', 'tensorflow.python.keras.layers.einsum_dense', 'tensorflow.python.keras.layers.multi_head_attention', 'tensorflow.python.keras.layers.local', 'tensorflow.python.keras.layers.merge', 'tensorflow.python.keras.layers.noise', 'tensorflow.python.keras.layers.kernelized', 'tensorflow.python.keras.layers.recurrent', 'tensorflow.python.platform.sysconfig', 'tensorflow.python.keras.layers.recurrent_v2', 'tensorflow.python.keras.layers.convolutional_recurrent', 'tensorflow.python.keras.layers.cudnn_recurrent', 'tensorflow.python.keras.layers.legacy_rnn', 'tensorflow.python.keras.layers.legacy_rnn.rnn_cell_wrapper_impl', 'tensorflow.python.keras.layers.rnn_cell_wrapper_v2', 'tensorflow.python.keras.layers.serialization', 'tensorflow.python.keras.layers', 'tensorflow.python.keras.activations', 'tensorflow.python.keras.saving.saved_model.metric_serialization', 'tensorflow.python.keras.metrics', 'tensorflow.python.keras.distribute.distributed_file_utils', 'tensorflow.python.saved_model.model_utils.export_output', 'tensorflow.python.saved_model.utils', 'tensorflow.python.saved_model.model_utils.mode_keys', 'tensorflow.python.saved_model.model_utils.export_utils', 'tensorflow.python.saved_model.model_utils', 'tensorflow.python.keras.utils.mode_keys', 'tensorflow.python.keras.distribute.worker_training_state', 'tensorflow.python.profiler.profiler_v2', 'urllib3.packages', 'urllib3.packages.six', 'urllib3.packages.six.moves', 'urllib3.packages.six.moves.http_client', 'urllib3.exceptions', 'urllib3._version', 'urllib3.contrib', 'urllib3.contrib._appengine_environ', 'urllib3.util.wait', 'urllib3.util.connection', 'urllib3.util.request', 'urllib3.util.response', 'urllib3.util.retry', 'urllib3.util.url', 'urllib3.util.ssltransport', 'urllib3.util.ssl_', 'urllib3.util.timeout', 'urllib3.util', 'urllib3.util.proxy', 'urllib3._collections', 'ipaddress', 'urllib3.util.ssl_match_hostname', 'urllib3.connection', 'mimetypes', 'urllib3.fields', 'urllib3.filepost', 'urllib3.packages.six.moves.urllib', 'urllib3.packages.six.moves.urllib.parse', 'urllib3.request', 'urllib3.response', 'urllib3.util.queue', 'urllib3.connectionpool', 'urllib3.poolmanager', 'urllib3', 'charset_normalizer.assets', 'charset_normalizer.constant', 'unicodedata2', '_multibytecodec', 'charset_normalizer.utils', 'charset_normalizer.md', 'charset_normalizer.models', 'charset_normalizer.cd', 'charset_normalizer.api', 'charset_normalizer.legacy', 'charset_normalizer.version', 'charset_normalizer', 'http.cookiejar', 'http.cookies', 'requests.compat', 'requests.exceptions', 'requests.packages.urllib3.packages', 'requests.packages.urllib3.packages.six', 'requests.packages.urllib3.packages.six.moves', 'requests.packages.urllib3.packages.six.moves.http_client', 'requests.packages.urllib3.exceptions', 'requests.packages.urllib3._version', 'requests.packages.urllib3.contrib', 'requests.packages.urllib3.contrib._appengine_environ', 'requests.packages.urllib3.util.wait', 'requests.packages.urllib3.util.connection', 'requests.packages.urllib3.util.request', 'requests.packages.urllib3.util.response', 'requests.packages.urllib3.util.retry', 'requests.packages.urllib3.util.url', 'requests.packages.urllib3.util.ssltransport', 'requests.packages.urllib3.util.ssl_', 'requests.packages.urllib3.util.timeout', 'requests.packages.urllib3.util', 'requests.packages.urllib3.util.proxy', 'requests.packages.urllib3._collections', 'requests.packages.urllib3.util.ssl_match_hostname', 'requests.packages.urllib3.connection', 'requests.packages.urllib3.fields', 'requests.packages.urllib3.filepost', 'requests.packages.urllib3.packages.six.moves.urllib', 'requests.packages.urllib3.packages.six.moves.urllib.parse', 'requests.packages.urllib3.request', 'requests.packages.urllib3.response', 'requests.packages.urllib3.util.queue', 'requests.packages.urllib3.connectionpool', 'requests.packages.urllib3.poolmanager', 'requests.packages.urllib3', 'idna.package_data', 'idna.idnadata', 'idna.intranges', 'idna.core', 'idna', 'requests.packages.idna.package_data', 'requests.packages.idna.idnadata', 'requests.packages.idna.intranges', 'requests.packages.idna.core', 'requests.packages.idna', 'requests.packages.chardet', 'requests.packages', 'certifi.core', 'certifi', 'requests.certs', 'requests.__version__', 'requests._internal_utils', 'requests.cookies', 'requests.structures', 'requests.utils', 'requests.auth', 'stringprep', 'encodings.idna', 'requests.hooks', 'requests.status_codes', 'requests.models', 'requests.adapters', 'requests.sessions', 'requests.api', 'requests', 'tensorflow.python.keras.callbacks', 'tensorflow.python.keras.engine.compile_utils', 'tensorflow.python.keras.saving.model_config', 'h5py._errors', '_cython_0_29_24', 'h5py.defs', 'h5py._objects', 'h5py.h5py_warnings', 'h5py.h5', 'h5py.version', 'h5py.h5r', 'h5py.utils', 'h5py.h5s', 'h5py.h5ac', 'h5py.h5p', 'h5py.h5t', 'h5py._conv', 'h5py.h5z', 'h5py._proxy', 'h5py.h5a', 'h5py.h5d', 'h5py.h5ds', 'h5py.h5g', 'h5py.h5i', 'h5py.h5f', 'h5py.h5fd', 'h5py.h5pl', 'h5py._hl', 'h5py._hl.compat', 'h5py._hl.filters', 'h5py._hl.base', 'h5py.h5o', 'h5py.h5l', 'h5py._selector', 'h5py._hl.selections', 'h5py._hl.selections2', 'h5py._hl.datatype', 'h5py._hl.vds', 'h5py._hl.dataset', 'h5py._hl.group', 'h5py._hl.files', 'h5py._hl.attrs', 'h5py', 'tensorflow.python.keras.saving.hdf5_format', 'tensorflow.python.keras.saving.saved_model.load_context', 'tensorflow.python.keras.saving.saved_model.save', 'tensorflow.python.keras.saving.save', 'tensorflow.python.keras.saving.saved_model.model_serialization', 'tensorflow.python.keras.engine.training', 'tensorflow.python.keras.saving.saved_model.network_serialization', 'tensorflow.python.keras.engine.functional', 'tensorflow.python.keras.engine.sequential', 'tensorflow.python.keras.engine.training_utils_v1', 'tensorflow.python.keras.distribute.distributed_training_utils_v1', 'scipy._lib._testutils', 'scipy._lib', 'scipy._lib.deprecation', 'scipy.__config__', 'scipy.version', 'scipy._distributor_init', 'scipy._lib._pep440', 'scipy._lib._ccallback_c', 'scipy._lib._ccallback', 'scipy', 'scipy._lib._util', 'scipy.sparse._sputils', 'scipy.sparse._base', 'scipy.sparse._sparsetools', 'scipy.sparse._data', 'scipy.sparse._index', 'scipy.sparse._compressed', 'scipy.sparse._csr', 'scipy.sparse._csc', 'scipy.sparse._csparsetools', 'scipy.sparse._lil', 'scipy.sparse._dok', 'scipy.sparse._coo', 'scipy.sparse._dia', 'scipy.sparse._bsr', 'scipy.sparse._construct', 'scipy.sparse._extract', 'scipy.sparse._matrix_io', 'scipy.sparse._arrays', 'scipy.sparse.linalg._isolve._iterative', 'scipy.sparse.linalg._interface', 'scipy.sparse.linalg._isolve.utils', 'scipy._lib.decorator', 'scipy._lib._threadsafety', 'scipy.sparse.linalg._isolve.iterative', 'scipy.sparse.linalg._isolve.minres', 'scipy.linalg._fblas', 'scipy.linalg.blas', 'scipy.linalg._flapack', 'scipy.linalg.lapack', 'scipy.linalg._misc', '_cython_0_29_32', 'scipy.linalg._cythonized_array_utils', 'scipy.linalg._flinalg', 'scipy.linalg._flinalg_py', 'scipy.linalg._decomp', 'scipy.linalg._decomp_svd', 'scipy.linalg._solve_toeplitz', 'scipy.linalg._basic', 'scipy.linalg._decomp_lu', 'scipy.linalg._decomp_ldl', 'scipy.linalg._decomp_cholesky', 'scipy.linalg._decomp_qr', 'scipy.linalg._decomp_qz', 'scipy.linalg._decomp_schur', 'scipy.linalg._decomp_polar', 'scipy.linalg._special_matrices', 'scipy.linalg._expm_frechet', 'scipy.linalg._matfuncs_sqrtm_triu', 'scipy.linalg._matfuncs_sqrtm', 'scipy.linalg.cython_lapack', 'scipy.linalg.cython_blas', 'scipy.linalg._matfuncs_expm', 'scipy.linalg._matfuncs', 'scipy.linalg._solvers', 'scipy.linalg._procrustes', 'scipy.linalg._decomp_update', 'scipy.linalg._sketches', 'scipy.linalg._decomp_cossin', 'scipy.linalg.decomp', 'scipy.linalg.decomp_cholesky', 'scipy.linalg.decomp_lu', 'scipy.linalg.decomp_qr', 'scipy.linalg.decomp_svd', 'scipy.linalg.decomp_schur', 'scipy.linalg.basic', 'scipy.linalg.misc', 'scipy.linalg.special_matrices', 'scipy.linalg.flinalg', 'scipy.linalg.matfuncs', 'scipy.linalg', 'scipy.sparse.linalg._isolve._gcrotmk', 'scipy.sparse.linalg._isolve.lgmres', 'scipy.sparse.linalg._isolve.lsqr', 'scipy.sparse.linalg._isolve.lsmr', 'scipy.sparse.linalg._isolve.tfqmr', 'scipy.sparse.linalg._isolve', 'scipy.sparse.linalg._dsolve._superlu', 'scipy.sparse.linalg._dsolve.linsolve', 'scipy.sparse.linalg._dsolve._add_newdocs', 'scipy.sparse.linalg._dsolve', 'scipy.sparse.linalg._eigen.arpack._arpack', 'scipy.sparse.linalg._eigen.arpack.arpack', 'scipy.sparse.linalg._eigen.arpack', 'scipy.sparse.linalg._eigen.lobpcg.lobpcg', 'scipy.sparse.linalg._eigen.lobpcg', 'scipy.sparse.linalg._eigen._svds', 'scipy.sparse.linalg._eigen', 'scipy.sparse.linalg._onenormest', 'scipy.sparse.linalg._expm_multiply', 'scipy.sparse.linalg._matfuncs', 'scipy.sparse.linalg._norm', 'scipy.sparse.linalg.isolve', 'scipy.sparse.linalg.dsolve', 'scipy.sparse.linalg.interface', 'scipy.sparse.linalg.eigen', 'scipy.sparse.linalg.matfuncs', 'scipy.sparse.linalg', 'scipy.sparse.csgraph._laplacian', 'scipy.sparse.csgraph._tools', 'scipy.sparse.csgraph._validation', 'scipy.sparse.csgraph._shortest_path', 'scipy.sparse.csgraph._traversal', 'scipy.sparse.csgraph._min_spanning_tree', 'scipy.sparse.csgraph._flow', 'scipy.sparse.csgraph._matching', 'scipy.sparse.csgraph._reordering', 'scipy.sparse.csgraph', 'scipy.sparse.base', 'scipy.sparse.bsr', 'scipy.sparse.compressed', 'scipy.sparse.construct', 'scipy.sparse.coo', 'scipy.sparse.csc', 'scipy.sparse.csr', 'scipy.sparse.data', 'scipy.sparse.dia', 'scipy.sparse.dok', 'scipy.sparse.extract', 'scipy.sparse.lil', 'scipy.sparse.sparsetools', 'scipy.sparse.sputils', 'scipy.sparse', 'tensorflow.python.keras.engine.training_arrays_v1', 'tensorflow.python.keras.engine.partial_batch_padding_handler', 'tensorflow.python.keras.engine.training_distributed_v1', 'tensorflow.python.keras.engine.training_eager_v1', 'tensorflow.python.keras.engine.training_generator_v1', 'tensorflow.python.keras.engine.training_v1', 'tensorflow.python.keras.models', 'tensorflow.python.keras', 'tensorflow.python.keras.legacy_tf_layers', 'tensorflow.python.keras.legacy_tf_layers.variable_scope_shim', 'tensorflow.python.keras.legacy_tf_layers.base', 'tensorflow.python.layers.base', 'tensorflow.python.feature_column.feature_column', 'tensorflow.python.feature_column.feature_column_v2', 'tensorflow.python.feature_column.sequence_feature_column', 'tensorflow.python.feature_column.serialization', 'tensorflow.python.feature_column.feature_column_lib', 'tensorflow.python.ops.gen_count_ops', 'tensorflow.python.ops.bincount_ops', 'tensorflow.python.ops.control_flow_util_v2', 'tensorflow.python.ops.cond_v2', 'tensorflow.python.ops.gradient_checker_v2', 'tensorflow.python.ops.metrics_impl', 'tensorflow.python.ops.metrics', 'tensorflow.python.ops.gen_stateful_random_ops', 'tensorflow.python.ops.stateful_random_ops', 'tensorflow.python.ops.while_v2_indexed_slices_rewriter', 'tensorflow.python.ops.while_v2', 'tensorflow.python.ops.distributions', 'tensorflow.python.ops.distributions.kullback_leibler', 'tensorflow.python.ops.distributions.util', 'tensorflow.python.ops.distributions.distribution', 'tensorflow.python.ops.distributions.bernoulli', 'tensorflow.python.ops.distributions.beta', 'tensorflow.python.ops.distributions.categorical', 'tensorflow.python.ops.distributions.dirichlet', 'tensorflow.python.ops.distributions.dirichlet_multinomial', 'tensorflow.python.ops.distributions.gamma', 'tensorflow.python.ops.distributions.exponential', 'tensorflow.python.ops.distributions.special_math', 'tensorflow.python.ops.distributions.laplace', 'tensorflow.python.ops.distributions.multinomial', 'tensorflow.python.ops.distributions.normal', 'tensorflow.python.ops.distributions.student_t', 'tensorflow.python.ops.distributions.uniform', 'tensorflow.python.ops.distributions.distributions', 'tensorflow.python.ops.linalg.linear_operator_algebra', 'tensorflow.python.ops.linalg.linear_operator_util', 'tensorflow.python.ops.linalg.linear_operator', 'tensorflow.python.ops.linalg.linear_operator_adjoint', 'tensorflow.python.ops.linalg.linear_operator_block_diag', 'tensorflow.python.ops.signal', 'tensorflow.python.ops.signal.fft_ops', 'tensorflow.python.ops.linalg.linear_operator_circulant', 'tensorflow.python.ops.linalg.linear_operator_diag', 'tensorflow.python.ops.linalg.linear_operator_householder', 'tensorflow.python.ops.linalg.linear_operator_identity', 'tensorflow.python.ops.linalg.linear_operator_kronecker', 'tensorflow.python.ops.linalg.adjoint_registrations', 'tensorflow.python.ops.linalg.linear_operator_lower_triangular', 'tensorflow.python.ops.linalg.cholesky_registrations', 'tensorflow.python.ops.linalg.linear_operator_full_matrix', 'tensorflow.python.ops.linalg.linear_operator_addition', 'tensorflow.python.ops.linalg.linear_operator_block_lower_triangular', 'tensorflow.python.ops.linalg.linear_operator_inversion', 'tensorflow.python.ops.linalg.inverse_registrations', 'tensorflow.python.ops.linalg.linear_operator_composition', 'tensorflow.python.ops.linalg.linear_operator_zeros', 'tensorflow.python.ops.linalg.registrations_util', 'tensorflow.python.ops.linalg.matmul_registrations', 'tensorflow.python.ops.linalg.solve_registrations', 'tensorflow.python.ops.linalg.linear_operator_low_rank_update', 'tensorflow.python.ops.linalg.linear_operator_permutation', 'tensorflow.python.ops.linalg.linear_operator_toeplitz', 'tensorflow.python.ops.linalg.linear_operator_tridiag', 'tensorflow.python.ops.linalg.linalg', 'tensorflow.python.ops.linalg.sparse', 'tensorflow.python.ops.linalg.sparse.conjugate_gradient', 'tensorflow.python.ops.linalg.sparse.gen_sparse_csr_matrix_ops', 'tensorflow.python.ops.linalg.sparse.sparse_csr_matrix_ops', 'tensorflow.python.ops.linalg.sparse.sparse_csr_matrix_grad', 'tensorflow.python.ops.linalg.sparse.sparse', 'tensorflow.python.ops.losses.losses', 'tensorflow.python.ops.ragged.ragged_batch_gather_ops', 'tensorflow.python.ops.ragged.ragged_concat_ops', 'tensorflow.python.ops.ragged.ragged_where_op', 'tensorflow.python.ops.ragged.ragged_batch_gather_with_default_op', 'tensorflow.python.ops.ragged.ragged_check_ops', 'tensorflow.python.ops.ragged.ragged_conversion_ops', 'tensorflow.python.ops.ragged.ragged_factory_ops', 'tensorflow.python.ops.ragged.ragged_image_ops', 'tensorflow.python.ops.ragged.ragged_squeeze_op', 'tensorflow.python.ops.ragged.ragged_string_ops', 'tensorflow.python.ops.ragged.ragged_ops', 'tensorflow.python.ops.signal.dct_ops', 'fractions', 'tensorflow.python.ops.signal.util_ops', 'tensorflow.python.ops.signal.shape_ops', 'tensorflow.python.ops.signal.mel_ops', 'tensorflow.python.ops.signal.mfcc_ops', 'tensorflow.python.ops.signal.reconstruction_ops', 'tensorflow.python.ops.signal.window_ops', 'tensorflow.python.ops.signal.spectral_ops', 'tensorflow.python.ops.signal.signal', 'tensorflow.python.ops.structured', 'tensorflow.python.ops.structured.structured_tensor', 'tensorflow.python.ops.structured.structured_array_ops', 'tensorflow.python.ops.structured.structured_ops', 'tensorflow.core.profiler', 'tensorflow.core.profiler.tfprof_log_pb2', 'tensorflow.core.profiler.tfprof_output_pb2', 'tensorflow.core.profiler.tfprof_options_pb2', 'tensorflow.python.profiler.internal.flops_registry', 'tensorflow.python.profiler.tfprof_logger', 'tensorflow.python.profiler.option_builder', 'tensorflow.python.util._pywrap_tfprof', 'tensorflow.python.profiler.model_analyzer', 'tensorflow.python.profiler.profiler', 'tensorflow.python.profiler.profiler_client', 'tensorflow.python.saved_model.main_op_impl', 'tensorflow.python.saved_model.main_op', 'tensorflow.python.saved_model.method_name_updater', 'tensorflow.python.saved_model.simple_save', 'tensorflow.python.saved_model.saved_model', 'tensorflow.python.tpu.bfloat16', 'tensorflow.python.tpu.feature_column', 'tensorflow.python.tpu.feature_column_v2', 'tensorflow.python.tpu.tpu_embedding', 'tensorflow.python.ops.init_ops_v2', 'tensorflow.python.tpu.tpu_embedding_v2_utils', 'tensorflow.python.tpu.tpu_embedding_base', 'tensorflow.python.tpu.tpu_embedding_for_serving', 'tensorflow.python.tpu.tpu_embedding_v1', 'tensorflow.python.tpu.tpu_embedding_v2', 'tensorflow.python.tpu.tpu_optimizer', 'tensorflow.python.tpu.api', 'tensorflow.python.user_ops', 'tensorflow.python.user_ops.ops', 'tensorflow.python.user_ops.ops.gen_user_ops', 'tensorflow.python.user_ops.user_ops', 'tensorflow.python.ops.gen_audio_ops', 'tensorflow.python.ops.gen_boosted_trees_ops', 'tensorflow.python.ops.gen_sendrecv_ops', 'tensorflow.python.ops.gen_sdca_ops', 'tensorflow.python.ops.sdca_ops', 'tensorflow.python.training.training_ops', 'tensorflow.python.training.adadelta', 'tensorflow.python.training.adagrad', 'tensorflow.python.training.adagrad_da', 'tensorflow.python.training.proximal_adagrad', 'tensorflow.python.training.adam', 'tensorflow.python.training.ftrl', 'tensorflow.python.training.momentum', 'tensorflow.python.training.rmsprop', 'tensorflow.python.training.gradient_descent', 'tensorflow.python.training.proximal_gradient_descent', 'tensorflow.python.training.sync_replicas_optimizer', 'tensorflow.python.layers.utils', 'tensorflow.python.training.input', 'tensorflow.python.training.basic_loops', 'tensorflow.python.training.tracking.python_state', 'tensorflow.python.training.supervisor', 'tensorflow.python.ops.gen_checkpoint_ops', 'tensorflow.python.training.checkpoint_ops', 'tensorflow.python.training.warm_starting_util', 'tensorflow.core.example', 'tensorflow.core.example.feature_pb2', 'tensorflow.core.example.example_pb2', 'tensorflow.python.keras.optimizer_v2.legacy_learning_rate_decay', 'tensorflow.python.training.learning_rate_decay', 'tensorflow.python.training.training', 'tensorflow.python._pywrap_quantize_training', 'tensorflow.python.training.quantize_training', 'tensorflow.python.platform.app', 'tensorflow.python.platform.resource_loader', 'absl.testing', 'shlex', 'asyncio.constants', 'asyncio.format_helpers', 'asyncio.base_futures', 'asyncio.log', 'asyncio.coroutines', '_contextvars', 'contextvars', 'asyncio.exceptions', 'asyncio.base_tasks', '_asyncio', 'asyncio.events', 'asyncio.futures', 'asyncio.protocols', 'asyncio.transports', 'asyncio.sslproto', 'asyncio.locks', 'asyncio.tasks', 'asyncio.staggered', 'asyncio.trsock', 'asyncio.base_events', 'asyncio.runners', 'asyncio.queues', 'asyncio.streams', 'asyncio.subprocess', 'asyncio.threads', 'asyncio.base_subprocess', 'asyncio.selector_events', 'asyncio.unix_events', 'asyncio', 'unittest.mock', 'absl.testing._pretty_print_reporter', 'xml.sax.handler', 'xml.sax._exceptions', 'xml.sax.xmlreader', 'xml.sax', 'xml.sax.saxutils', 'absl.testing.xml_reporter', 'absl.testing.absltest', 'absl.testing.parameterized', 'tensorflow.python._pywrap_sanitizers', 'tensorflow.python.pywrap_sanitizers', 'tensorflow.python.framework._test_metrics_util', 'tensorflow.python.framework.gpu_util', 'tensorflow.python.platform._pywrap_stacktrace_handler', 'tensorflow.core.util.test_log_pb2', 'tensorflow.python.platform.benchmark', 'tensorflow.python.platform.googletest', 'tensorflow.python.util._pywrap_util_port', 'tensorflow.python.util.protobuf', 'tensorflow.python.util.protobuf.compare', 'tensorflow.python.framework.test_util', 'tensorflow.python.ops.gradient_checker', 'tensorflow.python.platform.test', 'tensorflow.python.ops.control_flow_v2_toggles', 'tensorflow.python.compat.v2_compat', 'tensorflow.python.keras.layers.legacy_rnn.rnn_cell_impl', 'tensorflow.python.ops.rnn_cell_impl', 'tensorflow.python.ops.rnn', 'tensorflow.python.ops.rnn_cell', 'tensorflow.python.debug.lib', 'tensorflow.python.debug.lib.debug_graphs', 'tensorflow.python.debug.lib.debug_data', 'tensorflow.python.debug.lib.debug_gradients', 'tensorflow.python.debug.lib.debug_utils', 'tensorflow.python.debug.wrappers', 'tensorflow.python.debug.wrappers.framework', 'tensorflow.python.debug.wrappers.dumping_wrapper', 'tensorflow.python.debug.lib.common', 'tensorflow.python.debug.wrappers.grpc_wrapper', 'tensorflow.python.debug.cli', 'tensorflow.python.debug.cli.debugger_cli_common', 'tensorflow.python.debug.cli.cli_config', 'tensorflow.python.debug.cli.command_parser', 'tensorflow.python.debug.cli.tensor_format', 'tensorflow.python.debug.cli.cli_shared', 'tensorflow.python.debug.cli.evaluator', 'tensorflow.python.debug.cli.ui_factory', 'tensorflow.python.debug.lib.profiling', 'tensorflow.python.debug.lib.source_utils', 'tensorflow.python.debug.cli.analyzer_cli', 'tensorflow.python.debug.cli.profile_analyzer_cli', 'tensorflow.python.debug.wrappers.local_cli_wrapper', 'tensorflow.python.debug.wrappers.hooks', 'tensorflow.python.debug', 'tensorflow.core.protobuf.debug_event_pb2', 'tensorflow.python.debug.lib.op_callbacks_common', 'tensorflow.python.ops.gen_debug_ops', 'tensorflow.python.debug.lib.check_numerics_callback', 'tensorflow.python.client._pywrap_debug_events_writer', 'tensorflow.python.debug.lib.debug_events_writer', 'tensorflow.python.debug.lib.dumping_callback', 'tensorflow.python.dlpack', 'tensorflow.python.dlpack.dlpack', 'tensorflow.python.compiler.mlir', 'tensorflow.python._pywrap_mlir', 'tensorflow.python.pywrap_mlir', 'tensorflow.python.compiler.mlir.mlir', 'tensorflow.python', 'tensorflow.python.tools', 'tensorflow.python.tools.module_util', 'tensorflow._api', 'tensorflow._api.v2', 'tensorflow._api.v2.__internal__.autograph', 'tensorflow._api.v2.__internal__.decorator', 'tensorflow._api.v2.__internal__.dispatch', 'tensorflow.python.eager.test', 'tensorflow.python.distribute.multi_process_lib', 'tensorflow.python.distribute.multi_process_runner', 'tensorflow.python.distribute.distribute_coordinator', 'tensorflow.python.distribute.multi_worker_test_base', 'tensorflow.python.framework.test_combinations', 'tensorflow.python.framework.combinations', 'tensorflow.python.distribute.combinations', 'tensorflow.python.distribute.test_util', 'tensorflow.python.distribute.strategy_combinations', 'tensorflow._api.v2.__internal__.distribute.combinations', 'tensorflow.python.distribute.merge_call_interim', 'tensorflow._api.v2.__internal__.distribute.interim', 'tensorflow._api.v2.__internal__.distribute.multi_process_runner', 'tensorflow._api.v2.__internal__.distribute', 'tensorflow._api.v2.__internal__.eager_context', 'tensorflow._api.v2.__internal__.feature_column', 'tensorflow._api.v2.__internal__.function', 'tensorflow._api.v2.__internal__.graph_util', 'tensorflow._api.v2.__internal__.mixed_precision', 'tensorflow._api.v2.__internal__.monitoring', 'tensorflow._api.v2.__internal__.nest', 'tensorflow._api.v2.__internal__.ops', 'tensorflow._api.v2.__internal__.saved_model.load', 'tensorflow._api.v2.__internal__.saved_model', 'tensorflow._api.v2.__internal__.smart_cond', 'tensorflow._api.v2.__internal__.test.combinations', 'tensorflow._api.v2.__internal__.test', 'tensorflow._api.v2.__internal__.tf2', 'tensorflow._api.v2.__internal__.tracking', 'tensorflow._api.v2.__internal__.train', 'tensorflow._api.v2.__internal__.types', 'tensorflow._api.v2.__internal__', 'tensorflow._api.v2.__operators__', 'tensorflow._api.v2.audio', 'tensorflow._api.v2.autodiff', 'tensorflow._api.v2.autograph.experimental', 'tensorflow._api.v2.autograph', 'tensorflow._api.v2.bitwise', 'tensorflow._api.v2.compat.v1.app', 'tensorflow._api.v2.compat.v1.audio', 'tensorflow._api.v2.compat.v1.autograph.experimental', 'tensorflow._api.v2.compat.v1.autograph', 'tensorflow._api.v2.compat.v1.bitwise', 'tensorflow._api.v2.compat.v1.compat.v1.compat', 'tensorflow._api.v2.compat.v1.config.experimental', 'tensorflow._api.v2.compat.v1.config.optimizer', 'tensorflow._api.v2.compat.v1.config.threading', 'tensorflow._api.v2.compat.v1.config', 'tensorflow._api.v2.compat.v1.data.experimental.service', 'tensorflow._api.v2.compat.v1.data.experimental', 'tensorflow._api.v2.compat.v1.data', 'tensorflow._api.v2.compat.v1.debugging.experimental', 'tensorflow._api.v2.compat.v1.debugging', 'tensorflow._api.v2.compat.v1.distribute.cluster_resolver', 'tensorflow._api.v2.compat.v1.distribute.experimental', 'tensorflow._api.v2.compat.v1.distribute', 'tensorflow._api.v2.compat.v1.distributions', 'tensorflow._api.v2.compat.v1.dtypes', 'tensorflow._api.v2.compat.v1.errors', 'tensorflow.python.framework._pywrap_python_op_gen', 'tensorflow.python.framework.load_library', 'tensorflow._api.v2.compat.v1.experimental', 'tensorflow._api.v2.compat.v1.feature_column', 'tensorflow._api.v2.compat.v1.gfile', 'tensorflow._api.v2.compat.v1.graph_util', 'tensorflow._api.v2.compat.v1.image', 'tensorflow._api.v2.compat.v1.initializers', 'tensorflow._api.v2.compat.v1.io.gfile', 'tensorflow._api.v2.compat.v1.io', 'tensorflow._api.v2.compat.v1.layers.experimental', 'tensorflow._api.v2.compat.v1.layers', 'tensorflow._api.v2.compat.v1.linalg.experimental', 'tensorflow._api.v2.compat.v1.linalg', 'tensorflow.lite', 'tensorflow.lite.python', 'tensorflow.lite.toco', 'tensorflow.lite.toco.types_pb2', 'tensorflow.lite.toco.toco_flags_pb2', 'tensorflow.lite.python.lite_constants', 'tensorflow._api.v2.compat.v1.lite.constants', 'tensorflow.lite.python.authoring', 'imp', 'flatbuffers.compat', 'flatbuffers.packer', 'flatbuffers.number_types', 'flatbuffers.encode', 'flatbuffers.builder', 'flatbuffers.table', 'flatbuffers.util', 'flatbuffers', 'tensorflow.lite.python.conversion_metadata_schema_py_generated', 'tensorflow.lite.python.schema_py_generated', 'tensorflow.lite.python.schema_util', 'tensorflow.lite.python.tflite_keras_util', 'tensorflow.lite.python.op_hint', 'tensorflow.lite.tools', 'tensorflow.lite.tools.flatbuffer_utils', 'tensorflow.lite.python.util', 'tensorflow.python._pywrap_toco_api', 'tensorflow.lite.python.wrap_toco', 'tensorflow.lite.python.metrics', 'tensorflow.lite.python.metrics.converter_error_data_pb2', 'tensorflow.lite.python.metrics.metrics_interface', 'tensorflow.lite.python.metrics.metrics', 'tensorflow.lite.python.convert_phase', 'tensorflow.lite.python.metrics.wrapper', 'tensorflow.lite.python.metrics._pywrap_tensorflow_lite_metrics_wrapper', 'tensorflow.lite.python.metrics.wrapper.metrics_wrapper', 'tensorflow.lite.toco.model_flags_pb2', 'tensorflow.lite.python.convert', 'tensorflow.lite.experimental', 'tensorflow.lite.experimental.microfrontend', 'tensorflow.lite.experimental.microfrontend.python', 'tensorflow.lite.experimental.microfrontend.python.ops', 'tensorflow.lite.experimental.microfrontend.ops', 'tensorflow.lite.experimental.microfrontend.ops.gen_audio_microfrontend_op', 'aa8f2297d25b4dc6fd3d98411eb3ba53823c4f42', 'tensorflow.lite.experimental.microfrontend.python.ops.audio_microfrontend_op', 'tensorflow.lite.python.convert_saved_model', 'tensorflow.lite.python.interpreter_wrapper', 'tensorflow.lite.python.interpreter_wrapper._pywrap_tensorflow_interpreter_wrapper', 'tensorflow.lite.python.interpreter', 'tensorflow.lite.python.optimize', 'tensorflow.lite.python.optimize.calibrator', 'tensorflow.lite.tools.optimize', 'tensorflow.lite.tools.optimize.debugging', 'tensorflow.lite.tools.optimize.debugging.python', 'tensorflow.lite.tools.optimize.debugging.python.debugger', 'tensorflow.lite.python.lite', 'tensorflow.lite.python.authoring.authoring', 'tensorflow._api.v2.compat.v1.lite.experimental.authoring', 'tensorflow.lite.python.analyzer_wrapper', 'tensorflow.lite.python.analyzer_wrapper._pywrap_analyzer_wrapper', 'tensorflow.lite.python.analyzer', 'tensorflow._api.v2.compat.v1.lite.experimental', 'tensorflow._api.v2.compat.v1.lite', 'tensorflow._api.v2.compat.v1.logging', 'tensorflow._api.v2.compat.v1.lookup.experimental', 'tensorflow._api.v2.compat.v1.lookup', 'tensorflow._api.v2.compat.v1.losses', 'tensorflow._api.v2.compat.v1.manip', 'tensorflow._api.v2.compat.v1.math.special', 'tensorflow._api.v2.compat.v1.math', 'tensorflow._api.v2.compat.v1.metrics', 'tensorflow._api.v2.compat.v1.mixed_precision.experimental', 'tensorflow._api.v2.compat.v1.mixed_precision', 'tensorflow._api.v2.compat.v1.mlir.experimental', 'tensorflow._api.v2.compat.v1.mlir', 'tensorflow._api.v2.compat.v1.nest', 'tensorflow._api.v2.compat.v1.nn.experimental', 'tensorflow._api.v2.compat.v1.nn.rnn_cell', 'tensorflow._api.v2.compat.v1.nn', 'tensorflow._api.v2.compat.v1.profiler', 'tensorflow._api.v2.compat.v1.python_io', 'tensorflow._api.v2.compat.v1.quantization', 'tensorflow._api.v2.compat.v1.queue', 'tensorflow._api.v2.compat.v1.ragged', 'tensorflow._api.v2.compat.v1.random.experimental', 'tensorflow._api.v2.compat.v1.random', 'tensorflow._api.v2.compat.v1.raw_ops', 'tensorflow._api.v2.compat.v1.resource_loader', 'tensorflow._api.v2.compat.v1.saved_model.builder', 'tensorflow._api.v2.compat.v1.saved_model.constants', 'tensorflow._api.v2.compat.v1.saved_model.experimental', 'tensorflow._api.v2.compat.v1.saved_model.loader', 'tensorflow._api.v2.compat.v1.saved_model.main_op', 'tensorflow._api.v2.compat.v1.saved_model.signature_constants', 'tensorflow._api.v2.compat.v1.saved_model.signature_def_utils', 'tensorflow._api.v2.compat.v1.saved_model.tag_constants', 'tensorflow._api.v2.compat.v1.saved_model.utils', 'tensorflow._api.v2.compat.v1.saved_model', 'tensorflow._api.v2.compat.v1.sets', 'tensorflow._api.v2.compat.v1.signal', 'tensorflow._api.v2.compat.v1.sparse', 'tensorflow._api.v2.compat.v1.spectral', 'tensorflow._api.v2.compat.v1.strings', 'tensorflow._api.v2.compat.v1.summary', 'tensorflow._api.v2.compat.v1.sysconfig', 'tensorflow._api.v2.compat.v1.test', 'tensorflow._api.v2.compat.v1.tpu.experimental.embedding', 'tensorflow._api.v2.compat.v1.tpu.experimental', 'tensorflow._api.v2.compat.v1.tpu', 'tensorflow._api.v2.compat.v1.train.experimental', 'tensorflow._api.v2.compat.v1.train.queue_runner', 'tensorflow._api.v2.compat.v1.train', 'tensorflow._api.v2.compat.v1.types.experimental', 'tensorflow._api.v2.compat.v1.types', 'tensorflow._api.v2.compat.v1.user_ops', 'tensorflow._api.v2.compat.v1.version', 'tensorflow._api.v2.compat.v1.xla.experimental', 'tensorflow._api.v2.compat.v1.xla', 'tensorflow._api.v2.compat.v1.compat.v1', 'tensorflow._api.v2.compat.v1.compat.v2.compat', 'tensorflow._api.v2.compat.v2.__internal__.autograph', 'tensorflow._api.v2.compat.v2.__internal__.decorator', 'tensorflow._api.v2.compat.v2.__internal__.dispatch', 'tensorflow._api.v2.compat.v2.__internal__.distribute.combinations', 'tensorflow._api.v2.compat.v2.__internal__.distribute.interim', 'tensorflow._api.v2.compat.v2.__internal__.distribute.multi_process_runner', 'tensorflow._api.v2.compat.v2.__internal__.distribute', 'tensorflow._api.v2.compat.v2.__internal__.eager_context', 'tensorflow._api.v2.compat.v2.__internal__.feature_column', 'tensorflow._api.v2.compat.v2.__internal__.function', 'tensorflow._api.v2.compat.v2.__internal__.graph_util', 'tensorflow._api.v2.compat.v2.__internal__.mixed_precision', 'tensorflow._api.v2.compat.v2.__internal__.monitoring', 'tensorflow._api.v2.compat.v2.__internal__.nest', 'tensorflow._api.v2.compat.v2.__internal__.ops', 'tensorflow._api.v2.compat.v2.__internal__.saved_model.load', 'tensorflow._api.v2.compat.v2.__internal__.saved_model', 'tensorflow._api.v2.compat.v2.__internal__.smart_cond', 'tensorflow._api.v2.compat.v2.__internal__.test.combinations', 'tensorflow._api.v2.compat.v2.__internal__.test', 'tensorflow._api.v2.compat.v2.__internal__.tf2', 'tensorflow._api.v2.compat.v2.__internal__.tracking', 'tensorflow._api.v2.compat.v2.__internal__.train', 'tensorflow._api.v2.compat.v2.__internal__.types', 'tensorflow._api.v2.compat.v2.__internal__', 'tensorflow._api.v2.compat.v2.__operators__', 'tensorflow._api.v2.compat.v2.audio', 'tensorflow._api.v2.compat.v2.autodiff', 'tensorflow._api.v2.compat.v2.autograph.experimental', 'tensorflow._api.v2.compat.v2.autograph', 'tensorflow._api.v2.compat.v2.bitwise', 'tensorflow._api.v2.compat.v2.compat.v1.compat', 'tensorflow._api.v2.compat.v2.compat.v1', 'tensorflow._api.v2.compat.v2.compat.v2.compat', 'tensorflow._api.v2.compat.v2.config.experimental', 'tensorflow._api.v2.compat.v2.config.optimizer', 'tensorflow._api.v2.compat.v2.config.threading', 'tensorflow._api.v2.compat.v2.config', 'tensorflow._api.v2.compat.v2.data.experimental.service', 'tensorflow._api.v2.compat.v2.data.experimental', 'tensorflow._api.v2.compat.v2.data', 'tensorflow._api.v2.compat.v2.debugging.experimental', 'tensorflow._api.v2.compat.v2.debugging', 'tensorflow._api.v2.compat.v2.distribute.cluster_resolver', 'tensorflow._api.v2.compat.v2.distribute.coordinator', 'tensorflow._api.v2.compat.v2.distribute.experimental.coordinator', 'tensorflow._api.v2.compat.v2.distribute.experimental.partitioners', 'tensorflow.python.distribute.experimental', 'tensorflow.python.distribute.experimental.rpc', 'tensorflow.distribute', 'tensorflow.distribute.experimental', 'tensorflow.distribute.experimental.rpc', 'tensorflow.distribute.experimental.rpc.kernels', 'tensorflow.distribute.experimental.rpc.kernels.gen_rpc_ops', 'tensorflow.distribute.experimental.rpc.proto', 'tensorflow.distribute.experimental.rpc.proto.tf_rpc_service_pb2', 'tensorflow.python.distribute.experimental.rpc.rpc_ops', 'tensorflow._api.v2.compat.v2.distribute.experimental.rpc', 'tensorflow._api.v2.compat.v2.distribute.experimental', 'tensorflow._api.v2.compat.v2.distribute', 'tensorflow._api.v2.compat.v2.dtypes', 'tensorflow._api.v2.compat.v2.errors', 'tensorflow._api.v2.compat.v2.experimental.dlpack', 'tensorflow.dtensor', 'tensorflow.dtensor.python.gen_dtensor_ops', 'tensorflow.dtensor.proto', 'tensorflow.dtensor.proto.layout_pb2', 'tensorflow.dtensor.python.layout', 'tensorflow.python._pywrap_dtensor_device', 'tensorflow.dtensor.python.dtensor_device', 'tensorflow.dtensor.python.api', 'tensorflow.dtensor.python.multi_client_util', 'tensorflow.dtensor.python.heartbeat', 'tensorflow.dtensor.python.tpu_util', 'tensorflow.dtensor.python.mesh_util', 'tensorflow.dtensor.python.d_variable', 'tensorflow.dtensor.python.save_restore', 'tensorflow.dtensor.python.d_checkpoint', 'tensorflow.dtensor.python', 'tensorflow._api.v2.compat.v2.experimental.dtensor', 'tensorflow._api.v2.compat.v2.experimental.numpy.random', 'tensorflow._api.v2.compat.v2.experimental.numpy', 'tensorflow._api.v2.compat.v2.experimental.tensorrt', 'tensorflow._api.v2.compat.v2.experimental', 'tensorflow._api.v2.compat.v2.feature_column', 'tensorflow._api.v2.compat.v2.graph_util', 'tensorflow._api.v2.compat.v2.image', 'tensorflow._api.v2.compat.v2.io.gfile', 'tensorflow._api.v2.compat.v2.io', 'tensorflow._api.v2.compat.v2.linalg.experimental', 'tensorflow._api.v2.compat.v2.linalg', 'tensorflow._api.v2.compat.v2.lite.experimental.authoring', 'tensorflow._api.v2.compat.v2.lite.experimental', 'tensorflow._api.v2.compat.v2.lite', 'tensorflow._api.v2.compat.v2.lookup.experimental', 'tensorflow._api.v2.compat.v2.lookup', 'tensorflow._api.v2.compat.v2.math.special', 'tensorflow._api.v2.compat.v2.math', 'tensorflow._api.v2.compat.v2.mlir.experimental', 'tensorflow._api.v2.compat.v2.mlir', 'tensorflow._api.v2.compat.v2.nest', 'tensorflow._api.v2.compat.v2.nn.experimental', 'tensorflow._api.v2.compat.v2.nn', 'tensorflow._api.v2.compat.v2.profiler.experimental.client', 'tensorflow._api.v2.compat.v2.profiler.experimental.server', 'tensorflow._api.v2.compat.v2.profiler.experimental', 'tensorflow._api.v2.compat.v2.profiler', 'tensorflow._api.v2.compat.v2.quantization', 'tensorflow._api.v2.compat.v2.queue', 'tensorflow._api.v2.compat.v2.ragged', 'tensorflow._api.v2.compat.v2.random.experimental', 'tensorflow._api.v2.compat.v2.random', 'tensorflow._api.v2.compat.v2.raw_ops', 'tensorflow._api.v2.compat.v2.saved_model.experimental', 'tensorflow._api.v2.compat.v2.saved_model', 'tensorflow._api.v2.compat.v2.sets', 'tensorflow._api.v2.compat.v2.signal', 'tensorflow._api.v2.compat.v2.sparse', 'tensorflow._api.v2.compat.v2.strings', 'tensorflow._api.v2.compat.v2.summary.experimental', 'tensorflow._api.v2.compat.v2.summary', 'tensorflow._api.v2.compat.v2.sysconfig', 'tensorflow._api.v2.compat.v2.test', 'tensorflow._api.v2.compat.v2.tpu.experimental.embedding', 'tensorflow._api.v2.compat.v2.tpu.experimental', 'tensorflow._api.v2.compat.v2.tpu', 'tensorflow._api.v2.compat.v2.train.experimental', 'tensorflow._api.v2.compat.v2.train', 'tensorflow._api.v2.compat.v2.types.experimental', 'tensorflow._api.v2.compat.v2.types', 'tensorflow._api.v2.compat.v2.version', 'tensorflow._api.v2.compat.v2.xla.experimental', 'tensorflow._api.v2.compat.v2.xla', 'tensorboard.lazy', 'tensorboard.version', 'tensorboard', 'tensorboard.plugins', 'tensorboard.plugins.audio', 'tensorboard.util', 'tensorboard.util.op_evaluator', 'tensorboard.util.encoder', 'tensorboard.compat', 'tensorboard.compat.proto', 'tensorboard.compat.proto.tensor_shape_pb2', 'tensorboard.compat.proto.types_pb2', 'tensorboard.compat.proto.resource_handle_pb2', 'tensorboard.compat.proto.tensor_pb2', 'tensorboard.compat.proto.summary_pb2', 'tensorboard.plugins.audio.plugin_data_pb2', 'tensorboard.plugins.audio.metadata', 'tensorboard.util.lazy_tensor_creator', 'tensorboard.plugins.audio.summary_v2', 'tensorboard.plugins.audio.summary', 'tensorboard.plugins.custom_scalar', 'tensorboard.plugins.custom_scalar.layout_pb2', 'tensorboard.plugins.custom_scalar.metadata', 'tensorboard.plugins.custom_scalar.summary', 'tensorboard.plugins.histogram', 'tensorboard.plugins.histogram.plugin_data_pb2', 'tensorboard.plugins.histogram.metadata', 'tensorboard.compat.proto.cost_graph_pb2', 'tensorboard.compat.proto.attr_value_pb2', 'tensorboard.compat.proto.full_type_pb2', 'tensorboard.compat.proto.node_def_pb2', 'tensorboard.compat.proto.op_def_pb2', 'tensorboard.compat.proto.function_pb2', 'tensorboard.compat.proto.versions_pb2', 'tensorboard.compat.proto.graph_pb2', 'tensorboard.compat.proto.allocation_description_pb2', 'tensorboard.compat.proto.tensor_description_pb2', 'tensorboard.compat.proto.step_stats_pb2', 'tensorboard.compat.proto.cluster_pb2', 'tensorboard.compat.proto.coordination_config_pb2', 'tensorboard.compat.proto.debug_pb2', 'tensorboard.compat.proto.verifier_config_pb2', 'tensorboard.compat.proto.rewriter_config_pb2', 'tensorboard.compat.proto.config_pb2', 'tensorboard.compat.proto.event_pb2', 'tensorboard.compat.proto.variable_pb2', 'tensorboard.compat.proto.struct_pb2', 'tensorboard.compat.proto.trackable_object_graph_pb2', 'tensorboard.compat.proto.saved_object_graph_pb2', 'tensorboard.compat.proto.saver_pb2', 'tensorboard.compat.proto.meta_graph_pb2', 'tensorboard.compat.tensorflow_stub.error_codes', 'tensorboard.compat.tensorflow_stub.errors', 'tensorboard.compat.tensorflow_stub.compat.v1', 'tensorboard.compat.tensorflow_stub.compat', 'tensorboard.compat.tensorflow_stub.io.gfile', 'tensorboard.compat.tensorflow_stub.io', 'tensorboard.compat.tensorflow_stub.pywrap_tensorflow', 'tensorboard.compat.tensorflow_stub.dtypes', 'tensorboard.compat.tensorflow_stub.flags', 'tensorboard.compat.tensorflow_stub.app', 'tensorboard.compat.tensorflow_stub.tensor_shape', 'tensorboard.compat.tensorflow_stub', 'tensorboard.util.tensor_util', 'tensorboard.plugins.histogram.summary_v2', 'tensorboard.plugins.histogram.summary', 'tensorboard.plugins.image', 'tensorboard.plugins.image.plugin_data_pb2', 'tensorboard.plugins.image.metadata', 'tensorboard.plugins.image.summary_v2', 'tensorboard.plugins.image.summary', 'tensorboard.plugins.pr_curve', 'tensorboard.plugins.pr_curve.plugin_data_pb2', 'tensorboard.plugins.pr_curve.metadata', 'tensorboard.plugins.pr_curve.summary', 'tensorboard.plugins.scalar', 'tensorboard.plugins.scalar.plugin_data_pb2', 'tensorboard.plugins.scalar.metadata', 'tensorboard.plugins.scalar.summary_v2', 'tensorboard.plugins.scalar.summary', 'tensorboard.plugins.text', 'tensorboard.plugins.text.plugin_data_pb2', 'tensorboard.plugins.text.metadata', 'tensorboard.plugins.text.summary_v2', 'tensorboard.plugins.text.summary', 'tensorboard.summary.v1', 'tensorboard.summary.v2', 'tensorboard.summary.writer', 'tensorboard.summary.writer.record_writer', 'tensorboard.summary.writer.event_file_writer', 'tensorboard.summary._output', 'tensorboard.summary._writer', 'tensorboard.summary', 'tensorboard.summary._tf', 'tensorboard.summary._tf.summary', 'tensorflow._api.v2.compat.v2.compat.v2', 'tensorflow._api.v2.compat.v2.compat', 'tensorflow._api.v2.compat.v2', 'tensorflow._api.v2.compat.v1.compat.v2', 'tensorflow._api.v2.compat.v1.compat', 'tensorflow._api.v2.compat.v1', 'tensorflow._api.v2.compat', 'tensorflow._api.v2.config.experimental', 'tensorflow._api.v2.config.optimizer', 'tensorflow._api.v2.config.threading', 'tensorflow._api.v2.config', 'tensorflow._api.v2.data.experimental.service', 'tensorflow._api.v2.data.experimental', 'tensorflow._api.v2.data', 'tensorflow._api.v2.debugging.experimental', 'tensorflow._api.v2.debugging', 'tensorflow._api.v2.distribute.cluster_resolver', 'tensorflow._api.v2.distribute.coordinator', 'tensorflow._api.v2.distribute.experimental.coordinator', 'tensorflow._api.v2.distribute.experimental.partitioners', 'tensorflow._api.v2.distribute.experimental.rpc', 'tensorflow._api.v2.distribute.experimental', 'tensorflow._api.v2.distribute', 'tensorflow._api.v2.dtypes', 'tensorflow._api.v2.errors', 'tensorflow._api.v2.experimental.dlpack', 'tensorflow._api.v2.experimental.dtensor', 'tensorflow._api.v2.experimental.numpy.random', 'tensorflow._api.v2.experimental.numpy', 'tensorflow._api.v2.experimental.tensorrt', 'tensorflow._api.v2.experimental', 'tensorflow._api.v2.feature_column', 'tensorflow._api.v2.graph_util', 'tensorflow._api.v2.image', 'tensorflow._api.v2.io.gfile', 'tensorflow._api.v2.io', 'tensorflow._api.v2.linalg.experimental', 'tensorflow._api.v2.linalg', 'tensorflow._api.v2.lite.experimental.authoring', 'tensorflow._api.v2.lite.experimental', 'tensorflow._api.v2.lite', 'tensorflow._api.v2.lookup.experimental', 'tensorflow._api.v2.lookup', 'tensorflow._api.v2.math.special', 'tensorflow._api.v2.math', 'tensorflow._api.v2.mlir.experimental', 'tensorflow._api.v2.mlir', 'tensorflow._api.v2.nest', 'tensorflow._api.v2.nn.experimental', 'tensorflow._api.v2.nn', 'tensorflow._api.v2.profiler.experimental.client', 'tensorflow._api.v2.profiler.experimental.server', 'tensorflow._api.v2.profiler.experimental', 'tensorflow._api.v2.profiler', 'tensorflow._api.v2.quantization', 'tensorflow._api.v2.queue', 'tensorflow._api.v2.ragged', 'tensorflow._api.v2.random.experimental', 'tensorflow._api.v2.random', 'tensorflow._api.v2.raw_ops', 'tensorflow._api.v2.saved_model.experimental', 'tensorflow._api.v2.saved_model', 'tensorflow._api.v2.sets', 'tensorflow._api.v2.signal', 'tensorflow._api.v2.sparse', 'tensorflow._api.v2.strings', 'tensorflow._api.v2.summary.experimental', 'tensorflow._api.v2.summary', 'tensorflow._api.v2.sysconfig', 'tensorflow._api.v2.test', 'tensorflow._api.v2.tpu.experimental.embedding', 'tensorflow._api.v2.tpu.experimental', 'tensorflow._api.v2.tpu', 'tensorflow._api.v2.train.experimental', 'tensorflow._api.v2.train', 'tensorflow._api.v2.types.experimental', 'tensorflow._api.v2.types', 'tensorflow._api.v2.version', 'tensorflow._api.v2.xla.experimental', 'tensorflow._api.v2.xla', 'tensorflow.compat.v1.app', 'tensorflow.compat.v1.audio', 'tensorflow.compat.v1.autograph.experimental', 'tensorflow.compat.v1.autograph', 'tensorflow.compat.v1.bitwise', 'tensorflow.compat.v1.compat.v1.compat', 'tensorflow.compat.v1.compat.v1', 'tensorflow.compat.v1.compat.v2.compat', 'tensorflow.compat.v1.compat.v2', 'tensorflow.compat.v1.compat', 'tensorflow.compat.v1.config.experimental', 'tensorflow.compat.v1.config.optimizer', 'tensorflow.compat.v1.config.threading', 'tensorflow.compat.v1.config', 'tensorflow.compat.v1.data.experimental.service', 'tensorflow.compat.v1.data.experimental', 'tensorflow.compat.v1.data', 'tensorflow.compat.v1.debugging.experimental', 'tensorflow.compat.v1.debugging', 'tensorflow.compat.v1.distribute.cluster_resolver', 'tensorflow.compat.v1.distribute.experimental', 'tensorflow.compat.v1.distribute', 'tensorflow.compat.v1.distributions', 'tensorflow.compat.v1.dtypes', 'tensorflow.compat.v1.errors', 'tensorflow.compat.v1.experimental', 'tensorflow.compat.v1.feature_column', 'tensorflow.compat.v1.gfile', 'tensorflow.compat.v1.graph_util', 'tensorflow.compat.v1.image', 'tensorflow.compat.v1.initializers', 'tensorflow.compat.v1.io.gfile', 'tensorflow.compat.v1.io', 'tensorflow.compat.v1.layers.experimental', 'tensorflow.compat.v1.layers', 'tensorflow.compat.v1.linalg.experimental', 'tensorflow.compat.v1.linalg', 'tensorflow.compat.v1.lite.constants', 'tensorflow.compat.v1.lite.experimental.authoring', 'tensorflow.compat.v1.lite.experimental', 'tensorflow.compat.v1.lite', 'tensorflow.compat.v1.logging', 'tensorflow.compat.v1.lookup.experimental', 'tensorflow.compat.v1.lookup', 'tensorflow.compat.v1.losses', 'tensorflow.compat.v1.manip', 'tensorflow.compat.v1.math.special', 'tensorflow.compat.v1.math', 'tensorflow.compat.v1.metrics', 'tensorflow.compat.v1.mixed_precision.experimental', 'tensorflow.compat.v1.mixed_precision', 'tensorflow.compat.v1.mlir.experimental', 'tensorflow.compat.v1.mlir', 'tensorflow.compat.v1.nest', 'tensorflow.compat.v1.nn.experimental', 'tensorflow.compat.v1.nn.rnn_cell', 'tensorflow.compat.v1.nn', 'tensorflow.compat.v1.profiler', 'tensorflow.compat.v1.python_io', 'tensorflow.compat.v1.quantization', 'tensorflow.compat.v1.queue', 'tensorflow.compat.v1.ragged', 'tensorflow.compat.v1.random.experimental', 'tensorflow.compat.v1.random', 'tensorflow.compat.v1.raw_ops', 'tensorflow.compat.v1.resource_loader', 'tensorflow.compat.v1.saved_model.builder', 'tensorflow.compat.v1.saved_model.constants', 'tensorflow.compat.v1.saved_model.experimental', 'tensorflow.compat.v1.saved_model.loader', 'tensorflow.compat.v1.saved_model.main_op', 'tensorflow.compat.v1.saved_model.signature_constants', 'tensorflow.compat.v1.saved_model.signature_def_utils', 'tensorflow.compat.v1.saved_model.tag_constants', 'tensorflow.compat.v1.saved_model.utils', 'tensorflow.compat.v1.saved_model', 'tensorflow.compat.v1.sets', 'tensorflow.compat.v1.signal', 'tensorflow.compat.v1.sparse', 'tensorflow.compat.v1.spectral', 'tensorflow.compat.v1.strings', 'tensorflow.compat.v1.summary', 'tensorflow.compat.v1.sysconfig', 'tensorflow.compat.v1.test', 'tensorflow.compat.v1.tpu.experimental.embedding', 'tensorflow.compat.v1.tpu.experimental', 'tensorflow.compat.v1.tpu', 'tensorflow.compat.v1.train.experimental', 'tensorflow.compat.v1.train.queue_runner', 'tensorflow.compat.v1.train', 'tensorflow.compat.v1.types.experimental', 'tensorflow.compat.v1.types', 'tensorflow.compat.v1.user_ops', 'tensorflow.compat.v1.version', 'tensorflow.compat.v1.xla.experimental', 'tensorflow.compat.v1.xla', 'tensorflow.compat.v1', 'tensorflow.compat.v2.__internal__.autograph', 'tensorflow.compat.v2.__internal__.decorator', 'tensorflow.compat.v2.__internal__.dispatch', 'tensorflow.compat.v2.__internal__.distribute.combinations', 'tensorflow.compat.v2.__internal__.distribute.interim', 'tensorflow.compat.v2.__internal__.distribute.multi_process_runner', 'tensorflow.compat.v2.__internal__.distribute', 'tensorflow.compat.v2.__internal__.eager_context', 'tensorflow.compat.v2.__internal__.feature_column', 'tensorflow.compat.v2.__internal__.function', 'tensorflow.compat.v2.__internal__.graph_util', 'tensorflow.compat.v2.__internal__.mixed_precision', 'tensorflow.compat.v2.__internal__.monitoring', 'tensorflow.compat.v2.__internal__.nest', 'tensorflow.compat.v2.__internal__.ops', 'tensorflow.compat.v2.__internal__.saved_model.load', 'tensorflow.compat.v2.__internal__.saved_model', 'tensorflow.compat.v2.__internal__.smart_cond', 'tensorflow.compat.v2.__internal__.test.combinations', 'tensorflow.compat.v2.__internal__.test', 'tensorflow.compat.v2.__internal__.tf2', 'tensorflow.compat.v2.__internal__.tracking', 'tensorflow.compat.v2.__internal__.train', 'tensorflow.compat.v2.__internal__.types', 'tensorflow.compat.v2.__internal__', 'tensorflow.compat.v2.__operators__', 'tensorflow.compat.v2.audio', 'tensorflow.compat.v2.autodiff', 'tensorflow.compat.v2.autograph.experimental', 'tensorflow.compat.v2.autograph', 'tensorflow.compat.v2.bitwise', 'tensorflow.compat.v2.compat.v1.compat', 'tensorflow.compat.v2.compat.v1', 'tensorflow.compat.v2.compat.v2.compat', 'tensorflow.compat.v2.compat.v2', 'tensorflow.compat.v2.compat', 'tensorflow.compat.v2.config.experimental', 'tensorflow.compat.v2.config.optimizer', 'tensorflow.compat.v2.config.threading', 'tensorflow.compat.v2.config', 'tensorflow.compat.v2.data.experimental.service', 'tensorflow.compat.v2.data.experimental', 'tensorflow.compat.v2.data', 'tensorflow.compat.v2.debugging.experimental', 'tensorflow.compat.v2.debugging', 'tensorflow.compat.v2.distribute.cluster_resolver', 'tensorflow.compat.v2.distribute.coordinator', 'tensorflow.compat.v2.distribute.experimental.coordinator', 'tensorflow.compat.v2.distribute.experimental.partitioners', 'tensorflow.compat.v2.distribute.experimental.rpc', 'tensorflow.compat.v2.distribute.experimental', 'tensorflow.compat.v2.distribute', 'tensorflow.compat.v2.dtypes', 'tensorflow.compat.v2.errors', 'tensorflow.compat.v2.experimental.dlpack', 'tensorflow.compat.v2.experimental.dtensor', 'tensorflow.compat.v2.experimental.numpy.random', 'tensorflow.compat.v2.experimental.numpy', 'tensorflow.compat.v2.experimental.tensorrt', 'tensorflow.compat.v2.experimental', 'tensorflow.compat.v2.feature_column', 'tensorflow.compat.v2.graph_util', 'tensorflow.compat.v2.image', 'tensorflow.compat.v2.io.gfile', 'tensorflow.compat.v2.io', 'tensorflow.compat.v2.linalg.experimental', 'tensorflow.compat.v2.linalg', 'tensorflow.compat.v2.lite.experimental.authoring', 'tensorflow.compat.v2.lite.experimental', 'tensorflow.compat.v2.lite', 'tensorflow.compat.v2.lookup.experimental', 'tensorflow.compat.v2.lookup', 'tensorflow.compat.v2.math.special', 'tensorflow.compat.v2.math', 'tensorflow.compat.v2.mlir.experimental', 'tensorflow.compat.v2.mlir', 'tensorflow.compat.v2.nest', 'tensorflow.compat.v2.nn.experimental', 'tensorflow.compat.v2.nn', 'tensorflow.compat.v2.profiler.experimental.client', 'tensorflow.compat.v2.profiler.experimental.server', 'tensorflow.compat.v2.profiler.experimental', 'tensorflow.compat.v2.profiler', 'tensorflow.compat.v2.quantization', 'tensorflow.compat.v2.queue', 'tensorflow.compat.v2.ragged', 'tensorflow.compat.v2.random.experimental', 'tensorflow.compat.v2.random', 'tensorflow.compat.v2.raw_ops', 'tensorflow.compat.v2.saved_model.experimental', 'tensorflow.compat.v2.saved_model', 'tensorflow.compat.v2.sets', 'tensorflow.compat.v2.signal', 'tensorflow.compat.v2.sparse', 'tensorflow.compat.v2.strings', 'tensorflow.compat.v2.summary.experimental', 'tensorflow.compat.v2.summary', 'tensorflow.compat.v2.sysconfig', 'tensorflow.compat.v2.test', 'tensorflow.compat.v2.tpu.experimental.embedding', 'tensorflow.compat.v2.tpu.experimental', 'tensorflow.compat.v2.tpu', 'tensorflow.compat.v2.train.experimental', 'tensorflow.compat.v2.train', 'tensorflow.compat.v2.types.experimental', 'tensorflow.compat.v2.types', 'tensorflow.compat.v2.version', 'tensorflow.compat.v2.xla.experimental', 'tensorflow.compat.v2.xla', 'tensorflow.compat.v2', 'tensorflow.compat', 'keras.distribute.sidecar_evaluator', 'keras.distribute', 'keras.engine', 'keras.backend_config', 'keras.distribute.distribute_coordinator_utils', 'six.moves.urllib.parse', 'keras.utils.tf_inspect', 'keras.utils.keras_logging', 'keras.utils.io_utils', 'keras.utils.tf_contextlib', 'keras.utils.generic_utils', 'keras.utils.data_utils', 'keras.utils.dataset_utils', 'PIL._version', 'PIL', 'PIL.ImageMode', 'PIL.TiffTags', 'PIL._binary', 'PIL._deprecate', 'PIL._util', 'PIL._imaging', 'PIL.Image', 'keras.utils.image_utils', 'keras.utils.image_dataset', 'keras.utils.text_dataset', 'keras.utils.object_identity', 'keras.utils.tf_utils', 'keras.utils.timeseries_dataset', 'keras.utils.vis_utils', 'keras.utils.np_utils', 'keras.utils.layer_utils', 'keras.utils', 'keras.engine.keras_tensor', 'keras.utils.control_flow_util', 'keras.backend', 'keras.dtensor', 'keras.dtensor.lazy_variable', 'keras.dtensor.utils', 'keras.constraints', 'keras.initializers.initializers_v1', 'keras.initializers.initializers_v2', 'keras.initializers', 'keras.regularizers', 'keras.engine.base_layer_utils', 'keras.engine.input_spec', 'keras.saving', 'keras.saving.saved_model', 'keras.saving.saved_model.json_utils', 'keras.engine.node', 'keras.optimizers.optimizer_v2', 'keras.optimizers.optimizer_v2.utils', 'keras.optimizers.schedules', 'keras.optimizers.schedules.learning_rate_schedule', 'keras.optimizers.optimizer_v2.optimizer_v2', 'keras.optimizers.optimizer_v2.gradient_descent', 'keras.optimizers.optimizer_v2.rmsprop', 'keras.optimizers.optimizer_v2.adam', 'keras.optimizers.optimizer_v2.adadelta', 'keras.optimizers.optimizer_v2.adagrad', 'keras.optimizers.optimizer_v2.adamax', 'keras.optimizers.optimizer_v2.nadam', 'keras.optimizers.optimizer_v2.ftrl', 'keras.optimizers.optimizer_experimental', 'keras.optimizers.optimizer_experimental.optimizer', 'keras.optimizers.optimizer_experimental.adadelta', 'keras.optimizers.optimizer_experimental.adagrad', 'keras.optimizers.optimizer_experimental.adam', 'keras.optimizers.optimizer_experimental.adamax', 'keras.optimizers.optimizer_experimental.adamw', 'keras.optimizers.optimizer_experimental.ftrl', 'keras.optimizers.optimizer_experimental.nadam', 'keras.optimizers.optimizer_experimental.rmsprop', 'keras.optimizers.optimizer_experimental.sgd', 'keras.optimizers.legacy', 'keras.optimizers.legacy.optimizer', 'keras.optimizers.legacy.adadelta', 'keras.optimizers.legacy.adagrad', 'keras.optimizers.legacy.adam', 'keras.optimizers.legacy.adamax', 'keras.optimizers.legacy.ftrl', 'keras.optimizers.legacy.nadam', 'keras.optimizers.legacy.rmsprop', 'keras.optimizers.legacy.sgd', 'keras.optimizers.optimizer_v1', 'keras.optimizers', 'keras.mixed_precision.loss_scale_optimizer', 'keras.mixed_precision.device_compatibility_check', 'keras.mixed_precision.policy', 'keras.mixed_precision', 'keras.distribute.distributed_training_utils', 'keras.mixed_precision.autocast_variable', 'keras.saving.saved_model.utils', 'keras.saving.saved_model.base_serialization', 'keras.saving.saved_model.constants', 'keras.utils.losses_utils', 'keras.losses', 'keras.utils.version_utils', 'keras.saving.saving_utils', 'keras.protobuf', 'keras.protobuf.versions_pb2', 'keras.protobuf.saved_metadata_pb2', 'keras.saving.saved_model.order_preserving_set', 'keras.saving.saved_model.serialized_attributes', 'keras.utils.metrics_utils', 'keras.saving.saved_model.load', 'keras.saving.saved_model.save_impl', 'keras.saving.saved_model.layer_serialization', 'keras.utils.traceback_utils', 'keras.engine.base_layer', 'keras.dtensor.layout_map', 'keras.engine.input_layer', 'keras.engine.functional_utils', 'keras.distribute.distributed_file_utils', 'keras.utils.mode_keys', 'keras.distribute.worker_training_state', 'keras.callbacks', 'keras.saving.saved_model.metric_serialization', 'keras.metrics.base_metric', 'keras.engine.training_utils', 'keras.utils.dataset_creator', 'keras.engine.data_adapter', 'keras.engine.base_preprocessing_layer', 'keras.layers.preprocessing', 'keras.layers.preprocessing.preprocessing_utils', 'keras.layers.preprocessing.image_preprocessing', 'keras.layers.preprocessing.category_encoding', 'keras.layers.preprocessing.discretization', 'keras.layers.preprocessing.hashing', 'keras.layers.preprocessing.hashed_crossing', 'keras.layers.preprocessing.index_lookup', 'keras.layers.preprocessing.integer_lookup', 'keras.layers.preprocessing.normalization', 'keras.layers.preprocessing.string_lookup', 'keras.layers.preprocessing.text_vectorization', 'keras.layers.activation.relu', 'keras.layers.activation.softmax', 'keras.layers.activation.leaky_relu', 'keras.layers.activation.prelu', 'keras.layers.activation.elu', 'keras.layers.activation.thresholded_relu', 'keras.layers.activation', 'keras.layers.einsum_dense', 'keras.layers.regularization.dropout', 'keras.layers.regularization.spatial_dropout1d', 'keras.layers.regularization.spatial_dropout2d', 'keras.layers.regularization.spatial_dropout3d', 'keras.layers.regularization.gaussian_dropout', 'keras.layers.regularization.gaussian_noise', 'keras.layers.regularization.activity_regularization', 'keras.layers.regularization.alpha_dropout', 'keras.layers.regularization', 'keras.layers.attention.multi_head_attention', 'keras.layers.attention.base_dense_attention', 'keras.layers.attention.attention', 'keras.layers.attention.additive_attention', 'keras.layers.attention', 'keras.utils.conv_utils', 'keras.layers.convolutional.base_conv', 'keras.layers.convolutional.conv1d', 'keras.layers.convolutional.conv2d', 'keras.layers.convolutional.conv3d', 'keras.layers.convolutional.conv1d_transpose', 'keras.layers.convolutional.conv2d_transpose', 'keras.layers.convolutional.conv3d_transpose', 'keras.layers.convolutional.base_depthwise_conv', 'keras.layers.convolutional.depthwise_conv1d', 'keras.layers.convolutional.depthwise_conv2d', 'keras.layers.convolutional.base_separable_conv', 'keras.layers.convolutional.separable_conv1d', 'keras.layers.convolutional.separable_conv2d', 'keras.layers.pooling.base_pooling1d', 'keras.layers.pooling.average_pooling1d', 'keras.layers.pooling.base_pooling2d', 'keras.layers.pooling.average_pooling2d', 'keras.layers.pooling.base_pooling3d', 'keras.layers.pooling.average_pooling3d', 'keras.layers.pooling.max_pooling1d', 'keras.layers.pooling.max_pooling2d', 'keras.layers.pooling.max_pooling3d', 'keras.layers.pooling.base_global_pooling1d', 'keras.layers.pooling.global_average_pooling1d', 'keras.layers.pooling.base_global_pooling2d', 'keras.layers.pooling.global_average_pooling2d', 'keras.layers.pooling.base_global_pooling3d', 'keras.layers.pooling.global_average_pooling3d', 'keras.layers.pooling.global_max_pooling1d', 'keras.layers.pooling.global_max_pooling2d', 'keras.layers.pooling.global_max_pooling3d', 'keras.layers.pooling', 'keras.layers.reshaping.cropping1d', 'keras.layers.reshaping.cropping2d', 'keras.layers.reshaping.cropping3d', 'keras.layers.reshaping.flatten', 'keras.layers.reshaping.permute', 'keras.layers.reshaping.repeat_vector', 'keras.layers.reshaping.reshape', 'keras.layers.reshaping.up_sampling1d', 'keras.layers.reshaping.up_sampling2d', 'keras.layers.reshaping.up_sampling3d', 'keras.layers.reshaping.zero_padding1d', 'keras.layers.reshaping.zero_padding2d', 'keras.layers.reshaping.zero_padding3d', 'keras.layers.reshaping', 'keras.layers.convolutional', 'keras.layers.core.activation', 'keras.layers.core.dense', 'keras.layers.core.embedding', 'keras.layers.core.lambda_layer', 'keras.layers.core.masking', 'keras.layers.core.tf_op_layer', 'keras.layers.core', 'keras.layers.locally_connected.locally_connected_utils', 'keras.layers.locally_connected.locally_connected1d', 'keras.layers.locally_connected.locally_connected2d', 'keras.layers.locally_connected', 'keras.layers.merging.base_merge', 'keras.layers.merging.add', 'keras.layers.merging.subtract', 'keras.layers.merging.multiply', 'keras.layers.merging.average', 'keras.layers.merging.maximum', 'keras.layers.merging.minimum', 'keras.layers.merging.concatenate', 'keras.layers.merging.dot', 'keras.layers.merging', 'keras.layers.normalization', 'keras.layers.normalization.layer_normalization', 'keras.layers.normalization.batch_normalization', 'keras.layers.normalization.unit_normalization', 'keras.layers.normalization.batch_normalization_v1', 'keras.layers.kernelized', 'keras.layers.rnn.rnn_utils', 'keras.layers.rnn.dropout_rnn_cell_mixin', 'keras.layers.rnn.stacked_rnn_cells', 'keras.layers.rnn.base_rnn', 'keras.layers.rnn.abstract_rnn_cell', 'keras.layers.rnn.simple_rnn', 'keras.layers.rnn.gru_lstm_utils', 'keras.layers.rnn.gru', 'keras.layers.rnn.lstm', 'keras.layers.rnn.gru_v1', 'keras.layers.rnn.lstm_v1', 'keras.layers.rnn.base_conv_rnn', 'keras.layers.rnn.base_conv_lstm', 'keras.layers.rnn.conv_lstm1d', 'keras.layers.rnn.conv_lstm2d', 'keras.layers.rnn.conv_lstm3d', 'keras.layers.rnn.base_cudnn_rnn', 'keras.layers.rnn.cudnn_lstm', 'keras.layers.rnn.cudnn_gru', 'keras.layers.rnn.base_wrapper', 'keras.layers.rnn.bidirectional', 'keras.layers.rnn.time_distributed', 'keras.layers.rnn.cell_wrappers', 'keras.layers.rnn', 'keras.layers.noise', 'keras.layers.serialization', 'keras.layers', 'keras.activations', 'keras.metrics.metrics', 'keras.metrics', 'keras.engine.compile_utils', 'keras.saving.model_config', 'keras.saving.hdf5_format', 'keras.saving.saved_model.load_context', 'keras.saving.saved_model.save', 'keras.saving.save', 'keras.saving.pickle_utils', 'keras.saving.saved_model.model_serialization', 'keras.engine.training', 'keras.saving.saved_model.network_serialization', 'keras.engine.functional', 'keras.engine.sequential', 'keras.engine.training_utils_v1', 'keras.distribute.distributed_training_utils_v1', 'keras.engine.training_arrays_v1', 'keras.engine.partial_batch_padding_handler', 'keras.engine.training_distributed_v1', 'keras.engine.training_eager_v1', 'keras.engine.training_generator_v1', 'keras.engine.training_v1', 'keras.models.cloning', 'keras.models.sharpness_aware_minimization', 'keras.models', 'keras', 'tensorflow.python.util.fast_module_type', 'tensorflow.tools.compatibility', 'tensorflow.tools.compatibility.renames_v2', 'tensorflow.tools.compatibility.all_renames_v2', 'tensorflow.python.util.module_wrapper', 'keras.api.keras.__internal__.layers', 'keras.legacy_tf_layers.migration_utils', 'keras.legacy_tf_layers', 'keras.engine.base_layer_v1', 'keras.legacy_tf_layers.variable_scope_shim', 'keras.legacy_tf_layers.base', 'keras.api.keras.__internal__.legacy.layers.experimental', 'keras.legacy_tf_layers.convolutional', 'keras.legacy_tf_layers.core', 'keras.legacy_tf_layers.normalization', 'keras.legacy_tf_layers.pooling', 'keras.api.keras.__internal__.legacy.layers', 'keras.layers.rnn.legacy_cells', 'keras.layers.rnn.legacy_cell_wrappers', 'keras.api.keras.__internal__.legacy.rnn_cell', 'keras.api.keras.__internal__.legacy', 'keras.api.keras.__internal__', 'keras.api.keras.activations', 'keras.applications.imagenet_utils', 'keras.applications.densenet', 'keras.applications.efficientnet', 'keras.applications.efficientnet_v2', 'keras.applications.inception_resnet_v2', 'keras.applications.inception_v3', 'keras.applications.mobilenet', 'keras.applications.mobilenet_v2', 'keras.applications.mobilenet_v3', 'keras.applications.nasnet', 'keras.applications.resnet', 'keras.applications.resnet_v2', 'keras.applications.resnet_rs', 'keras.applications.vgg16', 'keras.applications.vgg19', 'keras.applications.xception', 'keras.applications', 'keras.api.keras.applications.densenet', 'keras.api.keras.applications.efficientnet', 'keras.api.keras.applications.efficientnet_v2', 'keras.api.keras.applications.imagenet_utils', 'keras.api.keras.applications.inception_resnet_v2', 'keras.api.keras.applications.inception_v3', 'keras.api.keras.applications.mobilenet', 'keras.api.keras.applications.mobilenet_v2', 'keras.api.keras.applications.mobilenet_v3', 'keras.api.keras.applications.nasnet', 'keras.applications.regnet', 'keras.api.keras.applications.regnet', 'keras.api.keras.applications.resnet', 'keras.api.keras.applications.resnet50', 'keras.api.keras.applications.resnet_rs', 'keras.api.keras.applications.resnet_v2', 'keras.api.keras.applications.vgg16', 'keras.api.keras.applications.vgg19', 'keras.api.keras.applications.xception', 'keras.api.keras.applications', 'keras.api.keras.backend', 'keras.callbacks_v1', 'keras.api.keras.callbacks', 'keras.api.keras.constraints', 'keras.datasets', 'keras.datasets.boston_housing', 'keras.api.keras.datasets.boston_housing', 'keras.datasets.cifar', 'keras.datasets.cifar10', 'keras.api.keras.datasets.cifar10', 'keras.datasets.cifar100', 'keras.api.keras.datasets.cifar100', 'keras.datasets.fashion_mnist', 'keras.api.keras.datasets.fashion_mnist', 'scipy.ndimage._ni_support', 'scipy.ndimage._nd_image', 'scipy._lib.doccer', 'scipy.ndimage._ni_docstrings', 'scipy.ndimage._filters', 'scipy.ndimage._fourier', 'scipy.special._sf_error', 'scipy.special._ufuncs_cxx', 'scipy.special._ufuncs', 'scipy.special._specfun', 'scipy.special._comb', 'scipy.special._basic', 'scipy.special._logsumexp', 'scipy.special._orthogonal', 'scipy.special._spfun_stats', 'scipy.special._ellip_harm_2', 'scipy.special._ellip_harm', 'scipy.special._lambertw', 'scipy.special._spherical_bessel', 'scipy.special._add_newdocs', 'scipy.special.add_newdocs', 'scipy.special.basic', 'scipy.special.orthogonal', 'scipy.special.specfun', 'scipy.special.sf_error', 'scipy.special.spfun_stats', 'scipy.special', 'scipy.ndimage._interpolation', '_ni_label', 'scipy.ndimage._ni_label', 'scipy.ndimage._morphology', 'scipy.ndimage._measurements', 'scipy.ndimage.filters', 'scipy.ndimage.fourier', 'scipy.ndimage.interpolation', 'scipy.ndimage.measurements', 'scipy.ndimage.morphology', 'scipy.ndimage', 'PIL.ImageFilter', 'PIL.ImageStat', 'PIL.ImageEnhance', 'keras.preprocessing.image', 'keras.preprocessing.sequence', 'keras.preprocessing.text', 'keras.preprocessing', 'keras.datasets.imdb', 'keras.api.keras.datasets.imdb', 'keras.datasets.mnist', 'keras.api.keras.datasets.mnist', 'keras.datasets.reuters', 'keras.api.keras.datasets.reuters', 'keras.api.keras.datasets', 'keras.estimator', 'keras.api.keras.estimator', 'keras.feature_column', 'keras.feature_column.base_feature_layer', 'keras.feature_column.sequence_feature_column', 'keras.premade_models.linear', 'keras.premade_models.wide_deep', 'keras.premade_models', 'keras.saving.utils_v1.unexported_constants', 'keras.saving.utils_v1.signature_def_utils', 'keras.saving.utils_v1.export_output', 'keras.saving.utils_v1.mode_keys', 'keras.saving.utils_v1.export_utils', 'keras.saving.utils_v1', 'keras.saving.saved_model_experimental', 'keras.api.keras.experimental', 'keras.api.keras.initializers', 'keras.api.keras.layers.experimental.preprocessing', 'keras.api.keras.layers.experimental', 'keras.feature_column.dense_features', 'keras.api.keras.layers', 'keras.api.keras.losses', 'keras.api.keras.metrics', 'keras.api.keras.mixed_precision', 'keras.api.keras.models', 'keras.api.keras.optimizers.legacy', 'keras.api.keras.optimizers.schedules', 'keras.api.keras.optimizers', 'keras.api.keras.preprocessing.image', 'keras.api.keras.preprocessing.sequence', 'keras.api.keras.preprocessing.text', 'keras.api.keras.preprocessing', 'keras.api.keras.regularizers', 'keras.api.keras.utils', 'keras.wrappers', 'keras.wrappers.scikit_learn', 'keras.api.keras.wrappers.scikit_learn', 'keras.api.keras.wrappers', 'keras.api.keras', 'keras.api', 'keras.api._v2.keras.__internal__.backend', 'keras.api._v2.keras.__internal__.layers', 'keras.api._v2.keras.__internal__.losses', 'keras.api._v2.keras.__internal__.models', 'keras.testing_infra', 'keras.testing_infra.test_utils', 'keras.api._v2.keras.__internal__.utils', 'keras.api._v2.keras.__internal__', 'keras.api._v2.keras.activations', 'keras.api._v2.keras.applications.densenet', 'keras.api._v2.keras.applications.efficientnet', 'keras.api._v2.keras.applications.efficientnet_v2', 'keras.api._v2.keras.applications.imagenet_utils', 'keras.api._v2.keras.applications.inception_resnet_v2', 'keras.api._v2.keras.applications.inception_v3', 'keras.api._v2.keras.applications.mobilenet', 'keras.api._v2.keras.applications.mobilenet_v2', 'keras.api._v2.keras.applications.mobilenet_v3', 'keras.api._v2.keras.applications.nasnet', 'keras.api._v2.keras.applications.regnet', 'keras.api._v2.keras.applications.resnet', 'keras.api._v2.keras.applications.resnet50', 'keras.api._v2.keras.applications.resnet_rs', 'keras.api._v2.keras.applications.resnet_v2', 'keras.api._v2.keras.applications.vgg16', 'keras.api._v2.keras.applications.vgg19', 'keras.api._v2.keras.applications.xception', 'keras.api._v2.keras.applications', 'keras.api._v2.keras.backend.experimental', 'keras.api._v2.keras.backend', 'keras.api._v2.keras.callbacks.experimental', 'keras.api._v2.keras.callbacks', 'keras.api._v2.keras.constraints', 'keras.api._v2.keras.datasets.boston_housing', 'keras.api._v2.keras.datasets.cifar10', 'keras.api._v2.keras.datasets.cifar100', 'keras.api._v2.keras.datasets.fashion_mnist', 'keras.api._v2.keras.datasets.imdb', 'keras.api._v2.keras.datasets.mnist', 'keras.api._v2.keras.datasets.reuters', 'keras.api._v2.keras.datasets', 'keras.dtensor.optimizers', 'keras.api._v2.keras.dtensor.experimental.optimizers', 'keras.api._v2.keras.dtensor.experimental', 'keras.api._v2.keras.dtensor', 'keras.api._v2.keras.estimator', 'keras.api._v2.keras.experimental', 'keras.api._v2.keras.initializers', 'keras.api._v2.keras.layers.experimental.preprocessing', 'keras.api._v2.keras.layers.experimental', 'keras.feature_column.dense_features_v2', 'keras.api._v2.keras.layers', 'keras.api._v2.keras.losses', 'keras.api._v2.keras.metrics', 'keras.api._v2.keras.mixed_precision', 'keras.api._v2.keras.models', 'keras.api._v2.keras.optimizers.experimental', 'keras.api._v2.keras.optimizers.legacy', 'keras.api._v2.keras.optimizers.schedules', 'keras.api._v2.keras.optimizers', 'keras.api._v2.keras.preprocessing.image', 'keras.api._v2.keras.preprocessing.sequence', 'keras.api._v2.keras.preprocessing.text', 'keras.api._v2.keras.preprocessing', 'keras.api._v2.keras.regularizers', 'keras.api._v2.keras.utils.experimental', 'keras.api._v2.keras.utils', 'keras.api._v2.keras.wrappers.scikit_learn', 'keras.api._v2.keras.wrappers', 'keras.api._v2.keras', 'keras.api._v2', 'tensorflow', 'lib.gpu_stats.apple_silicon', 'lib.gpu_stats', 'plugins', 'plugins.plugin_loader', 'lib.cli.actions', 'logging.handlers', 'lib.logger', 'lib.cli.launcher', 'lib.cli.args', 'lib.config', 'scripts', 'scripts.train', 'cv2.load_config_py3', 'cv2.version', 'cv2.Error', 'cv2.cuda', 'cv2.detail', 'cv2.dnn', 'cv2.fisheye', 'cv2.flann', 'cv2.gapi.core', 'cv2.gapi.core.cpu', 'cv2.gapi.core.fluid', 'cv2.gapi.core.ocl', 'cv2.gapi.ie', 'cv2.gapi.ie.detail', 'cv2.gapi.oak', 'cv2.gapi.onnx', 'cv2.gapi.own', 'cv2.gapi.own.detail', 'cv2.gapi.render', 'cv2.gapi.render.ocv', 'cv2.gapi.streaming', 'cv2.gapi.video', 'cv2.gapi.wip', 'cv2.gapi.wip.draw', 'cv2.gapi.wip.gst', 'cv2.gapi.wip.onevpl', 'cv2.ipp', 'cv2.ml', 'cv2.ocl', 'cv2.ogl', 'cv2.parallel', 'cv2.samples', 'cv2.segmentation', 'cv2.utils.fs', 'cv2.utils.nested', 'cv2.videoio_registry', 'cv2.misc.version', 'cv2.misc', 'cv2.mat_wrapper', 'cv2.gapi', 'cv2.utils', 'cv2.data', 'cv2', 'matplotlib', 'matplotlib._api.deprecation', 'matplotlib._api', 'matplotlib._version', 'matplotlib._c_internal_utils', 'matplotlib.cbook', 'matplotlib.docstring', 'PIL.ImageChops', 'PIL.ImageFile', 'PIL.GimpGradientFile', 'PIL.GimpPaletteFile', 'PIL.ImageColor', 'PIL.PaletteFile', 'PIL.ImagePalette', 'PIL.ImageSequence', 'PIL.PngImagePlugin', 'matplotlib._path', 'matplotlib.bezier', 'matplotlib.path', 'matplotlib.transforms', 'matplotlib.ticker', 'matplotlib.scale', 'matplotlib._color_data', 'matplotlib.colors', 'pyparsing.util', 'pyparsing.unicode', 'pyparsing.exceptions', 'pyparsing.actions', 'pyparsing.results', 'pyparsing.core', 'pyparsing.helpers', 'pyparsing.testing', 'pyparsing.common', 'pyparsing', 'matplotlib.fontconfig_pattern', 'matplotlib._enums', 'cycler', 'matplotlib.rcsetup', 'matplotlib.ft2font', 'dateutil._version', 'dateutil', 'kiwisolver._cext', 'kiwisolver']
09/06/2022 15:42:37 MainProcess     MainThread                     __init__        wrapper                        DEBUG    CACHEDIR=/Users/aaronlee/.matplotlib
09/06/2022 15:42:37 MainProcess     MainThread                     font_manager    _load_fontmanager              DEBUG    Using fontManager instance from /Users/aaronlee/.matplotlib/fontlist-v330.json
09/06/2022 15:42:37 MainProcess     MainThread                     queue_manager   __init__                       DEBUG    Initializing _QueueManager
09/06/2022 15:42:37 MainProcess     MainThread                     queue_manager   __init__                       DEBUG    Initialized _QueueManager
09/06/2022 15:42:37 MainProcess     MainThread                     train           __init__                       DEBUG    Initializing Train: (args: Namespace(func=<bound method ScriptExecutor.execute_script of <lib.cli.launcher.ScriptExecutor object at 0x15022ecd0>>, exclude_gpus=None, configfile=None, loglevel='INFO', logfile=None, redirect_gui=True, colab=False, input_a='/Users/aaronlee/Documents/fw/face source/hhe1', input_b='/Users/aaronlee/Documents/fw/body source/x1', model_dir='/Users/aaronlee/Documents/fw/training/hhe1', load_weights=None, trainer='original', summary=False, freeze_weights=False, batch_size=16, iterations=1000000, distributed=False, distribution_strategy='default', save_interval=250, snapshot_interval=25000, timelapse_input_a=None, timelapse_input_b=None, timelapse_output=None, preview=False, write_image=False, no_logs=False, warp_to_landmarks=False, no_flip=False, no_augment_color=False, no_warp=False)
09/06/2022 15:42:37 MainProcess     MainThread                     train           _get_images                    DEBUG    Getting image paths
09/06/2022 15:42:37 MainProcess     MainThread                     utils           get_image_paths                DEBUG    Scanned Folder contains 5018 files
09/06/2022 15:42:37 MainProcess     MainThread                     utils           get_image_paths                DEBUG    Returning 5014 images
09/06/2022 15:42:37 MainProcess     MainThread                     train           _get_images                    DEBUG    Test file: (filename: /Users/aaronlee/Documents/fw/face source/hhe1/hhe1_000129_0.png, metadata: {'width': 512, 'height': 512, 'itxt': {'alignments': {'x': 372, 'w': 102, 'y': 302, 'h': 126, 'landmarks_xy': [[372.75958251953125, 354.44732666015625], [372.75958251953125, 367.23577880859375], [374.5865173339844, 381.8511657714844], [378.2403564453125, 392.81268310546875], [381.89422607421875, 403.77423095703125], [389.201904296875, 412.90887451171875], [394.68267822265625, 418.3896179199219], [401.9903564453125, 423.8703918457031], [418.43267822265625, 427.52423095703125], [433.0480651855469, 425.69732666015625], [445.8365173339844, 422.04345703125], [454.97113037109375, 416.56268310546875], [464.10577392578125, 407.4281005859375], [469.5865173339844, 396.466552734375], [473.2403564453125, 385.5050048828125], [475.0672912597656, 372.716552734375], [476.89422607421875, 359.9281005859375], [380.0672912597656, 338.0050048828125], [387.375, 332.52423095703125], [394.68267822265625, 330.69732666015625], [401.9903564453125, 330.69732666015625], [409.2980651855469, 332.52423095703125], [436.701904296875, 336.1780700683594], [444.00958251953125, 334.3511657714844], [451.3172912597656, 334.3511657714844], [460.451904296875, 338.0050048828125], [465.93267822265625, 343.48577880859375], [420.25958251953125, 350.79345703125], [420.25958251953125, 359.9281005859375], [418.43267822265625, 367.23577880859375], [416.6057434082031, 374.54345703125], [409.2980651855469, 380.02423095703125], [412.951904296875, 381.8511657714844], [416.6057434082031, 383.6781005859375], [422.0865173339844, 381.8511657714844], [427.5672912597656, 381.8511657714844], [389.201904296875, 348.966552734375], [394.68267822265625, 347.1396179199219], [400.1634521484375, 348.966552734375], [407.47113037109375, 350.79345703125], [401.9903564453125, 352.6203918457031], [394.68267822265625, 352.6203918457031], [436.701904296875, 352.6203918457031], [442.18267822265625, 350.79345703125], [449.4903564453125, 352.6203918457031], [454.97113037109375, 354.44732666015625], [449.4903564453125, 356.27423095703125], [442.18267822265625, 356.27423095703125], [400.1634521484375, 398.29345703125], [403.8172912597656, 394.6396179199219], [412.951904296875, 390.98577880859375], [416.6057434082031, 392.81268310546875], [420.25958251953125, 392.81268310546875], [427.5672912597656, 396.466552734375], [433.0480651855469, 401.94732666015625], [427.5672912597656, 405.6011657714844], [420.25958251953125, 407.4281005859375], [414.7788391113281, 405.6011657714844], [409.2980651855469, 405.6011657714844], [405.64422607421875, 403.77423095703125], [401.9903564453125, 398.29345703125], [411.125, 396.466552734375], [416.6057434082031, 396.466552734375], [420.25958251953125, 398.29345703125], [431.22113037109375, 400.1203918457031], [420.25958251953125, 400.1203918457031], [414.7788391113281, 400.1203918457031], [411.125, 398.29345703125]], 'mask': {'components': {'mask': b'x\x9c\xed\x9a\x81M\xc3@\x10\x04\xdd\xd9\x95v\xa5}i\x06!\x8c\x90 \xc1\xd9\x1d\xe7@\xec40\xfb\xefMl\xdf{\xdbB\x08!\x84\x10B\x08!\x84\x10B\x08!\xfcr\xfa\x83\xeb\r\xdd\xfb]\xf0\x0c\xbd\xee\x0b\xbf\xcb\x80\xc9\xeb\x87\xd5\xde`\x15\xa3\x7f|\xe9\x07H\x00]\xff\xba\x05\xb6\xbd\x1c\xbd\x1f\xa0,\xfb\xee\xb6\xd0\xd6\x9b\x1dX\xbe\x7fw\xfc\x80\xde\xa9@\x13~#\x00\xe3\xd7+\xc0\xe8\xe5\x00E\xf9\xc5\x0e6\xe6\xd7*\x80\xe9\xb5\xbf\xa1\x02\xfdJ\x05\x9a\xf4\x0b\x1b\xb0\x86\xfd\xa4^\xf0w\xfc\xa3\xfe\xe9\xeb\x1f\xff?\xf7w\xfc\xa3\xfe"\xfd\xca#\x18\xe9\x17\xf4\xe8\rX\xf1\xf7\xb0\xbf\x86\xfdd\x01$\xff\xc2\xf4\xda\x03xc~m\x0cP\x98_|\x03\xc3\xfc\x9a\x1e+\x80\xfa\n^\x90_\x9e\x02-\xc6/O\x00\x9a\xf1\xabz\xa8\x81\xd3# g\x08H\xf8\r=\xb1\x01\xd6\x10\xb6|\xbf7\x06_\xb6\xdf\xd2O\x8f\xa0\xfd\x06\xba\xa7\x10\xed\xe9\xfd3\x88a\xbd\xb7\x01\xc4\x19\xd0\xb0\xde\xf8\t@Gpj\x00H\xaf\x06\x00\xba\xe7\x04\x00\xf5J\x00T\xffx\x00\xec\xdaK\x01\xa8\xc3g1\x00\xbc\xf7\x07kn\xf1\xe7\x03\\g\xdfN\xdc\x0b.\xfb\xfa\xe3L\x82K\x97~p\xeb\x93\x80\xd5\xcf\xb0\xbf%\xf8\xf2\xfd\xcb\xf3\xdc\x9fx\xff\x0eg\xc4\x1dB\x08\xe1O\xf3\x02\xd5T\xe6\xb7', 'affine_matrix': [[0.7422400998493934, 0.07669019175363748, -276.4200029734838], [-0.07669019175363745, 0.7422400998493938, -169.9855552812213]], 'interpolator': 3, 'stored_size': 128, 'stored_centering': 'face'}, 'extended': {'mask': b'x\x9c\xed\x9a\x8bm\xc30\x10C\xbd\x99F\xbb\xd1n4\xb7\x01\xea\xa2@\x90\xc0&\x9f{(\xca\xb7\xc0\xa3i)\x1f\xe9\xb6-\x84\x10B\x08!\x84\x10B\x08!\x843\xac:X\xb79\xbe\x15\xd5\xfb;\x1a\xcf\xf0\xf9to\x8d\xcfT\x81\xf2\x8b\xee/\x98\x12D9\x15\xa0u=\x11\xc0\xd2\xfb\x01L\xbd\x1b`\xb9\xfa}\x1f\xd6\xef\xc66$\xf4N\x01\x88\xde(\x80\xf1\xeb\x05@~\xb5\x80\x82\xfc=\xecW?\x030\xbfX\x00\xe6\x17\x0b\xe0\xfcZ\x01\x9c_\xdb\x82\x9c^\xdb\x82\xa0_*\x80\xf4+\x05\x90~\xa5\x00\xd4/\x140\xec\xaf\xf8\xe3\x1f\xf4O\xaf\xff\xf8\xff\xb9\xbf\xe2\x1f\xf5/\xd2\xaf\xfc\x04&\xfd\x82\xde?\xfc0\xfd5\xec_\xc3~r\x01H\xfe\xc6\xf4\xd3\xff\xc0\xb43\x88\x85\xf9\xc5#\x00\xcc\xaf\xe9\xb1\x05\xa0\x1e\xc1,\xc8/\x9f\xc15\xe3\x97O\x81\x8b\xf1\xabzh\x05\xaa\xaf\x9f*\xc0\xb9\n"\xfc\x86\x9e(\xc0\xa8\x1f\xd9\x82\xde\x1dH\xdb~K\xef\x17\xe0^D\xba~\xf7\x0e\xac<\xbd\xb5\xfa\xfc\x02|\xbdW\x00q\x07;\xac7\xb6\x004\x07\xa0\x06\xc0\xc6\x10\xb4\x00\xc0\xdas\x02\x80z%\x00\xaa\xbf\x1e\x00\x1f\x83\xb9\x14\xa0o\x98\xc2\xb9\x10\x00\xee\xfe\xa0\xe7\x1e\xfe|\x80\xfb\xec\xdb\x89\xef\x02n\xecHHp\xeb\xa3\x1f\xac\x17/\x81\x9f\xfaz\x99\xe0i\x1a\xec\xf7\xdc?x\x0c\xc2M\xb9C\x08!\xfci>\x00\x83\x08\xf2\x03', 'affine_matrix': [[0.7422400998493934, 0.07669019175363748, -276.4200029734838], [-0.07669019175363745, 0.7422400998493938, -169.9855552812213]], 'interpolator': 3, 'stored_size': 128, 'stored_centering': 'face'}}}, 'source': {'alignments_version': 2.2, 'original_filename': 'hhe1_000129_0.png', 'face_index': 0, 'source_filename': 'hhe1_000129.png', 'source_is_video': True, 'source_frame_dims': (720, 1280)}}})
09/06/2022 15:42:37 MainProcess     MainThread                     train           _get_images                    INFO     Model A Directory: '/Users/aaronlee/Documents/fw/face source/hhe1' (5014 images)
09/06/2022 15:42:37 MainProcess     MainThread                     utils           get_image_paths                DEBUG    Scanned Folder contains 13940 files
09/06/2022 15:42:37 MainProcess     MainThread                     utils           get_image_paths                DEBUG    Returning 13937 images
09/06/2022 15:42:37 MainProcess     MainThread                     train           _get_images                    DEBUG    Test file: (filename: /Users/aaronlee/Documents/fw/body source/x1/x1_000001_0.png, metadata: {'width': 512, 'height': 512, 'itxt': {'alignments': {'x': 150, 'w': 264, 'y': 174, 'h': 444, 'landmarks_xy': [[127.45399475097656, 402.349853515625], [133.07241821289062, 440.302734375], [141.50997924804688, 479.6119079589844], [154.2423553466797, 519.034423828125], [171.75718688964844, 552.8917236328125], [192.67576599121094, 582.8880004882812], [217.307373046875, 608.8701782226562], [246.3592529296875, 628.1234130859375], [279.93780517578125, 633.6201171875], [316.0046691894531, 627.6031494140625], [347.839111328125, 608.198486328125], [372.09710693359375, 577.8511962890625], [392.5078125, 543.4784545898438], [405.14727783203125, 505.09527587890625], [411.9152526855469, 462.6136474609375], [414.1551818847656, 417.84771728515625], [411.4447937011719, 374.256591796875], [138.31787109375, 352.03240966796875], [156.36680603027344, 335.45306396484375], [177.6224822998047, 328.57354736328125], [200.6338653564453, 328.60601806640625], [221.9288787841797, 335.03021240234375], [282.37255859375, 328.43035888671875], [304.1689453125, 313.42413330078125], [328.5741271972656, 306.75885009765625], [354.6045837402344, 308.2696228027344], [377.8187561035156, 321.19219970703125], [258.8541259765625, 374.0744934082031], [260.99957275390625, 402.1253967285156], [261.83770751953125, 429.09307861328125], [263.06756591796875, 457.7236328125], [232.9907989501953, 478.7345886230469], [250.29180908203125, 484.5555419921875], [268.12420654296875, 487.53009033203125], [285.8634033203125, 483.01422119140625], [303.52374267578125, 475.52117919921875], [165.9390869140625, 391.50579833984375], [183.8746795654297, 383.359375], [203.51409912109375, 380.46160888671875], [220.4702911376953, 384.87554931640625], [203.9730224609375, 392.97027587890625], [184.90859985351562, 395.4830322265625], [301.1737060546875, 374.3905029296875], [316.897705078125, 363.0811767578125], [338.0553894042969, 362.04241943359375], [356.053955078125, 368.6332702636719], [339.52008056640625, 376.9210205078125], [318.6045227050781, 378.07440185546875], [222.2144012451172, 536.7825927734375], [236.60667419433594, 524.4053955078125], [254.3994598388672, 517.32861328125], [271.6771545410156, 518.51904296875], [288.5391845703125, 514.1705322265625], [311.58648681640625, 517.4163818359375], [334.2955627441406, 526.5858154296875], [317.9800109863281, 555.70458984375], [297.10162353515625, 571.20263671875], [278.2506408691406, 576.0353393554688], [258.9029541015625, 575.4061279296875], [238.66506958007812, 563.2659912109375], [233.94898986816406, 537.9788818359375], [256.8385314941406, 530.90673828125], [273.752685546875, 530.3216552734375], [290.1849365234375, 528.4715576171875], [322.35833740234375, 529.385009765625], [292.2897033691406, 546.2708740234375], [275.46051025390625, 550.2220458984375], [258.1632080078125, 548.9169311523438]], 'mask': {'components': {'mask': b'x\x9c\xed\xda\xd1\r\x830\x0c\x84a6\xf3h\x1e-\xa3Q\nR\xcb\x03\x82\xc4w\xc6B\xdc\xbf\xc0\x97\x1a\xda\x8a\x84iRJ)\xa5\x94RJ)\xa5\x94RJ)u\x94\xef\x9a\xb7\x9a\xbb\xa5bsGN\xb7[\x0f\xfb\xafQg`c\xf8\x1aq\x01\x1e\xe0\x97\x11\x90tk!\x9ev\x13\x04\xf5%\n\xefq\x9f2\x80\x16\xf7)\x03\x00x\xc6\x00\x0c\xf1\t\x03p\xc8\xc7\x07\x00\xf1\xf8\x00\x0c\xf4\xd1\x018\xe8\xa3\x03h\xa8\x0f\x0e\x00\xe5\xc1\x018\xeeC\x03\x90\xffn\xdf\x8a\xfd\xea\xef\x9f|\xf9\xa5\xbe?\xdd\x07\xff\x7f\xdf\xee\x1b\xea\xa3\x8f\xc1\xa8\x0f\xf2O\xf7\xe1M\x00\xc7|\xf8\x01\xa8\xda7\xcc\xc7w\x810\x1f\xe6\xb1\' \xc2\x1e\x94#>a\x03\x02\xf2\x19\x9b\x80\x88O\xe0\x11\x9f\xb2\x05\xe9q\x9f\xb2\x01gq\x9f\xb3\x07\x1c\xf7)|\xfc\x02\xb0N\x01j?~\xf8\'\x90v\x08\xe2\xb5\x1f?x\x01\x88g@\xa1\x01\xf0\xf8\xd0\x00\xa8G`\x81\x010\xf9\xc0\x00\xc8\'\x80\xa3\x03`\x1d~\xfd\x1a\xf4\xd9\xfc\xe0\x00\x12N\x80\xdb\x00O?\xfe\x1d[\x00\xfd\xe2\xafY\xb7\x9f\xc2\xf7/ \xe9\xf8\xbfw\x01i|\xdf-\x90\xc8\xf7, \x95\xbf^@2\x7fu\x0f\xa4\xf3\xe7\x0b\xb8\x81?y\x1f\x82\xfb\xce\xc9I\x87\x0b\xb8M_2\xaf\xd4\xb7\xf6o\x04\xdd\xafoK\xf8V"+\xa5\xd4\xd3\xfb\x00\x9b\xb4\xc9B', 'affine_matrix': [[0.23242707013834873, -0.024354138534953714, 12.649845262850775], [0.024354138534953714, 0.23242707013834873, -37.31434361067757]], 'interpolator': 2, 'stored_size': 128, 'stored_centering': 'face'}, 'extended': {'mask': b'x\x9c\xed\xda\xc1q\x03!\x10DQ2#4B#4{\xa5\xb5\xaa|\x90V0\xbf\x01Q\xea>\xf9\xf6\x06\x06Q\x86%%\xc7q\x1c\xc7q\x1c\xc7q\x1c\xc7q\x1c\xe7\xd3S\x1e\xf9\xf9\xcb\xf1g\x9e\xa7=\x8f\xb8\x80\\J\xbd\x06\x87\x16\x90\xfb\xec{\xaa\x8e\xef\x1c\xba\xba\x80\x18\xaf* G\xf9\xe3\x87\xa0\xe0\xc3\xfa\x11\x81_v\xf6\x05\r \xfcr_\xd0\x00\xe6\xf3]\x90\xf9\xb8\x01\x85\xf9x\x0b\x82>^\x00\xd4\xa7\x0b\x80\xfat\x01T\xe8\xd3\x05\x00y\xbc\x00\xb0\x0f\x1b\xb0\xd8\xcf\xd8g\r(\xfb\xfb\xa8\x01\xf6\xbf\xdb\xcf\x8b}\xbe\xff\xc0\r\xd8\xbe\xfd\x95~\xd9\xdd\x87\xff\x7f|\xbb\x9f\xa9O\x0f\x00\xd4\x87\xfc\xee\xfe\xea\x03\xe8\xea\x038\xf63\xf3W_\x80`\x9e\x9d\x80\x05W\xb0\x85\xf8\x82\x0b8\xe4+\xbe\x02\x10_\xc0\x13_r\x03_\xe2\xbe\xe2\x02\x9e\xec\x00\x9a\x8f@q_\xc2\xc7\x1b \x99\xfe\x14\x9f\x00\x11\x1f\xdd\x02U\xc3\x8f6@\xc5\x07\x1b \x1b~p\x02t|h\x02\x84\xc3\x0fM\x80\x92\x0fL\x80t\xf8\xfd\x13 \xfc\xfa}\xa6\xd3W\xf3\x9d\x130\xe0\xfdE\xed\xe0\xc5\xcd\xef-@\xde\xfc{r\xb3?\x84o/`\xd8\xe3\x9b\xb6\x02\xc6\xbd\xfdiZ\x02\x03\xf9\x96\x02\x86\xf2\xef\x0b\x18\xcc\xbf[\x03\xc3\xf9\xeb\x02&\xf0\x17\x0f\x82\xea\x14>\xbdX\x04\xd3\xf4t{\x0e\xb7R?\xf3\xffA\xde|\xfd,\xe1\x96%\xb2\xe38\xce\xee\xf9\x059\x08\x87\x9b', 'affine_matrix': [[0.23242707013834873, -0.024354138534953714, 12.649845262850775], [0.024354138534953714, 0.23242707013834873, -37.31434361067757]], 'interpolator': 2, 'stored_size': 128, 'stored_centering': 'face'}}}, 'source': {'alignments_version': 2.2, 'original_filename': 'x1_000001_0.png', 'face_index': 0, 'source_filename': 'x1_000001.png', 'source_is_video': True, 'source_frame_dims': (1006, 1798)}}})
09/06/2022 15:42:37 MainProcess     MainThread                     train           _get_images                    INFO     Model B Directory: '/Users/aaronlee/Documents/fw/body source/x1' (13937 images)
09/06/2022 15:42:37 MainProcess     MainThread                     train           _get_images                    DEBUG    Got image paths: [('a', '5014 images'), ('b', '13937 images')]
09/06/2022 15:42:37 MainProcess     MainThread                     train           __init__                       DEBUG    Initialized Train
09/06/2022 15:42:37 MainProcess     MainThread                     train           process                        DEBUG    Starting Training Process
09/06/2022 15:42:37 MainProcess     MainThread                     train           process                        INFO     Training data directory: /Users/aaronlee/Documents/fw/training/hhe1
09/06/2022 15:42:37 MainProcess     MainThread                     train           _start_thread                  DEBUG    Launching Trainer thread
09/06/2022 15:42:37 MainProcess     MainThread                     multithreading  __init__                       DEBUG    Initializing MultiThread: (target: '_training', thread_count: 1)
09/06/2022 15:42:37 MainProcess     MainThread                     multithreading  __init__                       DEBUG    Initialized MultiThread: '_training'
09/06/2022 15:42:37 MainProcess     MainThread                     multithreading  start                          DEBUG    Starting thread(s): '_training'
09/06/2022 15:42:37 MainProcess     MainThread                     multithreading  start                          DEBUG    Starting thread 1 of 1: '_training'
09/06/2022 15:42:37 MainProcess     MainThread                     multithreading  start                          DEBUG    Started all threads '_training': 1
09/06/2022 15:42:37 MainProcess     MainThread                     train           _start_thread                  DEBUG    Launched Trainer thread
09/06/2022 15:42:37 MainProcess     MainThread                     train           _output_startup_info           DEBUG    Launching Monitor
09/06/2022 15:42:37 MainProcess     MainThread                     train           _output_startup_info           INFO     ===================================================
09/06/2022 15:42:37 MainProcess     MainThread                     train           _output_startup_info           INFO       Starting
09/06/2022 15:42:37 MainProcess     MainThread                     train           _output_startup_info           INFO     ===================================================
09/06/2022 15:42:38 MainProcess     _training                      train           _training                      DEBUG    Commencing Training
09/06/2022 15:42:38 MainProcess     _training                      train           _training                      INFO     Loading data, this may take a while...
09/06/2022 15:42:38 MainProcess     _training                      train           _load_model                    DEBUG    Loading Model
09/06/2022 15:42:38 MainProcess     _training                      utils           get_folder                     DEBUG    Requested path: '/Users/aaronlee/Documents/fw/training/hhe1'
09/06/2022 15:42:38 MainProcess     _training                      utils           get_folder                     DEBUG    Returning: '/Users/aaronlee/Documents/fw/training/hhe1'
09/06/2022 15:42:38 MainProcess     _training                      plugin_loader   _import                        INFO     Loading Model from Original plugin...
09/06/2022 15:42:38 MainProcess     _training                      multithreading  run                            DEBUG    Error in thread (_training): No module named 'decorator'
09/06/2022 15:42:38 MainProcess     MainThread                     train           _monitor                       DEBUG    Thread error detected
09/06/2022 15:42:38 MainProcess     MainThread                     train           _monitor                       DEBUG    Closed Monitor
09/06/2022 15:42:38 MainProcess     MainThread                     train           _end_thread                    DEBUG    Ending Training thread
09/06/2022 15:42:38 MainProcess     MainThread                     train           _end_thread                    CRITICAL Error caught! Exiting...
09/06/2022 15:42:38 MainProcess     MainThread                     multithreading  join                           DEBUG    Joining Threads: '_training'
09/06/2022 15:42:38 MainProcess     MainThread                     multithreading  join                           DEBUG    Joining Thread: '_training'
09/06/2022 15:42:38 MainProcess     MainThread                     multithreading  join                           ERROR    Caught exception in thread: '_training'
Traceback (most recent call last):
  File "/Users/aaronlee/faceswap/lib/cli/launcher.py", line 201, in execute_script
    process.process()
  File "/Users/aaronlee/faceswap/scripts/train.py", line 216, in process
    self._end_thread(thread, err)
  File "/Users/aaronlee/faceswap/scripts/train.py", line 256, in _end_thread
    thread.join()
  File "/Users/aaronlee/faceswap/lib/multithreading.py", line 217, in join
    raise thread.err[1].with_traceback(thread.err[2])
  File "/Users/aaronlee/faceswap/lib/multithreading.py", line 96, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/aaronlee/faceswap/scripts/train.py", line 278, in _training
    raise err
  File "/Users/aaronlee/faceswap/scripts/train.py", line 266, in _training
    model = self._load_model()
  File "/Users/aaronlee/faceswap/scripts/train.py", line 290, in _load_model
    model: "ModelBase" = PluginLoader.get_model(self._args.trainer)(
  File "/Users/aaronlee/faceswap/plugins/plugin_loader.py", line 111, in get_model
    return PluginLoader._import("train.model", name, disable_logging)
  File "/Users/aaronlee/faceswap/plugins/plugin_loader.py", line 177, in _import
    module = import_module(mod)
  File "/Users/aaronlee/miniforge3/envs/faceswap/lib/python3.9/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 850, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/Users/aaronlee/faceswap/plugins/train/model/original.py", line 11, in <module>
    from ._base import KerasModel, ModelBase
  File "/Users/aaronlee/faceswap/plugins/train/model/_base/__init__.py", line 4, in <module>
    from .model import get_all_sub_models, KerasModel, ModelBase  # noqa
  File "/Users/aaronlee/faceswap/plugins/train/model/_base/model.py", line 23, in <module>
    from .settings import Loss, Optimizer, Settings
  File "/Users/aaronlee/faceswap/plugins/train/model/_base/settings.py", line 37, in <module>
    from lib.model.autoclip import AutoClipper  # pylint:disable=ungrouped-imports
  File "/Users/aaronlee/faceswap/lib/model/autoclip.py", line 8, in <module>
    import tensorflow_probability as tfp
  File "/Users/aaronlee/miniforge3/envs/faceswap/lib/python3.9/site-packages/tensorflow_probability/__init__.py", line 75, in <module>
    from tensorflow_probability.python import *  # pylint: disable=wildcard-import
  File "/Users/aaronlee/miniforge3/envs/faceswap/lib/python3.9/site-packages/tensorflow_probability/python/__init__.py", line 21, in <module>
    from tensorflow_probability.python import bijectors
  File "/Users/aaronlee/miniforge3/envs/faceswap/lib/python3.9/site-packages/tensorflow_probability/python/bijectors/__init__.py", line 23, in <module>
    from tensorflow_probability.python.bijectors.absolute_value import AbsoluteValue
  File "/Users/aaronlee/miniforge3/envs/faceswap/lib/python3.9/site-packages/tensorflow_probability/python/bijectors/absolute_value.py", line 23, in <module>
    from tensorflow_probability.python.bijectors import bijector
  File "/Users/aaronlee/miniforge3/envs/faceswap/lib/python3.9/site-packages/tensorflow_probability/python/bijectors/bijector.py", line 33, in <module>
    from tensorflow_probability.python.internal import distribution_util
  File "/Users/aaronlee/miniforge3/envs/faceswap/lib/python3.9/site-packages/tensorflow_probability/python/internal/distribution_util.py", line 29, in <module>
    from tensorflow_probability.python.internal import prefer_static
  File "/Users/aaronlee/miniforge3/envs/faceswap/lib/python3.9/site-packages/tensorflow_probability/python/internal/prefer_static.py", line 22, in <module>
    import decorator
ModuleNotFoundError: No module named 'decorator'

============ System Information ============
encoding:            UTF-8
git_branch:          master
git_commits:         ae7793e bugfix: convert - Process final items on truncated batch
gpu_cuda:            No global version found. Check Conda packages for Conda Cuda
gpu_cudnn:           No global version found. Check Conda packages for Conda cuDNN
gpu_devices:         GPU_0: /physical_device:GPU:0
gpu_devices_active:  GPU_0
gpu_driver:          Not Applicable
gpu_vram:            GPU_0: 16384MB
os_machine:          arm64
os_platform:         macOS-12.5.1-arm64-arm-64bit
os_release:          21.6.0
py_command:          /Users/aaronlee/faceswap/faceswap.py train -A /Users/aaronlee/Documents/fw/face source/hhe1 -B /Users/aaronlee/Documents/fw/body source/x1 -m /Users/aaronlee/Documents/fw/training/hhe1 -t original -bs 16 -it 1000000 -s 250 -ss 25000 -L INFO -gui
py_conda_version:    conda 4.14.0
py_implementation:   CPython
py_version:          3.9.13
py_virtual_env:      True
sys_cores:           10
sys_processor:       arm
sys_ram:             Total: 16384MB, Available: 6378MB, Used: 8202MB, Free: 251MB

=============== Pip Packages ===============
absl-py==1.2.0
astunparse==1.6.3
cached-property @ file:///home/conda/feedstock_root/build_artifacts/cached_property_1615209429212/work
cachetools==5.2.0
certifi==2022.6.15
charset-normalizer==2.1.1
colorama @ file:///home/conda/feedstock_root/build_artifacts/colorama_1655412516417/work
cycler @ file:///home/conda/feedstock_root/build_artifacts/cycler_1635519461629/work
fastcluster==1.2.6
ffmpy @ file:///home/conda/feedstock_root/build_artifacts/ffmpy_1659474992694/work
flatbuffers==1.12
fonttools @ file:///Users/runner/miniforge3/conda-bld/fonttools_1661381467342/work
gast==0.4.0
google-auth==2.11.0
google-auth-oauthlib==0.4.6
google-pasta==0.2.0
grpcio==1.48.1
h5py==3.7.0
idna==3.3
imageio @ file:///home/conda/feedstock_root/build_artifacts/imageio_1661789389824/work
imageio-ffmpeg @ file:///home/conda/feedstock_root/build_artifacts/imageio-ffmpeg_1649960641006/work
importlib-metadata==4.12.0
joblib @ file:///home/conda/feedstock_root/build_artifacts/joblib_1633637554808/work
keras==2.9.0
Keras-Preprocessing==1.1.2
kiwisolver @ file:///Users/runner/miniforge3/conda-bld/kiwisolver_1657953165042/work
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
matplotlib @ file:///Users/runner/miniforge3/conda-bld/matplotlib-suite_1661439904837/work
munkres==1.1.4
numexpr @ file:///Users/runner/miniforge3/conda-bld/numexpr_1658076515604/work
numpy @ file:///Users/runner/miniforge3/conda-bld/numpy_1653325964689/work
nvidia-ml-py==11.515.48
oauthlib==3.2.0
opencv-python==4.6.0.66
opt-einsum==3.3.0
packaging @ file:///home/conda/feedstock_root/build_artifacts/packaging_1637239678211/work
pexpect @ file:///home/conda/feedstock_root/build_artifacts/pexpect_1602535608087/work
Pillow @ file:///Users/runner/miniforge3/conda-bld/pillow_1660385974755/work
protobuf==3.19.4
psutil @ file:///Users/runner/miniforge3/conda-bld/psutil_1662356191042/work
ptyprocess @ file:///home/conda/feedstock_root/build_artifacts/ptyprocess_1609419310487/work/dist/ptyprocess-0.7.0-py2.py3-none-any.whl
pyasn1==0.4.8
pyasn1-modules==0.2.8
pyparsing @ file:///home/conda/feedstock_root/build_artifacts/pyparsing_1652235407899/work
python-dateutil @ file:///home/conda/feedstock_root/build_artifacts/python-dateutil_1626286286081/work
requests==2.28.1
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn @ file:///Users/runner/miniforge3/conda-bld/scikit-learn_1659726157499/work
scipy==1.9.1
six @ file:///home/conda/feedstock_root/build_artifacts/six_1620240208055/work
tensorboard==2.9.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow-estimator==2.9.0
tensorflow-macos==2.9.2
tensorflow-metal==0.5.1
tensorflow-probability==0.7.0
termcolor==1.1.0
threadpoolctl @ file:///home/conda/feedstock_root/build_artifacts/threadpoolctl_1643647933166/work
tornado @ file:///Users/runner/miniforge3/conda-bld/tornado_1656938068018/work
tqdm @ file:///home/conda/feedstock_root/build_artifacts/tqdm_1662214488106/work
typing_extensions @ file:///home/conda/feedstock_root/build_artifacts/typing_extensions_1656706066251/work
unicodedata2 @ file:///Users/runner/miniforge3/conda-bld/unicodedata2_1649111974586/work
urllib3==1.26.12
Werkzeug==2.2.2
wrapt==1.14.1
zipp==3.8.1

============== Conda Packages ==============
# packages in environment at /Users/aaronlee/miniforge3/envs/faceswap:
#
# Name                    Version                   Build  Channel
absl-py                   1.2.0                    pypi_0    pypi
aom                       3.4.0                hbe31e94_1    conda-forge
astunparse                1.6.3                    pypi_0    pypi
brotli                    1.0.9                h1c322ee_7    conda-forge
brotli-bin                1.0.9                h1c322ee_7    conda-forge
bzip2                     1.0.8                h3422bc3_4    conda-forge
c-ares                    1.18.1               h3422bc3_0    conda-forge
ca-certificates           2022.6.15            h4653dfc_0    conda-forge
cached-property           1.5.2                hd8ed1ab_1    conda-forge
cached_property           1.5.2              pyha770c72_1    conda-forge
cachetools                5.2.0                    pypi_0    pypi
certifi                   2022.6.15          pyhd8ed1ab_1    conda-forge
charset-normalizer        2.1.1                    pypi_0    pypi
colorama                  0.4.5              pyhd8ed1ab_0    conda-forge
cycler                    0.11.0             pyhd8ed1ab_0    conda-forge
expat                     2.4.8                h6b3803e_0    conda-forge
fastcluster               1.2.6                    pypi_0    pypi
ffmpeg                    5.1.1           gpl_hfdc7bce_101    conda-forge
ffmpy                     0.3.0              pyhb6f538c_0    conda-forge
flatbuffers               1.12                     pypi_0    pypi
font-ttf-dejavu-sans-mono 2.37                 hab24e00_0    conda-forge
font-ttf-inconsolata      3.000                h77eed37_0    conda-forge
font-ttf-source-code-pro  2.038                h77eed37_0    conda-forge
font-ttf-ubuntu           0.83                 hab24e00_0    conda-forge
fontconfig                2.14.0               hfb34624_0    conda-forge
fonts-conda-ecosystem     1                             0    conda-forge
fonts-conda-forge         1                             0    conda-forge
fonttools                 4.37.1           py39h02fc5c5_0    conda-forge
freetype                  2.12.1               hd633e50_0    conda-forge
gast                      0.4.0                    pypi_0    pypi
gettext                   0.19.8.1          h049c9fb_1008    conda-forge
gmp                       6.2.1                h9f76cd9_0    conda-forge
gnutls                    3.7.7                h27a1928_0    conda-forge
google-auth               2.11.0                   pypi_0    pypi
google-auth-oauthlib      0.4.6                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
grpcio                    1.48.1                   pypi_0    pypi
h5py                      3.7.0                    pypi_0    pypi
hdf5                      1.12.1          nompi_hd9dbc9e_104    conda-forge
icu                       70.1                 h6b3803e_0    conda-forge
idna                      3.3                      pypi_0    pypi
imageio                   2.21.2             pyhfa7a67d_0    conda-forge
imageio-ffmpeg            0.4.7              pyhd8ed1ab_0    conda-forge
importlib-metadata        4.12.0                   pypi_0    pypi
joblib                    1.1.0              pyhd8ed1ab_0    conda-forge
jpeg                      9e                   he4db4b2_2    conda-forge
keras                     2.9.0                    pypi_0    pypi
keras-preprocessing       1.1.2                    pypi_0    pypi
kiwisolver                1.4.4            py39hab5e169_0    conda-forge
krb5                      1.19.3               he492e65_0    conda-forge
lame                      3.100             h27ca646_1001    conda-forge
lcms2                     2.12                 had6a04f_0    conda-forge
lerc                      4.0.0                h9a09cb3_0    conda-forge
libblas                   3.9.0           16_osxarm64_openblas    conda-forge
libbrotlicommon           1.0.9                h1c322ee_7    conda-forge
libbrotlidec              1.0.9                h1c322ee_7    conda-forge
libbrotlienc              1.0.9                h1c322ee_7    conda-forge
libcblas                  3.9.0           16_osxarm64_openblas    conda-forge
libclang                  14.0.6                   pypi_0    pypi
libcurl                   7.83.1               h7965298_0    conda-forge
libcxx                    14.0.6               h2692d47_0    conda-forge
libdeflate                1.13                 h57fd34a_0    conda-forge
libedit                   3.1.20191231         hc8eb9b7_2    conda-forge
libev                     4.33                 h642e427_1    conda-forge
libffi                    3.4.2                h3422bc3_5    conda-forge
libgfortran               5.0.0           11_3_0_hd922786_25    conda-forge
libgfortran5              11.3.0              hdaf2cc0_25    conda-forge
libiconv                  1.16                 h642e427_0    conda-forge
libidn2                   2.3.3                he4db4b2_0    conda-forge
liblapack                 3.9.0           16_osxarm64_openblas    conda-forge
libnghttp2                1.47.0               h519802c_1    conda-forge
libopenblas               0.3.21          openmp_hc731615_3    conda-forge
libpng                    1.6.37               h9b2ccdc_4    conda-forge
libprotobuf               3.19.4               hccf11d3_0    conda-forge
libsqlite                 3.39.3               h76d750c_0    conda-forge
libssh2                   1.10.0               h7a5bd25_3    conda-forge
libtasn1                  4.19.0               h1a8c8d9_0    conda-forge
libtiff                   4.4.0                hd6ca8d7_3    conda-forge
libunistring              0.9.10               h3422bc3_0    conda-forge
libvpx                    1.11.0               hc470f4d_3    conda-forge
libwebp-base              1.2.4                h57fd34a_0    conda-forge
libxcb                    1.13              h9b22ae9_1004    conda-forge
libxml2                   2.9.14               h9d8dfc2_4    conda-forge
libzlib                   1.2.12               ha287fd2_2    conda-forge
llvm-openmp               14.0.4               hd125106_0    conda-forge
markdown                  3.4.1                    pypi_0    pypi
markupsafe                2.1.1                    pypi_0    pypi
matplotlib                3.5.3            py39hdf13c20_2    conda-forge
matplotlib-base           3.5.3            py39ha500c34_2    conda-forge
munkres                   1.1.4              pyh9f0ad1d_0    conda-forge
ncurses                   6.3                  h07bb92c_1    conda-forge
nettle                    3.8.1                h63371fa_1    conda-forge
numexpr                   2.8.3            py39hd2dba81_0    conda-forge
numpy                     1.22.4           py39h7df2422_0    conda-forge
nvidia-ml-py              11.515.48                pypi_0    pypi
oauthlib                  3.2.0                    pypi_0    pypi
opencv-python             4.6.0.66                 pypi_0    pypi
openh264                  2.3.0                h9a09cb3_0    conda-forge
openjpeg                  2.5.0                h5d4e404_1    conda-forge
openssl                   3.0.5                h7aea29f_1    conda-forge
opt-einsum                3.3.0                    pypi_0    pypi
p11-kit                   0.24.1               h29577a5_0    conda-forge
packaging                 21.3               pyhd8ed1ab_0    conda-forge
pexpect                   4.8.0              pyh9f0ad1d_2    conda-forge
pillow                    9.2.0            py39he45c975_2    conda-forge
pip                       22.2.2             pyhd8ed1ab_0    conda-forge
protobuf                  3.19.4           py39hfb83b0d_0    conda-forge
psutil                    5.9.2            py39h02fc5c5_0    conda-forge
pthread-stubs             0.4               h27ca646_1001    conda-forge
ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
pyasn1                    0.4.8                    pypi_0    pypi
pyasn1-modules            0.2.8                    pypi_0    pypi
pyparsing                 3.0.9              pyhd8ed1ab_0    conda-forge
python                    3.9.13          h96fcbfb_0_cpython    conda-forge
python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
python_abi                3.9                      2_cp39    conda-forge
readline                  8.1.2                h46ed386_0    conda-forge
requests                  2.28.1                   pypi_0    pypi
requests-oauthlib         1.3.1                    pypi_0    pypi
rsa                       4.9                      pypi_0    pypi
scikit-learn              1.1.2            py39h598ef33_0    conda-forge
scipy                     1.9.1            py39h737da60_0    conda-forge
setuptools                65.3.0             pyhd8ed1ab_1    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
sqlite                    3.39.3               h2229b38_0    conda-forge
svt-av1                   1.2.1                he23bcac_0    conda-forge
tensorboard               2.9.1                    pypi_0    pypi
tensorboard-data-server   0.6.1                    pypi_0    pypi
tensorboard-plugin-wit    1.8.1                    pypi_0    pypi
tensorflow-deps           2.9.0                         0    apple
tensorflow-estimator      2.9.0                    pypi_0    pypi
tensorflow-macos          2.9.2                    pypi_0    pypi
tensorflow-metal          0.5.1                    pypi_0    pypi
tensorflow-probability    0.7                        py_1    conda-forge
termcolor                 1.1.0                    pypi_0    pypi
threadpoolctl             3.1.0              pyh8a188c0_0    conda-forge
tk                        8.6.12               he1e0b03_0    conda-forge
tornado                   6.2              py39h9eb174b_0    conda-forge
tqdm                      4.64.1             pyhd8ed1ab_0    conda-forge
typing-extensions         4.3.0                hd8ed1ab_0    conda-forge
typing_extensions         4.3.0              pyha770c72_0    conda-forge
tzdata                    2022c                h191b570_0    conda-forge
unicodedata2              14.0.0           py39hb18efdd_1    conda-forge
urllib3                   1.26.12                  pypi_0    pypi
werkzeug                  2.2.2                    pypi_0    pypi
wheel                     0.37.1             pyhd8ed1ab_0    conda-forge
wrapt                     1.14.1                   pypi_0    pypi
x264                      1!164.3095           h57fd34a_2    conda-forge
x265                      3.5                  hbc6ce65_3    conda-forge
xorg-libxau               1.0.9                h27ca646_0    conda-forge
xorg-libxdmcp             1.1.3                h27ca646_0    conda-forge
xz                        5.2.6                h57fd34a_0    conda-forge
zipp                      3.8.1                    pypi_0    pypi
zlib                      1.2.12               ha287fd2_2    conda-forge
zstd                      1.5.2                h8128057_4    conda-forge

================= Configs ==================
--------- convert.ini ---------

[color.color_transfer]
clip:                     True
preserve_paper:           True

[color.match_hist]
threshold:                99.0

[color.manual_balance]
colorspace:               HSV
balance_1:                0.0
balance_2:                0.0
balance_3:                0.0
contrast:                 0.0
brightness:               0.0

[writer.pillow]
format:                   png
draw_transparent:         False
separate_mask:            False
optimize:                 False
gif_interlace:            True
jpg_quality:              75
png_compress_level:       3
tif_compression:          tiff_deflate

[writer.ffmpeg]
container:                mp4
codec:                    libx264
crf:                      23
preset:                   medium
tune:                     none
profile:                  auto
level:                    auto
skip_mux:                 False

[writer.gif]
fps:                      25
loop:                     0
palettesize:              256
subrectangles:            False

[writer.opencv]
format:                   png
draw_transparent:         False
separate_mask:            False
jpg_quality:              75
png_compress_level:       3

[mask.mask_blend]
type:                     normalized
kernel_size:              3
passes:                   4
threshold:                4
erosion:                  0.0
erosion_top:              0.0
erosion_bottom:           0.0
erosion_left:             0.0
erosion_right:            0.0

[scaling.sharpen]
method:                   none
amount:                   150
radius:                   0.3
threshold:                5.0

--------- gui.ini ---------

[global]
fullscreen:               False
tab:                      extract
options_panel_width:      30
console_panel_height:     20
icon_size:                14
font:                     default
font_size:                9
autosave_last_session:    prompt
timeout:                  120
auto_load_model_stats:    True

--------- .faceswap ---------
backend:                  apple_silicon

--------- extract.ini ---------

[global]
allow_growth:             False

[detect.mtcnn]
minsize:                  20
scalefactor:              0.709
batch-size:               8
cpu:                      True
threshold_1:              0.6
threshold_2:              0.7
threshold_3:              0.7

[detect.cv2_dnn]
confidence:               50

[detect.s3fd]
confidence:               70
batch-size:               4

[align.fan]
batch-size:               12

[mask.unet_dfl]
batch-size:               8

[mask.custom]
batch-size:               8
centering:                face
fill:                     False

[mask.vgg_obstructed]
batch-size:               2

[mask.vgg_clear]
batch-size:               6

[mask.bisenet_fp]
batch-size:               8
cpu:                      False
weights:                  faceswap
include_ears:             False
include_hair:             False
include_glasses:          True

--------- train.ini ---------

[global]
centering:                face
coverage:                 87.5
icnr_init:                False
conv_aware_init:          False
optimizer:                adam
learning_rate:            5e-05
epsilon_exponent:         -7
autoclip:                 False
reflect_padding:          False
allow_growth:             False
mixed_precision:          False
nan_protection:           True
convert_batchsize:        16

[global.loss]
loss_function:            ssim
loss_function_2:          mse
loss_weight_2:            100
loss_function_3:          None
loss_weight_3:            0
loss_function_4:          None
loss_weight_4:            0
mask_loss_function:       mse
eye_multiplier:           3
mouth_multiplier:         2
penalized_mask_loss:      True
mask_type:                extended
mask_blur_kernel:         3
mask_threshold:           4
learn_mask:               False

[model.phaze_a]
output_size:              128
shared_fc:                None
enable_gblock:            True
split_fc:                 True
split_gblock:             False
split_decoders:           False
enc_architecture:         fs_original
enc_scaling:              7
enc_load_weights:         True
bottleneck_type:          dense
bottleneck_norm:          None
bottleneck_size:          1024
bottleneck_in_encoder:    True
fc_depth:                 1
fc_min_filters:           1024
fc_max_filters:           1024
fc_dimensions:            4
fc_filter_slope:          -0.5
fc_dropout:               0.0
fc_upsampler:             upsample2d
fc_upsamples:             1
fc_upsample_filters:      512
fc_gblock_depth:          3
fc_gblock_min_nodes:      512
fc_gblock_max_nodes:      512
fc_gblock_filter_slope:   -0.5
fc_gblock_dropout:        0.0
dec_upscale_method:       subpixel
dec_upscales_in_fc:       0
dec_norm:                 None
dec_min_filters:          64
dec_max_filters:          512
dec_slope_mode:           full
dec_filter_slope:         -0.45
dec_res_blocks:           1
dec_output_kernel:        5
dec_gaussian:             True
dec_skip_last_residual:   True
freeze_layers:            keras_encoder
load_layers:              encoder
fs_original_depth:        4
fs_original_min_filters:  128
fs_original_max_filters:  1024
fs_original_use_alt:      False
mobilenet_width:          1.0
mobilenet_depth:          1
mobilenet_dropout:        0.001
mobilenet_minimalistic:   False

[model.realface]
input_size:               64
output_size:              128
dense_nodes:              1536
complexity_encoder:       128
complexity_decoder:       512

[model.dfl_sae]
input_size:               128
architecture:             df
autoencoder_dims:         0
encoder_dims:             42
decoder_dims:             21
multiscale_decoder:       False

[model.unbalanced]
input_size:               128
lowmem:                   False
nodes:                    1024
complexity_encoder:       128
complexity_decoder_a:     384
complexity_decoder_b:     512

[model.dlight]
features:                 best
details:                  good
output_size:              256

[model.villain]
lowmem:                   False

[model.dfaker]
output_size:              128

[model.original]
lowmem:                   False

[model.dfl_h128]
lowmem:                   False

[trainer.original]
preview_images:           14
zoom_amount:              5
rotation_range:           10
shift_range:              5
flip_chance:              50
color_lightness:          30
color_ab:                 8
color_clahe_chance:       50
color_clahe_max_size:     4
User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 623 times

Re: Apple Silicon: ModuleNotFoundError: No module named 'decorator'

Post by torzdf »

Hmmm. Looks like an Apple Silicon only issue. Will investigate.

In the meantime, open up a terminal and do:

Code: Select all

conda activate faceswap
pip install cloudpickle decorator

ref: https://github.com/deepfakes/faceswap/issues/1250

My word is final

User avatar
torzdf
Posts: 2649
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 128 times
Been thanked: 623 times

Re: Apple Silicon: ModuleNotFoundError: No module named 'decorator'

Post by torzdf »

Solution C+P'd from Github issue

Code: Select all

conda activate faceswap
pip install decorator
pip install cloudpickle

I do not have an M1 Mac to test

My word is final

Locked