[Resource] Google Colab Notebook

[Andentze]

Unfortunately for all of us, Colab users, Google is blacklisting all notebooks which are associated with deepfaking by any means and are banning accounts which keep on using those notebooks.

Do not fret though, as I am currently searching for another way to use Faceswap in the cloud. I'll keep you guys updated if I do find one(either by creating a new topic or by replying to/editing this one).

[aolvera27]

Same thing happened to me during the weekend. However, I noticed they updated the list of countries where Colab Pro is available, and it's now possible for me to suscribe (which I think is fair), and I can confirm that training a deepfake model is still allowed with a Pro account. It is a shame that the list of elligible countries is very limited, though.

[Andentze]

Alright. Here's my plan. There's a theory that Google is hunting down the notebooks which have either DFL or Faceswap or anything that makes deepfaking possible, filters them and blocks them. So my idea is to spoof the notebook entirely so barely anything is left and minimize the chance of banning. That means no extract, no convert, no fancy stuff.
I am really not sure if this will work. Won't know if we don't try.

I will leave this here for you guys to see if that warning is gone and if it would return. For me, its basically gone.
https://colab.research.google.com/drive ... sp=sharing

[aolvera27]

I'm getting this error when attempting training or conversion on Colab. Extraction works just fine, and the Notebook had been working just fine until today. Is there some kind of update or maintenance going on?

06/24/2022 12:14:08 INFO Loading Model from Villain plugin...
06/24/2022 12:14:09 CRITICAL Error caught! Exiting...
06/24/2022 12:14:09 ERROR Caught exception in thread: '_training_0'
06/24/2022 12:14:11 ERROR Got Exception on main handler:
ModuleNotFoundError: No module named 'tensorflow_probability'

[Andentze]

I'm getting this error when attempting training or conversion on Colab. Extraction works just fine, and the Notebook had been working just fine until today. Is there some kind of update or maintenance going on?

06/24/2022 12:14:08 INFO Loading Model from Villain plugin...
06/24/2022 12:14:09 CRITICAL Error caught! Exiting...
06/24/2022 12:14:09 ERROR Caught exception in thread: '_training_0'
06/24/2022 12:14:11 ERROR Got Exception on main handler:
ModuleNotFoundError: No module named 'tensorflow_probability'

I forgot to catch up with the updates that torzdf has pushed so far. Fixed, I think. I can't really test that as I have 0 models to train as of now.

[aolvera27]

So I got this new error:

Code: Select all

ModuleNotFoundError: No module named 'ipykernel'

I dutifully wrote

Code: Select all

!conda install ipykernel

, and it worked for a couple of days, but now I got this message:

Code: Select all

KeyError: 'figure.raise_window is not a valid rc parameter (see rcParams.keys() for a list of valid parameters)'

As before, extraction is working fine. The problem occurs when attemppting a training session.

[torzdf]

That was code I added in a recent commit to stop the preview window from stealing focus (on normal systems).

figure.raise_window definitely is a valid rcParam, so either you have an outdated version of matplotlib or Colab just doesn't like it for whatever reason.

[aolvera27]

You were right. Updating matplotlib to 3.5.2 did the trick.

Thanks!

[aolvera27]

Well, this looks like it should be an easy fix, but I can't work it out.

When I try to copy the contents of Google Drive to a Colab session:

Code: Select all

!cp "/content/drive/My Drive/colab_files/faces/face_a.zip" .
!cp "/content/drive/My Drive/colab_files/faces/face_b.zip" .

!unzip face_a.zip -d face_a
!unzip face_b.zip -d face_b

I get this message:

Code: Select all

cp: relocation error: /lib/x86_64-linux-gnu/libacl.so.1: symbol getxattr version ATTR_1.0 not defined in file libattr.so.1 with link time reference

[Andentze]

Well, this looks like it should be an easy fix, but I can't work it out.

When I try to copy the contents of Google Drive to a Colab session:

Code: Select all

!cp "/content/drive/My Drive/colab_files/faces/face_a.zip" .
!cp "/content/drive/My Drive/colab_files/faces/face_b.zip" .

!unzip face_a.zip -d face_a
!unzip face_b.zip -d face_b

I get this message:

Code: Select all

cp: relocation error: /lib/x86_64-linux-gnu/libacl.so.1: symbol getxattr version ATTR_1.0 not defined in file libattr.so.1 with link time reference

I always used

Code: Select all

!unzip "/content/drive/My Drive/colab_files/faces/face_a.zip" -d "/content/drive/My Drive/colab_files/faces/face_a"
!unzip "/content/drive/My Drive/colab_files/faces/face_b.zip" -d "/content/drive/My Drive/colab_files/faces/face_b"

and deleted the archives afterwards. It always worked out. Might work for you.

[cswpf]

Do anyone write this colab into TPU trained script?GPU is always disconnected and reallocate the computer.

[torzdf]

Honestly, since Google banned deepfakes on Colab, I don't think anyone keeps their notebooks up to date any more.

[Andentze]

Honestly, since Google banned deepfakes on Colab, I don't think anyone keeps their notebooks up to date any more.

Google banned deepfaking only on free runtimes. I've managed to train an entire model for around 13 hours without disconnections(Captchas still can happen) and without any banning on any Premium class GPU.