Page 2 of 2

Re: [Resource] Google Colab Notebook

Posted: Sat Jun 18, 2022 11:24 am
by Andentze

Unfortunately for all of us, Colab users, Google is blacklisting all notebooks which are associated with deepfaking by any means and are banning accounts which keep on using those notebooks.

Do not fret though, as I am currently searching for another way to use Faceswap in the cloud. I'll keep you guys updated if I do find one(either by creating a new topic or by replying to/editing this one).


Re: [Resource] Google Colab Notebook

Posted: Mon Jun 20, 2022 8:05 pm
by aolvera27

Same thing happened to me during the weekend. However, I noticed they updated the list of countries where Colab Pro is available, and it's now possible for me to suscribe (which I think is fair), and I can confirm that training a deepfake model is still allowed with a Pro account. It is a shame that the list of elligible countries is very limited, though.


Re: [Resource] Google Colab Notebook

Posted: Wed Jun 22, 2022 1:27 pm
by Andentze

Alright. Here's my plan. There's a theory that Google is hunting down the notebooks which have either DFL or Faceswap or anything that makes deepfaking possible, filters them and blocks them. So my idea is to spoof the notebook entirely so barely anything is left and minimize the chance of banning. That means no extract, no convert, no fancy stuff.
I am really not sure if this will work. Won't know if we don't try.

I will leave this here for you guys to see if that warning is gone and if it would return. For me, its basically gone.
https://colab.research.google.com/drive ... sp=sharing


No module named 'tensorflow_probability'

Posted: Fri Jun 24, 2022 5:23 pm
by aolvera27

I'm getting this error when attempting training or conversion on Colab. Extraction works just fine, and the Notebook had been working just fine until today. Is there some kind of update or maintenance going on?

06/24/2022 12:14:08 INFO Loading Model from Villain plugin...
06/24/2022 12:14:09 CRITICAL Error caught! Exiting...
06/24/2022 12:14:09 ERROR Caught exception in thread: '_training_0'
06/24/2022 12:14:11 ERROR Got Exception on main handler:
ModuleNotFoundError: No module named 'tensorflow_probability'


Re: No module named 'tensorflow_probability'

Posted: Fri Jun 24, 2022 11:36 pm
by Andentze
aolvera27 wrote: Fri Jun 24, 2022 5:23 pm

I'm getting this error when attempting training or conversion on Colab. Extraction works just fine, and the Notebook had been working just fine until today. Is there some kind of update or maintenance going on?

06/24/2022 12:14:08 INFO Loading Model from Villain plugin...
06/24/2022 12:14:09 CRITICAL Error caught! Exiting...
06/24/2022 12:14:09 ERROR Caught exception in thread: '_training_0'
06/24/2022 12:14:11 ERROR Got Exception on main handler:
ModuleNotFoundError: No module named 'tensorflow_probability'

I forgot to catch up with the updates that torzdf has pushed so far. Fixed, I think. I can't really test that as I have 0 models to train as of now.


Re: [Resource] Google Colab Notebook

Posted: Thu Jul 07, 2022 1:09 pm
by aolvera27

So I got this new error:

Code: Select all

ModuleNotFoundError: No module named 'ipykernel'

I dutifully wrote

Code: Select all

!conda install ipykernel

, and it worked for a couple of days, but now I got this message:

Code: Select all

KeyError: 'figure.raise_window is not a valid rc parameter (see rcParams.keys() for a list of valid parameters)'

As before, extraction is working fine. The problem occurs when attemppting a training session.


Re: [Resource] Google Colab Notebook

Posted: Thu Jul 07, 2022 11:58 pm
by torzdf

That was code I added in a recent commit to stop the preview window from stealing focus (on normal systems).

figure.raise_window definitely is a valid rcParam, so either you have an outdated version of matplotlib or Colab just doesn't like it for whatever reason.


Re: [Resource] Google Colab Notebook

Posted: Fri Jul 08, 2022 3:05 am
by aolvera27

You were right. Updating matplotlib to 3.5.2 did the trick.

Thanks!


Re: [Resource] Google Colab Notebook

Posted: Fri Aug 26, 2022 1:24 pm
by aolvera27

Well, this looks like it should be an easy fix, but I can't work it out.

When I try to copy the contents of Google Drive to a Colab session:

Code: Select all

!cp "/content/drive/My Drive/colab_files/faces/face_a.zip" .
!cp "/content/drive/My Drive/colab_files/faces/face_b.zip" .

!unzip face_a.zip -d face_a
!unzip face_b.zip -d face_b

I get this message:

Code: Select all

cp: relocation error: /lib/x86_64-linux-gnu/libacl.so.1: symbol getxattr version ATTR_1.0 not defined in file libattr.so.1 with link time reference

Re: [Resource] Google Colab Notebook

Posted: Fri Aug 26, 2022 3:08 pm
by Andentze
aolvera27 wrote: Fri Aug 26, 2022 1:24 pm

Well, this looks like it should be an easy fix, but I can't work it out.

When I try to copy the contents of Google Drive to a Colab session:

Code: Select all

!cp "/content/drive/My Drive/colab_files/faces/face_a.zip" .
!cp "/content/drive/My Drive/colab_files/faces/face_b.zip" .

!unzip face_a.zip -d face_a
!unzip face_b.zip -d face_b

I get this message:

Code: Select all

cp: relocation error: /lib/x86_64-linux-gnu/libacl.so.1: symbol getxattr version ATTR_1.0 not defined in file libattr.so.1 with link time reference

I always used

Code: Select all

!unzip "/content/drive/My Drive/colab_files/faces/face_a.zip" -d "/content/drive/My Drive/colab_files/faces/face_a"
!unzip "/content/drive/My Drive/colab_files/faces/face_b.zip" -d "/content/drive/My Drive/colab_files/faces/face_b"

and deleted the archives afterwards. It always worked out. Might work for you.


Re: [Resource] Google Colab Notebook

Posted: Sat Apr 15, 2023 3:18 am
by cswpf

Do anyone write this colab into TPU trained script?GPU is always disconnected and reallocate the computer.


Re: [Resource] Google Colab Notebook

Posted: Sat Apr 15, 2023 12:06 pm
by torzdf

Honestly, since Google banned deepfakes on Colab, I don't think anyone keeps their notebooks up to date any more.


Re: [Resource] Google Colab Notebook

Posted: Sat Apr 15, 2023 12:09 pm
by Andentze
torzdf wrote: Sat Apr 15, 2023 12:06 pm

Honestly, since Google banned deepfakes on Colab, I don't think anyone keeps their notebooks up to date any more.

Google banned deepfaking only on free runtimes. I've managed to train an entire model for around 13 hours without disconnections(Captchas still can happen) and without any banning on any Premium class GPU.