Search found 43 matches

by dheinz70
Fri Oct 28, 2022 3:29 am
Forum: Convert Support
Topic: Cannot create alignments file, "libstdc++.so.6: version `GLIBCXX_3.4.30' not found"
Replies: 6
Views: 8455

Fresh Ubuntu 22.10 install error in Remove-Faces

I'm trying to use the alignment tool to "Remove-Faces" It spits out an error. There were no errors during the install. Thanks Loading... Setting Faceswap backend to NVIDIA 10/27/2022 22:20:09 INFO Log level set to: INFO ls: cannot access '/home/dave/miniconda3/envs/faceswap/lib/python3.9/s...
by dheinz70
Sat Aug 28, 2021 12:02 am
Forum: Training Discussion
Topic: Please give me advise on my approach
Replies: 3
Views: 7743

Re: Please give me advise on my approach

Original Model, with a batch size of 192??

Not sure that's gonna get you very good results. I suggest Villain or DFL-SAE. I get the best results from them.

by dheinz70
Wed Jun 02, 2021 9:01 pm
Forum: Training Discussion
Topic: Batch Size advice
Replies: 1
Views: 5325

Batch Size advice

Is there any benefit to stepping down the batch size as the model learns? My general recipe is run at max batch size for a few days, cut that batch size in 1/2 for a few more. Then remove warping and cut that batch size in 1/2 again and run for a day.

What do you find works best? Thanks in advance.

by dheinz70
Tue Apr 13, 2021 1:21 am
Forum: Training Support
Topic: an illegal memory access was encountered
Replies: 1
Views: 4555

an illegal memory access was encountered

I've been getting this error alot. The model runs for a while and this then spits out. AMD 3800x 32 GB ram 2060 Super Any Ideas. This same hardware setup used to run like a top on the same (or heavier) models. No crashlog is created, 2021-04-12 04:43:11.527466: F ./tensorflow/core/kernels/conv_2d_gp...
by dheinz70
Tue Mar 16, 2021 3:31 pm
Forum: Training Support
Topic: GPU Training on GeForce GTX 1660 Ti under linux Ubuntu 20.04.2 LTS
Replies: 2
Views: 3544

Re: GPU Training on GeForce GTX 1660 Ti under linux Ubuntu 20.04.2 LTS

Make sure you using the proprietary Nvidia driver on Linux? A default install uses the open source display drivers. Click the "Additional Drivers" icon and check from there. Also, the 450 nvidia driver works better than the 460 one. Just a guess.

by dheinz70
Tue Dec 29, 2020 1:37 am
Forum: Training Support
Topic: Distributed with Dual 2060 supers
Replies: 46
Views: 16285

Re: Distributed with Dual 2060 supers

My 2 cents on using two GPUs is that you really, really need a high end motherboard. I upgraded to a Ryzen 7 and a x570 mobo and dual GPUs are still flaky. I'm using Linux and I get maybe about a 20% increase in EG/s using dual 2060 supers over just using one. SO... 2 GPUs with batch of 16 only runs...
by dheinz70
Sat Dec 19, 2020 2:24 am
Forum: Hardware
Topic: MULTI GPU - double speed at same batc size or not?
Replies: 10
Views: 15485

Re: MULTI GPU - double speed at same batc size or not?

Two similarly capable cards should work. The rate determining step will be the slowest card. Dunno if the 30x cards are supported yet.

by dheinz70
Wed Dec 02, 2020 1:08 am
Forum: Convert Discussion
Topic: Converted faces are blurry
Replies: 16
Views: 28568

Re: DLight model still blurry after 400k iterations

My experience with DLight gives good A quality, and totally washed out B quality. Dunno if that helps you. 192 SAE and Villain give me the best results.

by dheinz70
Sat Nov 21, 2020 3:27 am
Forum: Hardware
Topic: What Do you think of this MB
Replies: 4
Views: 10220

Re: What Do you think of this MB

My feeling I'm seeing a linux driver issue or a tensorflow issue. I installed windows on the new computer and tried to run the same test. Single gpu performance was about 10-20% worse under Windows. I could not get distributed to work at all. Kept throwing out tensorflow illegal memory errors. I als...
by dheinz70
Thu Nov 19, 2020 12:39 am
Forum: Hardware
Topic: What Do you think of this MB
Replies: 4
Views: 10220

Re: What Do you think of this MB

Alright.... The new setup is built. Ubuntu 20.10, Ryzen 3800x, 32gb ram, and the MPG x570 Plus mb. Interesting results on my first tests. Tests with one gpu (did both GPU0 and GPU1) give me 20-21 EGs/sec with a batch of 7. Tests with distributed, batch of 14 (2x7) give me 24 EGs/sec. Only a slight g...
by dheinz70
Sat Nov 07, 2020 12:29 am
Forum: Hardware
Topic: What Do you think of this MB
Replies: 4
Views: 10220

What Do you think of this MB

https://www.newegg.com/msi-mpg-x570-gam ... 6813144262

Another question, When using both PCIe slots do all MBs switch them to 8x8 or do some keep both the slots at 16x?

by dheinz70
Wed Nov 04, 2020 10:15 pm
Forum: General Discussion
Topic: Save As bug
Replies: 3
Views: 8762

Save As bug

When I save a new project it adds the extension twice.

"realfacetest.fsw .FSW" is what it named the file, I only entered "realfacetest" in the name window.

by dheinz70
Sat Oct 31, 2020 7:45 pm
Forum: Training Support
Topic: Session Stats no longer appearing after a few hours of training
Replies: 15
Views: 11629

Re: Log and graph weirdness

The two bugs I've seen:

Changing the smoothing from 0.9 causes the stats to crash

It shows more iterations than the session has done. Hope that helps.

by dheinz70
Mon Oct 19, 2020 11:51 pm
Forum: Training Support
Topic: Distributed with Dual 2060 supers
Replies: 46
Views: 16285

Re: Distributed with Dual 2060 supers

The fact it drops down to 8x8 tells me it is probably mostly hardware. Just thought it was weird that running two cards is almost exactly half as productive.

Screenshot from 2020-10-19 18-49-07.png
Screenshot from 2020-10-19 18-49-07.png (35.19 KiB) Viewed 2973 times
by dheinz70
Mon Oct 19, 2020 8:54 pm
Forum: Training Support
Topic: Distributed with Dual 2060 supers
Replies: 46
Views: 16285

Re: Distributed with Dual 2060 supers

Another test with the same results. 2000 iterations on Original, single batch 150, distributed batch 300. Distributed is almost exactly half as efficient. Screenshot from 2020-10-19 15-49-51.png Watching the nvtop the stats never pegged and held there. avgeraged about 70% of what the gpus could hand...
by dheinz70
Sun Oct 18, 2020 6:34 pm
Forum: Training Support
Topic: Distributed with Dual 2060 supers
Replies: 46
Views: 16285

Re: Distributed with Dual 2060 supers

2000 iterations of a batch of 2 each on single and distributed. I doubt it was ever enuf data to clog the pipes. My feeling is there is some hardware limitation, but i suspect there is something else going on too.

Screenshot from 2020-10-18 13-28-38.png
Screenshot from 2020-10-18 13-28-38.png (892 Bytes) Viewed 6777 times
by dheinz70
Sun Oct 18, 2020 5:41 pm
Forum: Training Support
Topic: Distributed with Dual 2060 supers
Replies: 46
Views: 16285

Re: Distributed with Dual 2060 supers

I added the coolbits to my xorg.conf, so I could control the fans on the cards. I cranked them all to 100% and the cards ran at 55C. Same slow results on distributed. The nvidia control panel lists 93C as the slowdown temp. Batch of 12 gave me 23 EG/s. Screenshot from 2020-10-18 12-41-24.png I'm goi...
by dheinz70
Sun Oct 18, 2020 3:00 am
Forum: Training Support
Topic: Distributed with Dual 2060 supers
Replies: 46
Views: 16285

Re: Distributed with Dual 2060 supers

Did a couple thousand iterations to test. Screenshot from 2020-10-17 21-54-05.png A singe gpu batch of 10, dual with a batch of 16. I'm getting better EGs/sec from the single gpu. It took 4 mins to start on distributed. 1.5 mins to start on single gpu. I watch nvtop and I never saw the rx/tx get peg...
by dheinz70
Sun Oct 18, 2020 2:09 am
Forum: Training Support
Topic: Distributed with Dual 2060 supers
Replies: 46
Views: 16285

Re: Distributed with Dual 2060 supers

Yes, I do lower to 80% of what one can handle. It isn't just a startup issue. Depending on the model it can take 5-10 mins to start. It just runs really slowly once it starts. In terms of EG/s I'm getting better performance from 1 gpu doing 1/2 as many at a time. I'm watching nvtop with the single 2...