After 177 hours of training, I woke up to....
I've been training for 177 hours. This morning I woke up to a message that it was unable to save (presumably in the same folder where I've been saving it). I checked the folder memory and it has over 300 GB remaining.
Also had to unplug my computer to get it to shut down/reboot -- everything was stuck.
I tried to restart the project and it fails. I even tried reloading all the folders and same result.
I'm at a loss here and I have no idea what to do. I'd rather not start over after 177 hours (in fact, I think I would just throw in the towel on this ever working).
Is there any way to recover or reset to the previous day/iteration?
Help!