Adjustments that turned things around.
Hey all,
My specs before finding "lightspeed". :
Gigabyte D450 D3H Motherboard, AMD Ryzen 5 1600, 32 GB ram, MSI GtX 1050ti 4 GB GPU.
Very slow on training as in VERY. 7 iterations pr. minute
Changes : I was on Game Ready drivers (NVIDIA), I switched to Studio Driver (NVIDIA) and did a pip update of tensorflow. (Refer to NVIDIA site as to why Studio Driver is beneficial). These were the only changes made.
Result when training: 154 iterations pr. minute (Original - NOT Lowmem). I can't tell you why as I have software-ocd and ALWAYS have everything updated. HWINFO does not show overheating and fans are on nominal speed.
For whatever reason it has cleared a bottleneck of sorts, Studio Driver has an AI element that connects directly to the core and I believe that is the reason for the "inferno-fast"-training.
Hope it can help someone.
/Sergio