Can setting the Learning Rate to lower values help in getting the details better?
Posted: Tue Mar 16, 2021 3:05 pm
After training for a good amount of time (with warp on), if we reduce the learning rate to very low values like 1e or 2e on a small batch of 4 or 8 (with warp off) & train for some time & again set the learning rate to normal, will it help to get the details of the facial feature better?