Learning Rate Finder
Posted: Tue Oct 18, 2022 10:49 pm
In my never ending, mind numbing search for understanding what makes a good learning rate I found this code for a auto learning rate:
https://github.com/faizanahemad/data-sc ... _finder.py
A Learning Rate Finder, to optimize the learning rate. Has this been considered? Just wondered what the thoughts are on implementung something like this.
Once again, please forgive me for asking and pestering with naive or ignorant questions . I'm trying to understand what I'm doing, and why things aren't working the way they should, and how to fix them.