Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

find_learning_rate does not work anymore #1108

Closed
lucaventurini opened this issue Sep 16, 2019 · 0 comments · Fixed by #1119
Closed

find_learning_rate does not work anymore #1108

lucaventurini opened this issue Sep 16, 2019 · 0 comments · Fixed by #1119
Labels
bug Something isn't working

Comments

@lucaventurini
Copy link

Describe the bug
Before, I've run several experiments with which I could plot the optimal learning rate as in the tutorial. Now, after an upgrade of the codebase, I cannot anymore reproduce the same experiments.
What I find is similar to issue #986 , but in my case the learning rate is never updated (while in the above issue is updated at least at the first step).

To Reproduce
I've run the experiments with commit 24b72a6 , and set a start lr of 1e-08 and an end lr of 1000, with 200 iterations. I get a tsv with 200 lines where the lr is always the same (slightly above the start lr).

Expected behavior
I previously run the same experiments with commit 6c27431 and they seemed to work as in the tutorial. The lr in the tsv spanned all the interval specified.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant