Name		Name	Last commit message	Last commit date
parent directory ..
mnist		mnist
1-linear_regression_SGD_TF2-simple.ipynb		1-linear_regression_SGD_TF2-simple.ipynb
2-exercise-linear_regression_SGD_TF2-horovod.ipynb		2-exercise-linear_regression_SGD_TF2-horovod.ipynb
2-solution-linear_regression_SGD_TF2-horovod.ipynb		2-solution-linear_regression_SGD_TF2-horovod.ipynb
README.md		README.md

README.md

Visualizing the Stochastic Gradient Descent

We use here a 1D linear model to visualize the SGD algorithm in its variants Batch SGD (GD), Minibatch SGD and vanilla SGD.