Skip to content

Latest commit

 

History

History
12 lines (11 loc) · 469 Bytes

README.md

File metadata and controls

12 lines (11 loc) · 469 Bytes

image

Gradient_Descent_Comparisons

Benchmark on different Gradient Descent algorithms:

  • Constant step gradient descent
  • Gradient Descent with backtracking
  • Gradient descent on the steepest l1-norm
  • Fletcher-Reeves Combined Gradient Descent
  • Polack-Ribière Combined Gradient Descent
  • Adam accelerated Gradient Descent
  • Newton Gradient Descent
  • Quasi-Newton Gradient Descent