Gradient Descent and its Variants
Instituto de Investigaciones en Matemáticas Aplicadas y en Sistemas
Universidad Nacional Autónoma de México
Some are easy
Taken from Wikipedia
Some more difficult
Taken from Wikipedia
The scenario
Taken from Gradient Descent Derivation
Taken from Wikipedia
What about $k$
Taken from CS231n
Taken from Linear regression by gradient descent
Taken from An overview of gradient descent optimization algorithms
Taken from An overview of gradient descent optimization algorithms
Taken from Deep Learning in a Nutshell: History and Training
Gradient Descent and its Variants by Ivan V. Meza Ruiz is licensed under a Creative Commons Reconocimiento 4.0 Internacional License.
Creado a partir de la obra en http://turing.iimas.unam.mx/~ivanvladimir/slides/misc/gradient_descent.html.