Concept

Gradient descent

Moving parameters a small step against the gradient of the loss, repeatedly, towards a minimum: water running downhill.

Reference ↗
Related
3 articles

Glossary →