Gradient descent is a method for unconstrained mathematical optimization. It is a first-order iterative algorithm for minimizing a differentiable multivariate function. Source: Wikipedia, CC BY-SA 4.0 — https://en.wikipedia.org/wiki/Gradient_descent