Gradient Descent for Optimization

Gradient descent iteratively adjusts weights in the direction that lowers the loss.