Gradient Descent Training

Gradient descent updates weights in the direction that reduces the loss.

How does gradient descent update a network's weights?