Learning Rate and Its Effect on Training

The learning rate controls how big each gradient descent step is, shaping how fast and how reliably a neural network learns.