Code QuizIntermediate

SGD Parameter Update

Spot the sign error in this gradient descent update rule.

Codepython
def sgd_step(w, grad, lr=0.01):
    # move to reduce the loss
    w = w + lr * grad
    return w

What is the bug in this SGD update?