Code QuizIntermediate

Learning Rate Effect in Updates

Find why this learning-rate update ignores the step size.

Codepython

def update_value(V, state, td_error, alpha):
    # move estimate toward the target by a fraction alpha
    V[state] = V[state] + td_error
    return V

What is the bug in this value update?