Code QuizIntermediate

Terminal State Handling

Find the bootstrapping bug that ignores episode termination.

Codepython

def td_target(reward, gamma, V, next_state, done):
    # if episode ended, there is no future value
    target = reward + gamma * V[next_state]
    return target

What is the bug in this TD target computation?