Weight Initialization Strategy

Identify why initializing all weights to zero breaks learning.

import numpy as np

def init_layer(n_in, n_out):
    W = np.zeros((n_out, n_in))
    b = np.zeros(n_out)
    return W, b

What is the bug in this weight initialization?