[Re] Numerical influence of ReLU'(0) on backpropagation
ReScience C
A replication about the numerical influence of the derivative convention for ReLU at zero during backpropagation.
Investigate On a controlled network with exact-zero activations, how do alternative zero-derivative conventions change gradients and subsequent updates?