A Fix for Softmax and Cross-Entropy Numerical Bugs
An analysis of two numerical bugs in standard implementations of softmax and cross-entropy, proposing corrections for gradient calculations.
An analysis of two numerical bugs in standard implementations of softmax and cross-entropy, proposing corrections for gradient calculations.