A2 Fully Connected Nets with Batch Normalization Question....

Hi, Not sure where I am missing for this implementation that would produce higher errors. It seems I am missing something that should be propagate back to previous layers...

Running check with reg = 0 Initial loss: 2.26672370069 W1 relative error: 5.99e-01 <<<<<<<<<<< W2 relative error: 3.33e-01 <<<<<<<<<<< W3 relative error: 4.74e-10 b1 relative error: 2.22e-03 b2 relative error: 2.22e-08 b3 relative error: 6.51e-11 beta1 relative error: 3.33e-01 <<<<<<<<<<< beta2 relative error: 8.36e-09 gamma1 relative error: 3.33e-01 <<<<<<<<<<< gamma2 relative error: 2.18e-08 Running check with reg = 3.14 Initial loss: 6.85301802642 W1 relative error: 8.52e-02 <<<<<<<<<<< W2 relative error: 1.00e+00 <<<<<<<<<<< W3 relative error: 7.29e-09 b1 relative error: 1.73e-10 b2 relative error: 5.55e-09 b3 relative error: 2.58e-10 beta1 relative error: 3.34e-01 <<<<<<<<<<< beta2 relative error: 8.06e-09 gamma1 relative error: 3.34e-01 <<<<<<<<<<< gamma2 relative error: 7.80e-09

Thanks!