Is there a mathematically rigorous treatment of Adadelta?

I was wondering if there is a mathematically rigorous treatment of Adadelta, since the derivation of the algorithm is rather handwavy. Compare that to the paper of Adagrad, which provides a clear motivation and proofs.

Posted Feb 4, 2016, 7:36 PM UTC

41
alexmlamb•

No.

1st comment. ༼つ ◕_◕ ༽つ

-3