Convergence Analysis of Gradient Descent Algorithms with Proportional Updates
Igor Gitman, Deepak Dilipkumar, Ben Parr
https://arxiv.org/abs/1801.03137
Jan. 9, 2018


Optimizers and activations