Developer Guide for Intel® Data Analytics Acceleration Library 2019 Update 1

Adaptive Subgradient Method

The adaptive subgradient method (AdaGrad) [Duchi2011] follows the algorithmic framework of an iterative solver with the algorithm-specific transformation T and set of intrinsic parameters S t defined for the learning rate η as follows: