Developer Guide for Intel® Data Analytics Acceleration Library 2018

Adaptive Subgradient Method

The adaptive subgradient method (AdaGrad) [Duchi2011] follows the algorithmic framework of an iterative solver with the algorithm-specific transformation T and set of intrinsic parameters S t defined for the learning rate η as follows: