AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix

Yun Yue, Zhiling Ye, Jiadi Jiang, Yongchao Liu, Ke Zhang. AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

Authors

Yun Yue

This author has not been identified. Look up 'Yun Yue' in Google

Zhiling Ye

This author has not been identified. Look up 'Zhiling Ye' in Google

Jiadi Jiang

This author has not been identified. Look up 'Jiadi Jiang' in Google

Yongchao Liu

This author has not been identified. Look up 'Yongchao Liu' in Google

Ke Zhang

This author has not been identified. Look up 'Ke Zhang' in Google