Adaptive Algorithms

AI-SARAH: Adaptive and Implicit Stochastic Recursive Gradient Methods
We present AI-SARAH, a practical variant of SARAH. As a variant of SARAH, this algorithm employs the stochastic recursive gradient yet …
PDF Cite Code
AI-SARAH: Adaptive and Implicit Stochastic Recursive Gradient Methods
Paper accepted by TMLR.
👋 AI-SARAH is accepted by TMLR for publication.
Feb 22, 2023 Research, Academic Space
Paper accepted by TMLR.
Advanced Algorithms and Applications in Machine Learning
PDF Cite
Advanced Algorithms and Applications in Machine Learning
Doubly Adaptive Scaled Algorithm for Machine Learning Using Second-Order Information
We present a novel adaptive optimization algorithm for large-scale machine learning problems. Equipped with a low-cost estimate of …
PDF Cite Code
Doubly Adaptive Scaled Algorithm for Machine Learning Using Second-Order Information
Finite difference neural networks: Fast prediction of partial differential equations
Discovering the underlying behavior of complex systems is an important topic in many science and engineering disciplines. In this …
PDF Cite Code Video
Finite difference neural networks: Fast prediction of partial differential equations
FD-Net with Auxiliary Time Steps: Fast Prediction of PDEs using Hessian-Free Trust-Region Methods
Discovering the underlying physical behavior of complex systems is a crucial, but less well-understood topic in many engineering …
PDF Cite
FD-Net with Auxiliary Time Steps: Fast Prediction of PDEs using Hessian-Free Trust-Region Methods