arxivcs.LGeess.SY2026-06-27
Analysis of Adam Algorithms for Stochastic Dynamic Systems
The adaptive moment estimation algorithm, known as Adam, is widely used in modern machine learning, owing to its low per-iteration complexity and strong empirical performance. Despite its prevalent use, the theoretical foundation of Adam remains largely unexplored for time-varyin…