arxivmath.OCcs.LGcs.NEmath.NA2026-07-16
Fast and Scalable Caputo Fractional Gradient Descent via Perturbation-Preserving Memory Compression
Hwanseo Lee, Junseo Lee, Hyunju Kim
Fractional gradient descent (FGD) incorporates long-range memory through Caputo-type operators and has been shown to improve stability in ill-conditioned and nonconvex optimization problems. Despite these advantages, its practical use remains limited, mainly due to the high compu…