arxivcs.LGmath.OC2026-07-07
Stability Annealing Selects the Implicit Bias of Smoothed Sign Descent: A Rate-Indexed Barrier Path on Separable Data
Xiangwu Wang, Chengwei Cao, Yicheng Song, Ran Bi, Peilin Yu
Adaptive gradient methods can favor max-margin separators that differ from gradient descent, yet a fixed positive numerical stability constant eventually changes the update geometry again. This paper studies the rate-controlled middle case for full-batch linear classification on…