CORTEXA
← Browse
arxivcs.LGcs.AIphysics.chem-phphysics.comp-ph2026-07-02

Beyond Adam: SOAP and Muon for Faster, Label-Efficient Training of Machine Learning Interatomic Potentials

Gil Harari, Yoel Zimmermann, Ola Tangen Kulseng, Laura Zichi, Chuin Wei Tan, Marc L. Descoteaux, Boris Kozinsky

Machine learning interatomic potentials (MLIPs) have become a hallmark of AI for scientific simulation. While efforts on new architectures and datasets have led to increasingly accurate and general models, the choice of optimizer for training has largely remained unexplored, defaulting to Adam and its variants in the community. Here, we implement and systematically compare a class of recently proposed matrix-structured optimizers, including Muon, SOAP, and the hybrid SOAP-Muon, for training NequIP and Allegro MLIP models. We find that these optimizers can substantially outperform Adam in both convergence speed and final accuracy. SOAP and SOAP-Muon emerge as robust and consistently strong methods, while Muon only provides partial gains relative to Adam. The improvements are particularly pronounced under partial force supervision. Our results indicate that optimizer choice is an overlooked yet impactful design axis for MLIPs.

View free PDFSource page

Related papers

arxivcs.LGmath.NAphysics.chem-phphysics.comp-phphysics.data-an2026-07-08

Higher-Order Geometric Updates for Levenberg-Marquardt Method via Riemann Normal Coordinates

Jianing Liu, Dong H. Zhang

Nonlinear least-squares optimization is central to regression, physics-informed neural networks, and other machine-learning tasks. Such problems have a natural geometric interpretation, model predictions form a manifold in data space, while the chosen parameterization can introdu…

View free PDFSource page
arxivcs.LGcond-mat.mtrl-sciphysics.chem-phphysics.comp-ph2026-07-06

EquiFiLM: Charge-Conditioned Equivariant Force Fields via Feature-wise Linear Modulation

Samuel Sahel-Schackis, Ken-ichi Nomura, Aiichiro Nakano, Matthias F. Kling, Thomas Linker

Foundation machine learning force fields (MLFFs) such as MACE-MP-0 and UMA cover broad chemical space at near density functional theory (DFT) accuracy. However, they assume equilibrium ground-state physics and do not natively handle externally induced changes to the electronic st…

View free PDFSource page
arxivphysics.chem-phcs.AIphysics.comp-ph2026-07-23

Graph-Theoretic Neural Network Fragmentation with Covariant Direct Molecular Force Learning: Enabling Coupled-Cluster Accuracy AIMD for Fluxional Systems

Xiao Zhu, Srinivasan S. Iyengar

Accurate ab initio molecular dynamics (AIMD) simulations of complex, fluxional chemical systems are severely limited by the high computational scaling of correlated electronic structure methods. To overcome this bottleneck, we present a robust, graph-theoretic molecular fragmenta…

View free PDFSource page
arxivcs.LGcond-mat.mes-hallcs.AIcs.CEphysics.chem-ph2026-06-29

Beyond Drug Discovery: The Nanotechnology Molecular Optimization (NMO) Benchmark

Matthias Blaschke, Daniel Kienzle, Zsuzsanna Koczor-Benda, Julian Lorenz, Rainer Lienhart, Fabian Pauly

Generative molecular design is shaped by simple proxy benchmarks for drug-like properties and models pretrained on large pharmaceutical datasets. This combination yields strong benchmark metrics but limits transferability to domains structurally distinct from drug discovery. To o…

View free PDFSource page
arxivcs.LGcs.AIphysics.comp-phphysics.flu-dyn2026-06-25

Diffusion-corrected Autoregressive Fourier Neural Operator for Droplet Evolution Prediction

Jinghao Cao, Minsung Kang, Hongyue Sun, Chi Zhou, Jihoon Chung, Xubo Yue, et al.

Predicting droplet evolution in material jetting, or Inkjet Printing (IJP), is essential for maintaining printing quality. However, long-horizon forecasts remain challenging due to error accumulation and the complex coupling of process variables. In this work, we introduce the Di…

View free PDFSource page
arxivphysics.chem-phcs.LGphysics.comp-phphysics.data-an2026-07-22

Hypothesis-and-Refinement Learning of Organic Structures from Multimodal Spectroscopic Data

Chengchun Liu, Zhiyuan Yan, Li Yuan, Hao Li, Boxuan Zhao, Yonghong Tian, et al.

Determining molecular structures from spectroscopic data remains fundamentally challenging because the inverse problem is intrinsically underdetermined: individual spectra are sparse, low-dimensional, and encode only partial structural evidence relative to the vast space of possi…

View free PDFSource page