CORTEXA
← Browse
arxivcs.LG2026-07-09

Auditing Invisible Weight Updates with Reference Traces

Zekai Shang

Master weights and stochastic rounding bypass invisible stored-weight updates but do not locate lost direct-storage proposals or parameters worth protecting. We ask what one matched high-precision pilot trace can audit before a low-precision run. The exact target-code event is distinct from projected-code and archived symmetric-spacing aggregate proxies; neither proxy is a pathwise certificate. In the principal controlled two-layer grid, the archived symmetric-spacing proxy tracks nondegenerate crossings spanning 384x in time with median predicted/measured ratio 1.000 and 94.5% within 15%. In analytic-grid GPT-2-124M/OpenWebText runs with common initial target codes, changing only post-optimizer write-back from round-to-nearest to stochastic rounding recovers 89.2-92.2% of the loss gap through 10,000 steps. The same policy contrast recovers 92.9-93.6% at 3,000 E5M2 steps in one fixed 162.2M-parameter decoder configuration, but its visibility trajectories are not informative enough to establish diagnostic transfer. At exactly 10% of the eligible-2-D blanket fp32-master payload, mean recoveries across three fixed seeds are 71.4% for clipped signed leverage, 69.4% for absolute proposal contribution, and 2.1% for freeze-only; the latter comparison does not establish leverage superiority. In a post-selection fixed-target check, one seed-2031 absolute-proposal-contribution mask, reused unchanged across fixed target seeds 2035-2037, recovers 67.8-69.0% (mean 68.5%) at the same exact 10% eligible-2-D fp32-master payload and 1000-step horizon; target-specific masks recover 67.1-70.6% (mean 68.7%). A reference trace therefore supports separate aggregate-visibility and first-order-importance analyses, with failed transfer and superiority tests delimiting both.

View free PDFSource page

Related papers

arxivcs.LG2026-07-23

Searching the Space of Feed-Forward Neural-Network Weight-Update Rules with Fixed Depth Symbolic Regression

Charles Brum, Edward Finkelstein

We investigate whether symbolic regression can discover explicit neural network weight-update rules that outperform standard hand-designed optimizers on small symbolic regression benchmarks. Candidate update rules are represented as fixed-depth symbolic expressions over operands…

View free PDFSource page
arxivcs.LG2026-07-04

Memory Merge DQN: Sensitivity Weighted Target Updates for Stable Value Learning

Adrian Ly, Richard Dazeley, Peter Vamplew, Sunil Aryal, Francisco Cruz

Deep Q-networks use target networks to stabilise bootstrapped value learning, but the standard hard copy update also introduces a tradeoff. Holding the target network fixed, improves short term stability, yet each hard update abruptly replaces the target parameters with the newes…

View free PDFSource page
arxivcs.LGstat.ML2026-07-16

Probabilistic Physics-Informed Neural Networks for Estimating Heterogeneous Elastic Properties from Low-Resolution and Noisy Displacement Data

Tatthapong Srikitrungruang, Jaesung Lee

Estimating spatially heterogeneous elastic properties from low-resolution displacement measurements is a severely ill-posed inverse elasticity problem because low resolution obscures spatial details needed to distinguish heterogeneous property variations, and small measurement pe…

View free PDFSource page