arxivcs.LG2026-06-30
Fora: From Weight-Space to Function-Space Protection in Capability-Preserving Fine-Tuning
Full fine-tuning adapts large language models to new tasks but can erode capabilities they already possess. Existing remedies protect through proxies such as parameter distances, importance penalties, output matching, or dominant singular directions of the weights, but none direc…