Irina Piontkovskaia

First-Order Predictable but Pairwise Fragile: Local Task Adaptation in Trained Transformers

Irina Piontkovskaia, Sergey Nikolenko

Task arithmetic, sequential fine-tuning, activation steering, and first-order random search all operate through relatively small perturbations around an already trained checkpoint, and they rely on different local approximations: individual perturbations should be first-order pre…Read more