Vili Kohonen

Inoculation Adapters: Improved Selective Generalization of Capabilities with Fewer Surprising Backdoors

Maxime Riché, Daniel Tan, Vili Kohonen, Niels Warncke

Inoculation prompting is a selective-generalization technique used against Emergent Misalignment. We introduce inoculation adapters (IA), a family of methods that similarly reduce the optimization pressure to learn undesired traits by strengthening those traits during training. I…Read more