arxivcs.CVcs.AI2026-07-08
Adversarial Decoys: Misdirecting Attention-Based Defenses in ViT
Giulia Marchiori Pietrosanti, Giulio Rossolini, Giorgio Buttazzo
Vision Transformers (ViTs) remain vulnerable to localized adversarial attacks, e.g., adversarial patches, while recent test-time defenses mitigate them by suppressing image tokens with abnormally high attention scores. These defenses exploit a strong coupling between attention an…