arxivcs.LG2026-06-30
Addressing Over-Refusal in LLMs with Competing Rewards
Safety training on language models often induces over-refusal: improved safety on harmful prompts at the cost of increased refusal on harmless ones. Though this trade-off can be mitigated by training models with reinforcement learning (RL) to reason before answering, it does not…