arxivcs.AIcs.CL2026-07-22
Refusal-Gated Decoding: Preserving Refusal Behavior Under High-Temperature Sampling
Phillip Howard, Xin Su, Allen Roush, Manikandan Ravikiran, Amir Abdullah
High-temperature sampling is one of the primary mechanisms for increasing diversity in LLMs. Recent advances in truncation-based sampling techniques have helped mitigate drawbacks of high-temperature sampling such as neural text degeneration, thereby enabling greater diversity in…