Allen Roush

Refusal-Gated Decoding: Preserving Refusal Behavior Under High-Temperature Sampling

Phillip Howard, Xin Su, Allen Roush, Manikandan Ravikiran, Amir Abdullah

High-temperature sampling is one of the primary mechanisms for increasing diversity in LLMs. Recent advances in truncation-based sampling techniques have helped mitigate drawbacks of high-temperature sampling such as neural text degeneration, thereby enabling greater diversity in…Read more