arxivcs.LGcs.AI2026-07-20
A Geometric Perspective on Stabilizing Value Conflict Resolution
Large Language Models (LLMs) often struggle to navigate value conflicts when trained with the compressed scalar rewards of Reinforcement Learning from Human Feedback (RLHF). To address this challenge, we investigate how chain-of-thought (CoT) reasoning can help improve performanc…