arxivcs.LGcs.AIcs.CL2026-07-15
Consensus as Privileged Context for Label-Free Self-Distillation
John Gkountouras, Josip Jukić, Ivan Titov
Sampling multiple solutions and returning the majority answer is among the most reliable ways to improve the reasoning accuracy of large language models without labels, and a growing family of methods converts this consensus signal into training supervision. However, existing app…