John Gkountouras

Consensus as Privileged Context for Label-Free Self-Distillation

John Gkountouras, Josip Jukić, Ivan Titov

Sampling multiple solutions and returning the majority answer is among the most reliable ways to improve the reasoning accuracy of large language models without labels, and a growing family of methods converts this consensus signal into training supervision. However, existing app…Read more