Eunsol Choi

Training Continuous Chain of Thought Models: A Tale of Two Regimes

Varun Yerram, He He, Eunsol Choi

Continuous Chain-of-Thought methods replace verbose reasoning traces with a short sequence of dense latent representations. Earlier continuous CoT methods indirectly supervise the latent representations such that its final state match that of verbose reasoning traces, requiring a…Read more