Yuan Qing

StochasT: Learning with Stochastic Turn Depth for Visual Instruction Tuning

Yuan Qing, Chengzhi Mao, Boqing Gong

Large Vision-Language Models (LVLMs) rely extensively on Visual Instruction Tuning (VIT) to elicit their multimodal reasoning capabilities. However, we find a discrepancy: VIT often packs multiple language tasks about the same image for conversational, multi-turn training, wherea…Read more