Jiafu Tang

AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioning

Yanghai Wang, Jiahao Wang, Jiafu Tang, Yuanxing Zhang, Zhe Cao, Hanyan Bian, et al.

Omni-modal video captioning is not merely combining visual captioning with audio transcription: a useful caption must describe how visual actions, speech, music, and sound effects co-evolve. Existing large multimodal models often fail at this relational step, treating audio and v…Read more

Beyond blind feature injection: An information foraging theory-guided deep learning framework for product recommendation

Weiyue Li, Ming Gao, Jingmin An, Bowei Chen, Jiafu Tang, Xuhui Wang, et al.