Dmitry Vetrov

Beyond Modality Fusion: Deep Ensembles for Multimodal Classification

Ilya Burenko, Dmitry Vetrov

In multimodal classification, late-fusion approaches classify concatenated modality-specific features extracted by unimodal neural networks. When modality imbalance is pronounced, various regularization techniques have been proposed to balance the learning process and overcome th…Read more