Adapt and explore: Multimodal mixup for representation learning

Ronghao Lin, Haifeng Hu

Abstract: Highlights•Innovatively introducing mixup strategy to multimodal representation learning.•Conducting multimodal mixup through adapting and exploring steps.•Mixing negative samples in multimodal contrastive learning.•Improving the robustness against missing modalities and the performance of multimodal representations.•Transferable to various multimodal learning scenarios.