Multi-corpus emotion recognition method based on cross-modal gated attention fusion

Elena Ryumina, Dmitry Ryumin, Alexandr Axyonov, Denis Ivanko, Alexey Karpov

Abstract: Highlights•An open-source multi-corpus trained method for multimodal emotion recognition (MER).•A context-independent multimodal gated fusion at the feature level.•A first ablation study of MER using two different experimental setups.•New state-of-the-art results for four benchmarks: IEMOCAP, CMU-MOSEI, MELD, and AFEW.