TMBL: Transformer-based multimodal binding learning model for multimodal sentiment analysis

Jiehui Huang, Jun Zhou, Zhenchao Tang, Jiaying Lin, Calvin Yu-Chian Chen

Abstract: Highlights•Develop binding learning mechanism to facilitate cross-modal feature interaction.•Introduce optimized transformer structure to filter out inconsistent noise.•Introduce CLS and PE feature vectors in the modality fusion process.