What do they "meme"? A metaphor-aware multi-modal multi-task framework for fine-grained meme understanding

Bingbing Wang, Shijue Huang, Bin Liang, Geng Tu, Min Yang, Ruifeng Xu

Abstract: Highlights•Explore relations within and across modalities for fine-grained meme understanding.•Introduce a novel framework to bridge gaps between different modalities and tasks.•Conduct comprehensive experiments to show the excellence of our proposed framework.