Multimodal summarization with modality features alignment and features filtering

Binghao Tang, Boda Lin, Zheng Chang, Si Li

Abstract: Highlights•Maximum Mean Discrepancy to align the textual and visual modalities.•Using CLIP to extract visual features and a filter to enhance utilization.•Feasibility of Large Language Model for data preprocessing.