Reliable Service Recommendation: A Multi-Modal Adversarial Method for Personalized Recommendation Under Uncertain Missing Modalities

Junyang Chen, Ruohan Yang, Jingcai Guo, Huan Wang, Kaishun Wu, Liang-Jie Zhang

Abstract: Personalized recommendation is of paramount importance in online content platforms like Kuai and Tencent. To ensure accurate recommendations, it is crucial to consider multi-modal information in both items and user-user/item interactions. While existing works on multimedia recommendation have made strides in leveraging multi-modal contents to enrich item representations, many of them overlook the practical scenario of multiple modality missing. As a result, the performance of recommendation systems can be significantly compromised in such cases. In this paper, we introduce a novel multi-modal adversarial method called $MMAM$, which aims to provide reliable personalized recommendation services even in the presence of uncertain missing modalities. The core idea behind $MMAM$ is to design a generator that can effectively encode both user-user/item interactions and multi-modal contents, taking into account various missing cases. The generator is trained to learn transferable features from different combinations of missing modalities in order to deceive a discriminative classifier. Additionally, we propose a modal discriminator that can classify the missing cases of multi-modalities, further enhancing the capability of the model. Moreover, a well-equipped predictor utilizes the transferable features to predict potential user interests. To improve the prediction accuracy, we design a type discriminator that enhances the classification of link types. By employing a mini-max game between the generator and the discriminators, $MMAM$ successfully obtains transferable features that encompass multi-modal contents, even when facing uncertain missing modalities. We conduct extensive experiments on industrial datasets, including Kuai and Tencent. Comparing with state-of-the-art approaches, MMAM achieves improvements in personalized recommendation tasks under uncertain missing modalities. MMAM holds promise for enhancing multi-modal personalized recommendations in real-world applications.

External IDs:dblp:journals/tsc/ChenYGWWZ25