A Novel Hybrid Architectures for Overcoming Sparse Data in Subscription Product Recommendation Systems

Jinmo Kang, Sanghyeon Lee, Yeonghwan Jeon, Hyuncheol Jo, Byoung-Ki Jeon

Abstract: As subscription-based business models gain importance across industries like e-commerce, content streaming, and OTT platforms, the demand for recommendation systems tailored to these services has grown significantly. However, these systems frequently encounter challenges such as data sparsity, imbalanced user engagement, and product interdependencies, which traditional recommendation models struggle to fully address. Existing models often fail to account for the unique aspects of subscription service, leading to suboptimal recommendations. To address these shortcomings, this study proposes a new hybrid architecture that addresses both data sparsity and imbalance. By integrating recommendation and classification models, the proposed approach aims to improve both the accuracy and diversity of product recommendations. The system is built on a Recency, Frequency, and Monetary (RFM) feature store and employs correction techniques such as negative sampling and Gaussian rank scaling to better capture user behavior and product relationships. Additionally, combining Wide & Deep and XGBoost models ensures strong performance across different data environments. Both offline and online evaluations show that the proposed model significantly improves recommendation accuracy, click-through rates, and business revenue, proving its effectiveness for subscription-based services.

External IDs:dblp:conf/bigdataconf/KangLJJJ24