Data Cleaning by Deep Dictionary Learning

Zhongqi Lu, Qiang Yang

Abstract: The soundness of training data is important to the performance of a learning model. However in recommender systems, the training data are usually noisy. Because the users' behaviors have some randomness and their feedback towards the recommendations are sparse. In this work, we would like to propose a noise elimination model to preprocess the training data in the recommender systems. We define the noise as the abnormal patterns in the users' feedback. The proposed deep dictionary learning model tries to find the common patterns through dictionary learning. Meanwhile, we define the dictionary through the output layer of a stacked autoencoder, so that the dictionary is represented by a deep structure and the noise in the dictionary is further filtered-out.

Conflicts: ust.hk, cse.ust.hk