Subjective Learning for Conflicting Data

Tianren Zhang, Yizhou Jiang, Xin Su, Shangqi Guo, Chongkai Gao, Feng Chen

Keywords: Supervised learning, conflicting data, multi-domain learning

TL;DR: We investigate a novel learning regime of learning from conflicting data, which generalizes the single target function assumption that is widely adopted in conventional supervised learning.

Abstract: Conventional supervised learning typically assumes that the learning task can be solved by approximating a single target function. However, this assumption is often invalid in open-ended environments where no manual task-level data partitioning is available. In this paper, we investigate a more general setting where training data is sampled from multiple domains while the data in each domain conforms to a domain-specific target function. When different domains possess distinct target functions, training data exhibits inherent "conflict'', thus rendering single-model training problematic. To address this issue, we propose a framework termed subjective learning where the key component is a subjective function that automatically allocates the data among multiple candidate models to resolve the conflict in multi-domain data, and draw an intriguing connection between subjective learning and a variant of Expectation-Maximization. We present theoretical analysis on the learnability and the generalization error of our approach, and empirically show its efficacy and potential applications in a range of regression and classification tasks with synthetic data.