KEFI: Kernel-based Feature Identification for Generalizable Classification

Long Tung Vuong, Chuanxia Zheng, Manh Luong, Thanh-Toan Do, Trung Le, Dinh Phung

Primary Area: unsupervised, self-supervised, semi-supervised, and supervised representation learning

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.

Keywords: Representation Learning, Domain generalization, Image classification

Submission Guidelines: I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2024/AuthorGuide.

Abstract:

To achieve satisfactory generalization performance on previously unseen domains, existing domain generalization (DG) methods often assume fixed domain-invariant features from a set of training domains for good generalization on new domains. However, this assumption can be overly strict, especially when the source domains lack shared information or when the target domains utilize information from selective source domains in a compositional manner. This leads to the natural question of how we utilize information from the source domain to the target domain in an appropriate way. In response to this challenge, we propose an innovative framework that includes an attribute-based feature extractor that captures from the source domains semantically meaningful components referred to as \textit{attributes} and a \textit{Kernel-based Attribute Identifier} that leverages kernel learning theory to define the decision boundaries for these attributes collected from the source domains. This dynamic learning approach empowers the classifier to effectively identify the learned attributes in the domains it has not encountered before. We empirically validate our method on well-established DG benchmarks,
achieving competitive results compared to state-of-the-art techniques.

Anonymous Url: I certify that there is no URL (e.g., github page) that could be used to find authors' identity.

No Acknowledgement Section: I certify that there is no acknowledgement section in this submission for double blind review.

Submission Number: 5092