Enhancing Concept-based Learning with Logic

Deepika Vemuri, Gautham Bellamkonda, Vineeth N. Balasubramanian

Keywords: Concepts, first-order logic, differentiable logic, interpretability

TL;DR: We propose a logic-based module to incorporate the relations between concepts in the learning process.

Abstract: Concept-based models promote learning in terms of high-level transferrable abstractions. These models offer one level more of transparency compared to a black box model, as the predictions are a weighted combination of concepts. The relations between concepts are a rich source of information that would compliment learning. We propose using the propositional logic derived from the concepts to model these relations and to address the expressivity-vs-interpretability tradeoff in these models. Three architectural variants that give rise to logic-enhanced models are introduced. We analyse several ways of training them and experimentally show that logic-enhanced concept-based models perform better than or on par with the base models, with the additional benefit of having better concept alignment and interpretability. These models allow for a richer formal expression of predictions, paving the way for logical reasoning with symbolic concepts.

Submission Number: 65