Description Logic Concept Learning using Large Language Models

Adrita Barua, Pascal Hitzler

Keywords: LLM's, logical reasoning, DL-Learner, Concept Learning, DL Class Expressions, XAI, Ontology Engineering

Abstract:

Recent advances in Large Language Models (LLMs) have drawn interest in their capacity for logical reasoning, an area traditionally dominated by symbolic systems that rely on complete, manually curated knowledge bases represented in formal languages. This paper introduces a framework that leverages pretrained LLMs to generate Description Logic (DL) class expressions from instance-level examples and background knowledge, translated to natural language. The baseline is Concept Induction, a symbolic learning approach that is mostly based on formal logical reasoning over a DL theory. Drawing inspiration from the DL-Learner architecture, our approach replaces traditional symbolic methods with LLM-based models to generate DL class expressions from instance-level data.

We evaluate our approach using three benchmark ontologies across two LLMs: gpt-4o and o3-mini. We use a symbolic reasoner, Pellet, to verify the LLM-generated results and incorporate the reasoner’s feedback into our pipeline to ensure logical consistency, thereby generating a hybrid neurosymbolic system. By introducing controlled variations to the background knowledge, we assess the models’ reliance on commonsense versus formal reasoning. Results show that o3-mini achieves near-perfect accuracy across settings, albeit with longer runtime. These findings demonstrate that LLMs have the potential to serve as scalable and flexible DL learners when coupled in a hybrid neurosymbolic setting, offering a promising alternative to symbolic approaches—particularly in contexts where high-quality ontologies are incomplete or unavailable.

Track: Main Track

Paper Type: Long Paper

Resubmission: No

Software: https://github.com/AdritaBarua/DL-learner-using-LLMs/tree/main

Submission Number: 48