Conceptual Framework for Trustworthy Artificial Intelligence: Combining Large Language Models with Formal Logic Systems

Andrey Nechesov, Dmitry Kondratyev, Sviridenko Dmitry, Igor Anureev, Natalia Garanina, Gumirow Andrei, Ivan Gorobets, Dementyeva Yana

Keywords: digital twins, smart city, polynomial programming methodology, Turing-complete language, semantic programming, large language model, trustworthy AI, deductive verification, 2-SAT

Abstract:

The paper explores the problem of building trustworthy artificial intelligence based on large language models and p-computable checkers.
For this purpose we present a concept of framework for reliable verification of answers obtained by large language models (LLMs). We focus on the application of this framework to digital twin systems, particularly for smart cities, where LLMs are not yet widely used due to their resource intensity and potential for hallucination. Taking into account the fact that solution verification from a suitable set of tasks is p-computable and in most cases less complex than computing and implementing the whole task, we present a methodology that uses checkers to assess the validity of LLM-generated solutions. These checkers are implemented within the methodology of polynomial-time programming in Turing-complete languages, and guarantee a polynomial-time complexity. Our system was tested on the 2-SAT problem. This framework offers a scalable way to implement trustworthy AI systems with guaranteed polynomial complexity, ensuring error detection and preventing system hangups.

Submission Number: 22