Goal-Oriented Interactions in Games Using LLMs

Adon Phillips, Jochen Lang, David Mould

Abstract: Unrealistic parser-based dialogue systems limit player agency. Large language model (LLM) characters can enhance agency but lack structure and measurable objectives. In this article, we propose a framework for structured interactions that tracks player progress through specific objectives, while also improving character LLM responses. This approach frames interactions as puzzles with states representing goal-based milestones. We employ an LLM to analyze dialogue history and enforce state transitions for state awareness and to enable specific actions like tailored LLM prompts and multimodal content changes. This results in a robust dialogue state tracking system for goal-based interactions. Using our method, a designer can craft transition rules as abstract goals that allow players to invent their own solutions rather than discovering the designer's intent. We demonstrate this with a hostage scenario game, where the player negotiates with a hostage-taker adversary. The game's effectiveness is assessed through qualitative gameplay analysis and a quantitative evaluation of our state tracking method.