Question-Based Viewing with LLM-Powered Personified Characters: A Role-Playing Dialogue System for Perspective-Taking in Museums

Akito Nakano, Shio Takidaira, Tsukasa Sawaura, Yoshiyuki Shoji, Takehiro Yamamoto, Yusuke Yamamoto, Hiroaki Ohshima, Kenro Aihara, Noriko Kando

Abstract: This paper proposes an interactive museum-viewing support system designed to foster diverse perspective-taking through role-play with fictional characters. While museums are widely regarded as valuable informal learning environments, passive viewing often results in low engagement and limited knowledge retention. Inspired by Visual Thinking Strategies (VTS), our tablet-based application leverages large language models (LLMs) to generate context-sensitive, character-driven questions posed by fantasy personas such as elves, dwarves, and werewolves, each with distinctive values and interpretive tendencies. Visitors engage with these questions and are occasionally prompted to assume a character’s role, generating their own questions in that persona’s voice. To explore the feasibility and user response, we conducted a small-scale case study at the National Museum of Ethnology, Japan. Although the number of participants was limited, the results provided valuable qualitative insights: the role-playing interaction increased engagement, encouraged perspective-shifting, and facilitated the generation of more varied and reflective questions.

External IDs:dblp:conf/icadl/NakanoTSSYYOAK25