Leveraging Virtual Reality and AI Tutoring for Language Learning: A Case Study of a Virtual Campus Environment with OpenAI GPT Integration with Unity 3D

Adithya Tadaga Gangadhar, Abhinavaram N, Gowri Srinivasa

Abstract: This paper presents a new approach to multiple language learning, with Hindi as the language to be learned, by integrating virtual reality environments and AI-enabled tutoring systems using OpenAI’s GPT API calls. A virtual campus environment was developed using Unity, focusing on a detailed representation of our university’s building’s 11th floor, where most cultural and technological activities take place. Within this environment, an AI tutor powered by OpenAI’s GPT model provided language learning support in Hindi, handling translation tasks. The system utilized speech-to-text, text-to-text conversion, and text-to-speech capabilities for real-time interaction. This research demonstrates the synergy of VR technology and AI tutoring for immersive language learning experiences.