How Do Strategies for Using ChatGPT Affect Knowledge Comprehension?

Li Chen, Gen Li, Boxuan Ma, Cheng Tang, Fumiya Okubo, Atsushi Shimada

Abstract: This study investigates the effects of generative AI on the knowledge comprehension of university students, focusing on the use of ChatGPT strategies. Data from 81 junior students who used the ChatGPT worksheet were collected and analyzed. Path analysis revealed complex interactions between ChatGPT strategy use, e-book reading behaviors, and students’ prior perceived understanding of concepts. Students’ prior perceived understanding and reading behaviors indirectly affected their final scores, mediated by the ChatGPT strategy use. The mediation effects indicated that reading behaviors significantly influenced final scores through ChatGPT strategies, indicating the importance of the interaction with learning materials. Further regression analysis identified the specific ChatGPT strategy related to verifying and comparing information sources as significantly influenced by reading behaviors and directly affecting students’ final scores. The findings provide implications for practical strategic guidance for integrating ChatGPT in education.