Investigating the Impact of Code Generation Tools (ChatGPT & Github CoPilot) on Programming Education

Faisal Nizamudeen, Lorenzo Gatti, Nacir Bouali, Faizan Ahmed

Abstract: In our rapidly evolving technological landscape, AI tools have gained substantial power and integration across various domains. Through interviews and surveys conducted at a University in the Netherlands, we investigated students’ perceptions of AI tools. Our results show that students generally have a positive attitude towards the adoption of AI technologies and feel that it enhances their learning experience. Furthermore, this research project examines the capabilities of AI-powered tools, namely GitHub Copilot and ChatGPT, in solving a variety of university-level assignments. By empirically evaluating the capabilities of these AI tools and offering insights to educators, this research project aims to assist them in designing programming exercises that encompass essential learning processes while accounting for students’ utilization of AI tools. The findings indicate that a majority of the exercises currently utilized by the examined university could be solved partially or entirely