UAV-VQG: Visual Question Generation Framework on UAV Images

Argho Sarkar, Maryam Rahnemoonfar

Abstract: Visual Question Generation (VQG) is one of the most challenging problems since it aims to produce relevant and meaningful questions from images. As the VQG process is able to generate a diverse set of questions that do not exist in the training set, various models (e.g., visual question answering) can be beneficial from this question generation task by evaluating the model’s performance in unknown settings. In this paper, we explored the visual question generation task on images collected by an unmanned aerial vehicle (UAV). We highlight the significant role of the question generation task and present a variational attention-based model that focuses on creating diversified and meaningful questions from images. In comparison to baseline approaches, our presented method has demonstrated the ability to create a broad and meaningful set of questions.