Analysis of Relationships between Visual Cognitive Contents and Response of Each Brain Region via Visual Question Answering

Ryo Shichida, Ren Togo, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

Abstract: This paper presents a brain activity analysis of the visual cognitive contents via Visual Question Answering (VQA). Our analysis enables generation of answers to various types of questions about viewed images such as objects, colors, numbers, and so on from only brain activity when a subject viewed the ones. In this paper, by comparing the answers about viewed images estimated from each brain region, we reveal differences in the brain response. Experimental results show that specific brain regions strongly respond to visual stimuli such as objects and colors.