Measure Children's Mindreading Ability with Machine Reading
Submission Type: Regular Long Paper
Submission Track: NLP Applications
Submission Track 2: Human-Centered NLP
Keywords: Natural Language Processing, Machine Reading Comprehension, Multimodal, Psychology, Mind-reading
TL;DR: A new framework for building automated scoring system for evaluating children's mindreading ability.
Abstract: Recently, much research in psychology has benefited from the advances in machine learning techniques.
Some recent studies showed that it is possible to build automated scoring models for children's mindreading.
These models were trained on a set of manually-labeled question-response pairs, which were collected by asking children to answer one or two questions after a short story is told or a video clip is played.
However, existing models did not take the features of the stories and video clips into account when scoring, which obviously will reduce the accuracy of the scoring models. Furthermore, considering that different psychological tests may contain the same questions, this approach cannot be extended to other related psychological test datasets.
In this study, we proposed a multi-modal learning framework to leverage the features extracted from the stories and videos related to the questions being asked during the children's mindreading evaluation.
Experimental results show that the scores produced by the proposed models agree well with those graded by human experts, highlighting the potential of the proposed network architecture for practical automated children's mindreading scoring systems.
Submission Number: 1072
Loading