Evaluate Communication Capability of Language Model: A Brief Survey from Evolution View

06 Nov 2023 (modified: 26 Jan 2024)PKU 2023 Fall CoRe SubmissionEveryoneRevisionsBibTeXCC BY 4.0
Keywords: Communication, Intention, Belief, Cooperation
Abstract: Creating intelligent agents that genuinely comprehend human language has long been the aspiration of natural language processing scientists. However, most of the current evaluation metrics for language models fail to accurately distinguish whether a language model truly grasps the essence of communication or merely replicates human speech patterns. Furthermore, contemporary robots struggle to engage in non-verbal communication with humans. To address these two issues, this essay will first differentiate between the concepts of machines truly understanding communication and merely imitating it. Subsequently, we will analyze the origins of human language production and emergence within the context of evolutionary biology. Building upon this analysis, this essay will introduce two criteria for assessing whether intelligent agents have mastered the essential traits of human communication.
Submission Number: 118
Loading