Research Community Perspectives on ``Intelligence'' and Large Language Models

ACL ARR 2025 February Submission7552 Authors

Abstract:

Despite the widespread use of "artificial intelligence" (AI) framing in Natural Language Processing (NLP) research, it is not clear what researchers mean by "intelligence". To that end, we present the results of a survey on the notion of "intelligence" among researchers and its role in the research agenda. The survey elicited complete responses from 303 researchers from a variety of fields including NLP, Machine Learning, Cognitive Science, Linguistics, Neuroscience.
We identify $3$ criteria of intelligence that the community agrees on the most: generalization, adaptability, \& reasoning.
Our results suggests that the perception of the current NLP systems as "intelligent" is a minority position (29\%).
Furthermore, only 16.2\% of the respondents see developing intelligent systems as a research goal, and these respondents are more likely to consider the current systems intelligent.

Paper Type: Long

Research Area: Special Theme (conference specific)

Research Area Keywords: community survey, intelligence, generalization, terminology, large language models

Contribution Types: Surveys

Languages Studied: English

Submission Number: 7552