Can Large Language Models Create New Knowledge for Spatial Reasoning Tasks?

ACL ARR 2024 August Submission55 Authors

11 Aug 2024 (modified: 12 Sept 2024)ACL ARR 2024 August SubmissionEveryoneRevisionsBibTeXCC BY 4.0
Abstract: The potential for Large Language Models (LLMs) to generate new information offers a potential step change for research and innovation. This is challenging to assert as it can be difficult to determine what an LLM has previously seen during training, making ``newness'' difficult to substantiate. In this paper we observe that LLMs are able to perform sophisticated reasoning on problems with a spatial dimension, that they are unlikely to have previously directly encountered. While not perfect, this points to a significant level of understanding that state-of-the-art LLMs can now achieve, supporting the proposition that LLMs are able to yield significant emergent properties. In particular, Claude 3 is found to perform well in this regard.
Paper Type: Short
Research Area: NLP Applications
Research Area Keywords: mathematical NLP, generalization, reasoning
Contribution Types: Position papers
Languages Studied: english
Submission Number: 55
Loading

OpenReview is a long-term project to advance science through improved peer review with legal nonprofit status. We gratefully acknowledge the support of the OpenReview Sponsors. © 2025 OpenReview