Surprisal is Influenced by Syntax and Semantics, but not Equally across Language Models

Alessandro Lopopolo, Milena Rabovsky

Published: 03 Oct 2025, Last Modified: 03 Oct 2025CPL 2025 SpotlightPosterEveryoneRevisionsBibTeXCC BY 4.0
Keywords: LLMs, surprisal, syntax, dependency grammar, constituency grammar, N400
TL;DR: Surprisal from language models reflects constituency and dependency structure, and semantics differently across architectures.
Submission Number: 16