Cognitive Flexibility of Large Language Models
Keywords: Cognitive Assessment, LLM
Abstract: Cognitive flexibility is a property of cognitive systems which enables success in rapid adaptation to new tasks in quick succession. We investigate the degree of cognitive flexibility exhibited by several Large Language Models by evaluating them on two neuropsychological tests, the Wisconsin Card Sorting Test and the Letter-Number Test. Our findings indicate that some Large Language Models fail to switch tasks within the same context window, despite succeeding at these same tasks in distinct context windows, while others are able to flexibly switch tasks.
Submission Number: 44
Loading