Stylometric Analysis of Large Language Model-Generated Commentaries in the Context of Medical Neuroscience

Jan K. Argasinski, Iwona Grabska-Gradzinska, Karol Przystalski, Jeremi K. Ochab, Tomasz Walkowiak

Abstract: This study investigates the application of Large Language Models (LLMs) in generating commentaries on neuroscientific papers, with a focus on their stylometric differences from human-written texts. Utilizing three papers from reputable journals in the field of medical neuroscience, each accompanied by published expert commentaries, we compare these with commentaries generated by state-of-the-art LLMs. Through quantitative stylometric analysis and qualitative assessments, we aim to be a part of the discussion around the viability of LLMs in augmenting scientific discourse within the domain of medical neuroscience.