Narrative Style and the Spread of Health Misinformation on Twitter

Achyutarama R Ganti, Eslam Ali Hassan Hussein, Steven R. Wilson, Zexin Ma, Xinyan Zhao

Submission Type: Regular Long Paper

Submission Track: Computational Social Science and Cultural Analytics

Submission Track 2: NLP Applications

Keywords: narrative communication, misinformation, computational social sciences, natural language processing, linguistic analysis, classification

Abstract: Using a narrative style is an effective way to communicate health information both on and off social media. Given the amount of misinformation being spread online and its potential negative effects, it is crucial to investigate the interplay between narrative communication style and misinformative health content on user engagement on social media platforms. To explore this in the context of Twitter, we start with previously annotated health misinformation tweets (n ≈15,000) and annotate a subset of the data (n=3,000) for the presence of narrative style. We then use these manually assigned labels to train text classifiers, experimenting with supervised fine-tuning and in-context learning for automatic narrative detection. We use our best model to label remaining portion of the dataset, then statistically analyze the relationship between narrative style, misinformation, and user-level features on engagement, finding that narrative use is connected to increased tweet engagement and can, in some cases, lead to increased engagement with misinformation. Finally, we analyze the general categories of language used in narratives and health misinformation in our dataset.

Submission Number: 76