Beyond Labels and Topics: Discovering Causal Relationships in Neural Topic Modeling

Yi-Kun Tang, Heyan Huang, Xuewen Shi, Xian-Ling Mao

Keywords: Causal relationships discovery, Neural topic model, Structural Causal Model

Abstract:

Topic models that can take advantage of labels are broadly used in identifying interpretable topics from textual data.
However, existing topic models tend to merely view labels as names of topic clusters or as categories of texts, thereby neglecting the potential causal relationships between supervised information and latent topics, as well as within these elements themselves.
In this paper, we focus on uncovering possible causal relationships both between and within the supervised information and latent topics to better understand the mechanisms behind the emergence of the topics and the labels.
To this end, we propose Causal Relationship-Aware Neural Topic Model (CRNTM), a novel neural topic model that can automatically uncover interpretable causal relationships between and within supervised information and latent topics, while concurrently discovering high-quality topics.
In CRNTM, both supervised information and latent topics are treated as nodes, with the causal relationships represented as directed edges in a Directed Acyclic Graph (DAG).
A Structural Causal Model (SCM) is employed to model the DAG.
Experiments are conducted on three public corpora with different types of labels.
Experimental results show that the discovered causal relationships are both reliable and interpretable, and
the learned topics are of high quality comparing with seven start-of-the-art topic model baselines.

Track: Web Mining and Content Analysis

Submission Guidelines Scope: Yes

Submission Guidelines Blind: Yes

Submission Guidelines Format: Yes

Submission Guidelines Limit: Yes

Submission Guidelines Authorship: Yes

Student Author: Yes

Submission Number: 2503