Keywords: Semantic drift, topic change point, neural semantic fusion, large language model, social computing
Abstract: Evaluating semantic drift is essential for understanding dynamical discourse evolution and opinion formation in online discussions. However, sparse and uneven distributions of event-specific keywords prevent traditional models from capturing post-level semantic drift. Thus, to address this issue, we propose an LLM-embedding Semantic Adaptation Network (LLM-SAN), which is a hybrid semantic drift evaluation model with an LLM-Embedding gated recurrent unit (GRU) module, an LLM-Embedding graph convolutional network (GCN) module and a multi-expert adaptive fusion module. The GRU module is used to extract features from event related posts, and The GCN is used to extract features from temporal graphical topic posts. Then, the features are merged by the multi-expert adaptive fusion module. Finally, this module predicts the future post embedding, and the prediction error is used to evaluate and detect the semantic drift points. Extensive experiments are conducted, and the results show that LLM-SAN achieves the state-of-the-art performance on the semantic drift evaluation task, compared to the other baselines. Ablation experiments are also conducted to show the effectiveness of each module in LLM-SAN.
Paper Type: Long
Research Area: Computational Social Science, Cultural Analytics, and NLP for Social Good
Research Area Keywords: human behavior analysis, NLP tools for social analysis, quantitative analyses of news and/or social media
Contribution Types: NLP engineering experiment, Data analysis
Languages Studied: English
Submission Number: 10073
Loading