Learning by Surprise: Surplexity for Mitigating Model Collapse in Generative AI

NetSciX 2026 Conference Submission195 Authors

27 Sept 2025 (modified: 27 Sept 2025)NetSciX 2026 Conference SubmissionEveryoneRevisionsBibTeXCC BY 4.0
Keywords: LLM, Model Collapse, Linguistic Diversity, Synthetic Data, Artificial Intelligence
TL;DR: We propose a new characterization of model collapse in LLM autophagy based on next token probabilities, building a mitigation strategy and a network representation of the phenomenon
Submission Number: 195
Loading