Go to ACL ARR 2025 February homepageImproved Unbiased Watermark for Large Language Models
Abstract: As artificial intelligence surpasses human capabilities in text generation, the necessity to authenticate the origins of AI-generated content has become paramount. Unbiased watermarks offer a powerful solution by embedding statistical signals into language model-generated text without distorting the quality. In this paper, we introduce MCmark, a family of unbiased, Multi-Channel-based watermarks. MCmark works by partitioning the model's vocabulary into segments and promoting token probabilities within a selected segment based on a watermark key. We demonstrate that MCmark not only preserves the original distribution of the language model but also offers significant improvements in detectability and robustness over existing unbiased watermarks.
Our experiments with widely-used language models demonstrate an improvement in detectability of over 10\% using MCmark, compared to existing state-of-the-art unbiased watermarks. This advancement underscores MCmark's potential in enhancing the practical application of watermarking in AI-generated texts.
Paper Type: Long
Research Area: Machine Learning for NLP
Research Area Keywords: Language Model Watermarking, Generative Models
Contribution Types: NLP engineering experiment, Theory
Languages Studied: English, Romanian
Submission Number: 1165
Loading