The Replica-Symmetric Prediction for Random Linear Estimation With Gaussian Matrices Is Exact

Published: 01 Jan 2019, Last Modified: 07 Oct 2024IEEE Trans. Inf. Theory 2019EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: This paper considers the fundamental limit of random linear estimation for i.i.d. signal distributions and i.i.d. Gaussian measurement matrices. Its main contribution is a rigorous characterization of the asymptotic mutual information (MI) and minimum mean-square error (MMSE) in this setting. Under mild technical conditions, our results show that the limiting MI and MMSE are equal to the values predicted by the replica method from statistical physics. This resolves a well-known problem that has remained open for over a decade.
Loading

OpenReview is a long-term project to advance science through improved peer review with legal nonprofit status. We gratefully acknowledge the support of the OpenReview Sponsors. © 2025 OpenReview