On Transmission Model for Massive MIMO under Low-Resolution Output Quantization

Bin Li, Ning Liang, Wenyi Zhang

Abstract: A general analytical framework based on generalized mutual information is applied to the analysis of massive multiple-input-multiple-output systems with low-resolution output quantization. For Gaussian codebook ensemble and nearestneighbor decoding rule, an equivalence relationship is established for general nonlinear transceiver distortion, that the effective signal-to-noise ratio based on the generalized mutual information is consistent with the heuristically derived signal-to-quantizationnoise ratio based on Bussgang theorem. Specializing to lowresolution output quantization, an extensively used approximate model called the additive quantization noise model is shown to be inconsistent with the generalized mutual information analysis, but this inconsistency can be remedied by taking into account the correlation within the quantization noise vector.