Denoising Diffusion Error Correction Codes

Yoni Choukroun, Lior Wolf

Keywords: ECC, Deep Learning, Diffusion Models

TL;DR: We propose a novel SOTA Neural error correction decoder based on a new diffusion model.

Abstract:

Error correction code (ECC) is an integral part of the physical communication layer, ensuring reliable data transfer over noisy channels.
Recently, neural decoders have demonstrated their advantage over classical decoding techniques.
However, recent state-of-the-art neural decoders suffer from high complexity and lack the important iterative scheme characteristic of many legacy decoders.
In this work, we propose to employ denoising diffusion models for the soft decoding of linear codes at arbitrary block lengths.
Our framework models the forward channel corruption as a series of diffusion steps that can be reversed iteratively.
Three contributions are made: (i) a diffusion process suitable for the decoding setting is introduced, (ii) the neural diffusion decoder is conditioned on the number of parity errors, which indicates the level of corruption at a given step, (iii) a line search procedure based on the code's syndrome obtains the optimal reverse diffusion step size.
The proposed approach demonstrates the power of diffusion models for ECC and is able to achieve state-of-the-art accuracy, outperforming the other neural decoders by sizable margins, even for a single reverse diffusion step.

Anonymous Url: I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.

No Acknowledgement Section: I certify that there is no acknowledgement section in this submission for double blind review.

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics

Submission Guidelines: Yes

Please Choose The Closest Area That Your Submission Falls Into: Deep Learning and representational learning