Energy-Based Models for Anomaly Detection: A Manifold Diffusion Recovery Approach

Published: 21 Sept 2023, Last Modified: 02 Nov 2023NeurIPS 2023 posterEveryoneRevisionsBibTeX
Keywords: Energy-based Models, Anomaly Detection, Generative Models, Out-of-Distribution Detection, Recovery Likelihood
TL;DR: We present Manifold Projection-Diffusion Recovery, a new training algorithm for energy-based models (EBMs), and show its effectiveness in anomaly detection and out-of-distribution detection tasks.
Abstract: We present a new method of training energy-based models (EBMs) for anomaly detection that leverages low-dimensional structures within data. The proposed algorithm, Manifold Projection-Diffusion Recovery (MPDR), first perturbs a data point along a low-dimensional manifold that approximates the training dataset. Then, EBM is trained to maximize the probability of recovering the original data. The training involves the generation of negative samples via MCMC, as in conventional EBM training, but from a different distribution concentrated near the manifold. The resulting near-manifold negative samples are highly informative, reflecting relevant modes of variation in data. An energy function of MPDR effectively learns accurate boundaries of the training data distribution and excels at detecting out-of-distribution samples. Experimental results show that MPDR exhibits strong performance across various anomaly detection tasks involving diverse data types, such as images, vectors, and acoustic signals.
Submission Number: 6281
Loading