Defending Diffusion Models Against Membership Inference Attacks via Higher-Order Langevin Dynamics

TMLR Paper9107 Authors

Abstract: Recent advances in generative artificial intelligence applications have raised new data security concerns. This paper focuses on defending diffusion models against membership inference attacks. This type of attack occurs when the attacker can determine if a certain data point was used to train the model. Although diffusion models are intrinsically more resistant to membership inference attacks than other generative models, they are still susceptible. The defense proposed here utilizes critically-damped higher-order Langevin dynamics, which introduces several auxiliary variables and a joint diffusion process along these variables. The idea is that the presence of auxiliary variables mixes external randomness that helps to corrupt sensitive input data earlier on in the diffusion process. This concept is theoretically investigated and validated on a toy dataset and the CIFAR-10 dataset using the Area Under the Receiver Operating Characteristic (AUROC) curves and the FID metric.

Submission Type: Regular submission (no more than 12 pages of main content)

Assigned Action Editor: ~Jinghui_Chen1

Submission Number: 9107