On the Importance of Difficulty Calibration in Membership Inference AttacksDownload PDF

29 Sept 2021, 00:30 (edited 15 Mar 2022)ICLR 2022 PosterReaders: Everyone
  • Keywords: membership inference attack, privacy
  • Abstract: The vulnerability of machine learning models to membership inference attacks has received much attention in recent years. However, existing attacks mostly remain impractical due to having high false positive rates, where non-member samples are often erroneously predicted as members. This type of error makes the predicted membership signal unreliable, especially since most samples are non-members in real world applications. In this work, we argue that membership inference attacks can benefit drastically from difficulty calibration, where an attack's predicted membership score is adjusted to the difficulty of correctly classifying the target sample. We show that difficulty calibration can significantly reduce the false positive rate of a variety of existing attacks without a loss in accuracy.
  • One-sentence Summary: Membership inference attacks can greatly benefit from a technique called difficulty calibration, significantly improving their reliability.
11 Replies

Loading