Keywords: face, embedding, reconstruction, gan, template, homomorphic encryption, privacy, attack, security, computer vision
TL;DR: Using deep face embeddings from facial recognition systems, we reconstruct face images which are high-resolution, realistic, and reconstruct relevant attributes of the original face.
Abstract: Modern face recognition systems use deep convolution neural networks to extract latent embeddings from face images. Since basic arithmetic operations on embeddings are needed to make comparisons, generic encryption schemes cannot be used. This leaves facial embedding unprotected and susceptible to privacy attacks that reconstruction facial identity. We propose a search algorithm on the latent vector space of StyleGAN to find a matching face. Our process yields latent vectors that generate face images that are high-resolution, realistic, and reconstruct relevant attributes of the original face. Further, we demonstrate that our process is capable of fooling FaceNet, a state-of-the-art face recognition system.
Paper Under Submission: The paper is NOT under submission at NeurIPS