Does Adversarial Transferability Indicate Knowledge Transferability?

Kaizhao Liang, Jacky Y. Zhang, Oluwasanmi O Koyejo, Bo Li

Keywords: adversarial transferability, knowledge transferability

Abstract: Despite the immense success that deep neural networks (DNNs) have achieved, \emph{adversarial examples}, which are perturbed inputs that aim to mislead DNNs to make mistakes, have recently led to great concerns. On the other hand, adversarial examples exhibit interesting phenomena, such as \emph{adversarial transferability}. DNNs also exhibit knowledge transfer, which is critical to improving learning efficiency and learning in domains that lack high-quality training data. To uncover the fundamental connections between these phenomena, we investigate and give an affirmative answer to the question: \emph{does adversarial transferability indicate knowledge transferability?} We theoretically analyze the relationship between adversarial transferability and knowledge transferability, and outline easily checkable sufficient conditions that identify when adversarial transferability indicates knowledge transferability. In particular, we show that composition with an affine function is sufficient to reduce the difference between two models when they possess high adversarial transferability. Furthermore, we provide empirical evaluation for different transfer learning scenarios on diverse datasets, showing a strong positive correlation between the adversarial transferability and knowledge transferability, thus illustrating that our theoretical insights are predictive of practice.

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics

One-sentence Summary: We investigate and give an affirmative answer to the question: 'does adversarial transferability indicate knowledge transferability?'

Community Implementations: [ 2 code implementations](https://www.catalyzex.com/paper/arxiv:2006.14512/code)

Reviewed Version (pdf): https://openreview.net/references/pdf?id=BDCok8d7Dt