Self-Destructing Models: Increasing the Costs of Harmful Dual Uses in Foundation Models

Eric Mitchell, Peter Henderson, Christopher D Manning, Dan Jurafsky, Chelsea Finn

Keywords: pretraining, foundation models, ai safety, meta learning, dual use, responsible ai

TL;DR: We show how to pretrain foundation models such that they can't be fine-tuned on harmful tasks

Abstract: A growing ecosystem of large, open-source foundation models has reduced the labeled data and technical expertise necessary to apply machine learning to many new problems. Yet foundation models pose a clear dual-use risk, indiscriminately reducing the costs of building both harmful and benign machine learning systems. To mitigate this risk, we propose the task blocking paradigm, in which foundation models are trained with an additional mechanism to impede adaptation to harmful tasks while retaining good performance on desired tasks. We call the resulting models self-destructing models, inspired by mechanisms that prevent adversaries from using tools for harmful purposes. We present an algorithm for training self-destructing models leveraging techniques from meta-learning and adversarial learning, showing that it can largely prevent a BERT-based model from learning to perform gender identification without harming the model's ability to perform profession classification. We conclude with a discussion of future directions.

Community Implementations: [ 1 code implementation](https://www.catalyzex.com/paper/self-destructing-models-increasing-the-costs/code)