Prohibiting Generative AI in any Form of Weapon Control

Mary Cummings

Keywords: generative artificial intelligence, lethal autonomous weapons, safety-critical

TL;DR: Generative AI is inherently unreliable and not appropriate in environments that could result in the loss of life until hallucinations are addressed.

Abstract: This position paper argues that the use of generative artificial intelligence (GenAI) to control, direct, guide or govern any weapon, either in situ or remotely, should be prohibited by government agencies and non-governmental organizations. Such a moratorium should exist until hallucinations can be successfully modeled and predicted. Generative AI is inherently unreliable and not appropriate in environments that could result in the loss of life.

Lay Summary: This position paper argues that the use of generative artificial intelligence (GenAI) to control, direct, guide or govern any weapon, either in a battlefield or from remote control stations, should be prohibited by government agencies and non-governmental organizations. Such a moratorium should exist until hallucinations can be successfully modeled and predicted. Generative AI is inherently unreliable and not appropriate in any environment that could result in the loss of life.

Submission Number: 142