AI Must not be Fully Autonomous

Tosin Adewumi, Lama Alkhaled, Florent Imbert, Hui Han, Nudrat Habib, Karl Löwenmark

Keywords: AI, Autonomous, Responsible Human Oversight

TL;DR: We are of the position that AI must not be fully autonomous.

Abstract: Autonomous AI has many benefits. It also has many risks. We identify the 3 levels of autonomous AI. We are of the position that AI must not be fully autonomous because of the many risks, especially as artificial superintelligence (ASI) is speculated to be just decades away. Fully autonomous AI, which can develop its own objectives, is at level 3 and without responsible human oversight. However, responsible human oversight is crucial for mitigating the risks. To argue for our position, we discuss the theories of autonomy, AI and agents. Then, we offer 12 distinct arguments and 3 counterarguments with rebuttals to the counterarguments. We also present 15 recent evidence of AI misaligned values and other risks.

Serve As Reviewer: ~Tosin_Adewumi1

Submission Number: 1