On research oversight for fostering responsible AI R&D ecosystem

Published: 02 Jan 2025, Last Modified: 03 Mar 2025AAAI 2025 Workshop AIGOV OralEveryoneRevisionsBibTeXCC BY 4.0
Keywords: AI-governance, AI-safety, dual-use
TL;DR: Current AI Governance discourse lacks discussion on oversight of research and development related to AI
Abstract: An overlooked area in the current discourse on AI Governance is the discussion on oversight of research and development related to AI. We are inspired by the work on federal research oversight policies in bio-safety and bio-security communities, which are critical components of effective governance and ensure the responsible conduct of potentially dual-use research. In this paper, we highlight the need for discussions related to the critically important topic of research oversight of AI R&D and the potential benefits of such oversight to the AI R&D ecosystem. We identify if and how the frameworks in the bio-safety and bio-security community can help us think through the development of such a policy framework for AI, identify the critical challenges unique to AI when thinking of research oversight policies and procedures, and propose a suggested framework to mitigate some of the challenges. The intent of this paper is to ensure that there are appropriate risk identification and mitigating methods in place to prevent incidents and to raise awareness among researchers, academic institutions, and funding agencies about concerns related to AI safety and security.
Submission Number: 11
Loading

OpenReview is a long-term project to advance science through improved peer review with legal nonprofit status. We gratefully acknowledge the support of the OpenReview Sponsors. © 2025 OpenReview