EleutherAI: Going Beyond "Open Science" to "Science in the Open"

Jason Phang, Herbie Bradley, Leo Gao, Louis J. Castricato, Stella Biderman

Keywords: open, public, research, collaboration

TL;DR: How EleutherAI conducts research in public, and why it has been successful

Abstract: Over the past two years, EleutherAI has established itself as a radical initiative aimed at both promoting open-source research and conducting research in a transparent, openly accessible and collaborative manner. EleutherAI's approach to research goes beyond transparency; by doing research entirely in public, anyone in the world can observe and contribute at every stage. Our work has been received positively and resulted in several high-impact projects in Natural Language Processing and other fields. In this paper, we describe our experience doing public-facing machine learning research, the benefits we believe this approach brings, and the pitfalls we have encountered.