Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers

Open Webpage

Siddharth Singh, Prajwal Singhania, Aditya Ranjan, John Kirchenbauer, Jonas Geiping, Yuxin Wen, Neel Jain, Abhimanyu Hans, Manli Shu, Aditya Tomar, Tom Goldstein, Abhinav Bhatele

Published: 01 Jan 2024, Last Modified: 15 May 2025SC 2024EveryoneRevisionsBibTeXCC BY-SA 4.0