Distributed Training of Large Language Models on AWS Trainium

Open Webpage

Xinwei Fu, Zhen Zhang, Haozheng Fan, Guangtai Huang, Mohammad El-Shabani, Randy Huang, Rahul Solanki, Fei Wu, Ron Diamant, Yida Wang

Published: 01 Jan 2024, Last Modified: 16 Apr 2025SoCC 2024EveryoneRevisionsBibTeXCC BY-SA 4.0