Reducing Activation Recomputation in Large Transformer Models

Download PDF
Open Webpage

Vijay Anand Korthikanti, Jared Casper, Sangkug Lym, Lawrence McAfee, Michael Andersch, Mohammad Shoeybi, Bryan Catanzaro

Published: 2023, Last Modified: 13 Nov 2024MLSys 2023EveryoneRevisionsBibTeXCC BY-SA 4.0