Communication-efficient Distributed Learning for Large Batch Optimization

Rui Liu, Barzan Mozafari

Abstract: Many communication-efficient methods have been proposed for distributed learning, whereby gradient compression is used to reduce the communication cost. However, given recent advances in large batc...