Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication

Anastasia Koloskova, Sebastian U. Stich, Martin Jaggi

Abstract: We consider decentralized stochastic optimization with the objective function (e.g. data samples for machine learning tasks) being distributed over n machines that can only communicate to their nei...