Papers › Gradient Sparsification for Communication-Efficient Distributed Optimization

Gradient Sparsification for Communication-Efficient Distributed Optimization

26 Oct 2017NeurIPS 2018 12arXiv:1710.09854archive 2025-07-28

Jianqiao Wangni, Jialei Wang, Ji Liu, Tong Zhang

Modern large scale machine learning applications require stochastic optimization algorithms to be implemented on distributed computational architectures. A key bottleneck is the communication overhead for exchanging information such as stochastic gradients among different workers. In this paper, to reduce the communication cost we propose a convex optimization formulation to minimize the coding length of stochastic gradients. To solve the optimal sparsification efficiently, several simple and fast algorithms are proposed for approximate solution, with theoretical guaranteed for sparseness. Experiments on ℓ₂ regularized logistic regression, support vector machines, and convolutional neural networks validate our sparsification approaches.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

BIG-bench Machine LearningDistributed OptimizationStochastic Optimizationregression

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Introduced by this paper: Gradient Sparsification

Gradient Sparsification

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections