Papers › Sparse Plus Low Rank Matrix Decomposition: A Discrete Optimization Approach

Sparse Plus Low Rank Matrix Decomposition: A Discrete Optimization Approach

26 Sep 2021arXiv:2109.12701archive 2025-07-28

Dimitris Bertsimas, Ryan Cory-Wright, Nicholas A. G. Johnson

We study the Sparse Plus Low-Rank decomposition problem (SLR), which is the problem of decomposing a corrupted data matrix into a sparse matrix of perturbations plus a low-rank matrix containing the ground truth. SLR is a fundamental problem in Operations Research and Machine Learning which arises in various applications, including data compression, latent semantic indexing, collaborative filtering, and medical imaging. We introduce a novel formulation for SLR that directly models its underlying discreteness. For this formulation, we develop an alternating minimization heuristic that computes high-quality solutions and a novel semidefinite relaxation that provides meaningful bounds for the solutions returned by our heuristic. We also develop a custom branch-and-bound algorithm that leverages our heuristic and convex relaxations to solve small instances of SLR to certifiable (near) optimality. Given an input n-by-n matrix, our heuristic scales to solve instances where n=10000 in minutes, our relaxation scales to instances where n=200 in hours, and our branch-and-bound algorithm scales to instances where n=25 in minutes. Our numerical results demonstrate that our approach outperforms existing state-of-the-art approaches in terms of rank, sparsity, and mean-square error while maintaining a comparable runtime.

PaperPDFCode

Code

nicholasjohnson2020/sparselowranksoftware officialmentioned in papermentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Collaborative FilteringData Compression

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

SLR

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections