Papers › The Optimal Hard Threshold for Singular Values is 4/sqrt(3)

The Optimal Hard Threshold for Singular Values is 4/sqrt(3)

24 May 2013arXiv:1305.5870links table onlyarchive 2025-07-28

Matan Gavish, David L. Donoho

The archive published only this paper's code-link row. Authors, date and abstract are from arXiv's metadata (CC0), read from the Kaggle arXiv metadata snapshot of 2026-09-12 where its title matched the archive's; the title is the archive's.

We consider recovery of low-rank matrices from noisy data by hard thresholding of singular values, where singular values below a prescribed threshold λ are set to 0. We study the asymptotic MSE in a framework where the matrix size is large compared to the rank of the matrix to be recovered, and the signal-to-noise ratio of the low-rank piece stays constant. The AMSE-optimal choice of hard threshold, in the case of n-by-n matrix in noise level \sigma, is simply (4/√(3)) √(n)σ≈2.309 √(n)σ when σ is known, or simply 2.858·y_(med) when σ is unknown, where y_(med) is the median empirical singular value. For nonsquare m by n matrices with m ≠n, these thresholding coefficients are replaced with different provided constants. In our asymptotic framework, this thresholding rule adapts to unknown rank and to unknown noise level in an optimal manner: it is always better than hard thresholding at any other value, no matter what the matrix is that we are trying to recover, and is always better than ideal Truncated SVD (TSVD), which truncates at the true rank of the low-rank matrix we are trying to recover. Hard thresholding at the recommended value to recover an n-by-n matrix of rank r guarantees an AMSE at most 3nrσ². In comparison, the guarantee provided by TSVD is 5nrσ², the guarantee provided by optimally tuned singular value soft thresholding is 6nrσ², and the best guarantee achievable by any shrinkage of the data singular values is 2nrσ². Empirical evidence shows that these AMSE properties of the 4/√(3) thresholding rule remain valid even for relatively small n, and that performance improvement over TSVD and other shrinkage rules is substantial, turning it into the practical hard threshold of choice.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

erichson/optht mentioned on GitHub report
kieferk/pymssa mentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections