UnsolvedMajor Unsolved Problem

Minimax-Optimal Sparse PCA: Computational–Statistical Gap

Posed by Berthet & Rigollet (formalized) (2013)

§ Problem Statement

Setup

Unsolved Problem

§ Discussion

Loading discussion…

§ Significance & Implications

§ Known Partial Results

§ References

[1]

Computational Lower Bounds for Sparse PCA

Quentin Berthet, Philippe Rigollet (2013)

Conference on Learning Theory (COLT)

📍 Section 5 (Complexity Theoretic Lower Bounds), opening paragraph immediately before Section 5.1 (“It is legitimate to wonder … is this gap intrinsic to the problem?”), p. 8

[2]

Minimax bounds for sparse PCA with noisy high-dimensional data

Aharon Birnbaum, Iain M. Johnstone, Boaz Nadler, Debashis Paul (2013)

Annals of Statistics

[3]

On the distribution of the largest eigenvalue in principal components analysis

Iain M. Johnstone (2001)

Annals of Statistics

📍 Section 1 (Introduction), formulation of the spiked covariance model Σ = I + θvvᵀ and Tracy–Widom limit for the largest eigenvalue, pp. 295–298.

[4]

PCA in high dimensions: An orientation

Iain M. Johnstone, Debashis Paul (2018)

Proceedings of the IEEE

📍 Section V (Sparse PCA), discussion of the computational–statistical gap between k log p / n and k² / n rates, pp. 11–14.

§ Tags