Information Theory

MSC 94A

Shannon theory, coding theory, entropy, mutual information, channel capacity.

38 problems

UnsolvedMajor

Capacity of the Binary Deletion Channel

Information TheoryTheoretical Computer Science
Unsolved

Remove logarithmic gaps in minimax sample complexity for matrix normal covariance estimation

Mathematical StatisticsInformation TheoryProbability Theory

Sourced from the work of Rafael Mendes de Oliveira, William Cole Franks, Akshay Ramachandran, Michael Walter

Unsolved

Full minimax characterization for tensor normal factor estimation beyond the largest factor

Mathematical StatisticsInformation TheoryProbability Theory

Sourced from the work of Rafael Mendes de Oliveira, William Cole Franks, Akshay Ramachandran, Michael Walter

Unsolved

Optimal guarantees in the low-sample tensor regime (below constant-Frobenius threshold)

Mathematical StatisticsInformation TheoryProbability Theory

Sourced from the work of Rafael Mendes de Oliveira, William Cole Franks, Akshay Ramachandran, Michael Walter

Unsolved

Exact information-theoretic detection threshold for correlated SBM vs Erdos-Renyi pair

Probability TheoryMathematical StatisticsInformation Theory

Sourced from the work of Guanyi Chen, Jian Ding, Shuyang Gong, Zhangsong Li

Unsolved

General-$k$ threshold for testing correlated SBMs against independent SBMs

Probability TheoryMathematical StatisticsInformation Theory

Sourced from the work of Guanyi Chen, Jian Ding, Shuyang Gong, Zhangsong Li

UnsolvedNotable

From low-degree hardness to unconditional polynomial-time hardness

Probability TheoryMathematical StatisticsInformation Theory

Sourced from the work of Guanyi Chen, Jian Ding, Shuyang Gong, Zhangsong Li

Unsolved

Remove the Polylogarithmic Gap to Exact Minimax Optimality

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Kaizheng Wang

Unsolved

Polynomial-time minimax robust mean estimation under star-shaped constraints

Mathematical StatisticsInformation Theory

Sourced from the work of Akshay Prasadan, Matey Neykov

Unsolved

Sharp minimax behavior as contamination approaches the breakdown boundary $\epsilon\uparrow 1/2$

Mathematical StatisticsInformation Theory

Sourced from the work of Akshay Prasadan, Matey Neykov

Unsolved

Information-theoretic limits under heavy-tailed (non-sub-Gaussian) noise

Mathematical StatisticsInformation Theory

Sourced from the work of Akshay Prasadan, Matey Neykov

Unsolved

Robust Confounder Selection Under Imperfect Primary-Set Elicitation

Information TheoryCombinatorics & Graph Theory

Sourced from the work of F. Richard Guo, Qingyuan Zhao

Unsolved

Statistical Identification of Primary Adjustment Sets From Data

Information TheoryCombinatorics & Graph Theory

Sourced from the work of F. Richard Guo, Qingyuan Zhao

Unsolved

Optimal Break-Point Estimation Rate in Grouped Time-Varying Network VAR

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Degui Li, Bin Peng, Songqiao Tang, Wei Biao Wu

Unsolved

Full Multiple-Break Theory for Latent Group Structure and Coefficients

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Degui Li, Bin Peng, Songqiao Tang, Wei Biao Wu

Unsolved

Finite-sample optimal FDR-FNR frontier under the two-group model

Mathematical StatisticsProbability TheoryInformation Theory

Sourced from the work of Yutong Nie, Yihong Wu

Unsolved

Optimal FDR-FNR tradeoff beyond independent two-group mixtures

Mathematical StatisticsProbability TheoryInformation Theory

Sourced from the work of Yutong Nie, Yihong Wu

Unsolved

Asymptotic Normality of Spectrum-Aware Debiasing Beyond Right-Rotationally Invariant Designs

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Yufan Li, Pragya Sur

Unsolved

Theory for Debiased PCR Under General Covariate Models

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Yufan Li, Pragya Sur

Unsolved

Overparameterized optimal subsample size for infinite-ensemble subagging

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Takuya Koriyama, Pratik Patil, Jin-Hong Du, Kai Tan, Pierre C. Bellec

Unsolved

Nonasymptotic guarantees for bagged regularized M-estimators

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Takuya Koriyama, Pratik Patil, Jin-Hong Du, Kai Tan, Pierre C. Bellec

Unsolved

Extension beyond convex differentiable-loss framework

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Takuya Koriyama, Pratik Patil, Jin-Hong Du, Kai Tan, Pierre C. Bellec

Unsolved

Finite-sample error-rate control and power guarantees under the linear subspace model

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Amitay Eldar, Keren Mor Waknin, Samuel Davenport, Tamir Bendory, Armin Schwartzman, Yoel Shkolnisky

Unsolved

Log-factor-free adaptive contraction on general Minkowski-dimensional domains

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Tao Tang, Xiuyuan Cheng, Nan Wu, David Dunson

Unsolved

Optimal adaptation beyond compact manifolds

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Tao Tang, Xiuyuan Cheng, Nan Wu, David Dunson

Unsolved

Machine-learning debiased efficient estimation under generalized data-fusion alignments

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Ellen Sandra Graham, Marco Carone, Andrea Rotnitzky

Unsolved

Beyond smooth finite-dimensional targets in unified semiparametric data fusion

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Ellen Sandra Graham, Marco Carone, Andrea Rotnitzky

Unsolved

Non-asymptotic AMP distributional theory beyond polynomially many iterations

Mathematical StatisticsInformation Theory

Sourced from the work of Gen Li, Yuting Wei

Unsolved

Characterize adaptive distribution classes where two-point rates are attainable

Mathematical StatisticsInformation TheoryCombinatorics & Graph Theory

Sourced from the work of Spencer Compton, Gregory Valiant

Unsolved

Remove polylogarithmic slack in attainable two-point rates

Mathematical StatisticsInformation TheoryCombinatorics & Graph Theory

Sourced from the work of Spencer Compton, Gregory Valiant

Unsolved

Sharp boundary for attainability in finite-sample location models

Mathematical StatisticsInformation TheoryCombinatorics & Graph Theory

Sourced from the work of Spencer Compton, Gregory Valiant

Unsolved

Remove polylogarithmic dimension factors in high-dimensional Berry--Esseen bounds for $m$-dependent sums

Mathematical StatisticsProbability TheoryInformation Theory

Sourced from the work of Heejong Bong, Arun Kumar Kuchibhotla, Alessandro Rinaldo

Unsolved

Complete optimality characterization in the independent-vector specialization under minimal moments

Mathematical StatisticsProbability TheoryInformation Theory

Sourced from the work of Heejong Bong, Arun Kumar Kuchibhotla, Alessandro Rinaldo

UnsolvedNotable

Critical SNR for outlier emergence at fixed summary statistics

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Gerard Ben Arous, Reza Gheissari, Jiaoyang Huang, Aukosh Jagannath

UnsolvedNotable

Small-SNR no-outlier regime and monotonicity in SNR

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Gerard Ben Arous, Reza Gheissari, Jiaoyang Huang, Aukosh Jagannath

Unsolved

Sharp dynamic emergence thresholds for XOR/multilayer GMM classification

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Gerard Ben Arous, Reza Gheissari, Jiaoyang Huang, Aukosh Jagannath

Unsolved

Outlier theory beyond non-degeneracy/invertibility assumptions (ReLU and zero diagonal entries)

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Gerard Ben Arous, Reza Gheissari, Jiaoyang Huang, Aukosh Jagannath

Unsolved

Outlier characterization for unbounded link functions (e.g., phase retrieval)

Mathematical StatisticsOptimization & Variational MethodsInformation Theory

Sourced from the work of Gerard Ben Arous, Reza Gheissari, Jiaoyang Huang, Aukosh Jagannath