Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

On maximum-likelihood estimation in the all-or-nothing regime (2101.09994v1)

Published 25 Jan 2021 in cs.IT, cs.AI, cs.LG, and math.IT

Abstract: We study the problem of estimating a rank-1 additive deformation of a Gaussian tensor according to the \emph{maximum-likelihood estimator} (MLE). The analysis is carried out in the sparse setting, where the underlying signal has a support that scales sublinearly with the total number of dimensions. We show that for Bernoulli distributed signals, the MLE undergoes an \emph{all-or-nothing} (AoN) phase transition, already established for the minimum mean-square-error estimator (MMSE) in the same problem. The result follows from two main technical points: (i) the connection established between the MLE and the MMSE, using the first and second-moment methods in the constrained signal space, (ii) a recovery regime for the MMSE stricter than the simple error vanishing characterization given in the standard AoN, that is here proved as a general result.

User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Luca Corinzia (9 papers)
  2. Paolo Penna (30 papers)
  3. Wojciech Szpankowski (36 papers)
  4. Joachim M. Buhmann (47 papers)
Citations (1)

Summary

We haven't generated a summary for this paper yet.