On Approximating Functions of the Singular Values in a Stream

Abstract: For any real number $p &gt; 0$, we nearly completely characterize the space complexity of estimating $$|A|<em>p^p = \sum</em>{i=1}ⁿ \sigma_i<sup>p$$ for $n \times n$ matrices $A$ in which each row and each column has $O(1)$ non-zero entries and whose entries are presented one at a time in a data stream model. Here the $\sigma_i$ are the singular values of $A$, and when $p \geq 1$, $|A|_p<sup>p$ is the $p$-th power of the Schatten $p$-norm. We show that when $p$ is not an even integer, to obtain a $(1+\epsilon)$-approximation to $|A|_p<sup>p$ with constant probability, any $1$-pass algorithm requires $n<sup>{1-g(\epsilon)}$ bits of space, where $g(\epsilon) \rightarrow 0$ as $\epsilon \rightarrow 0$ and $\epsilon &gt; 0$ is a constant independent of $n$. However, when $p$ is an even integer, we give an upper bound of $$n^{1-2/p} \textrm{poly}(\epsilon^{-1}\log n)$$ bits of space, which holds even in the turnstile data stream model. The latter is optimal up to $\textrm{poly}(\epsilon^{-1} \log n)$ factors. Our results considerably strengthen lower bounds in previous work for arbitrary (not necessarily sparse) matrices $A$: the previous best lower bound was $\Omega(\log n)$ for $p\in (0,1)$, $\Omega(n^{{1/p-1/2}/\log} n)$ for $p\in [1,2)$ and $\Omega(n<sup>{1-2/p})$ for $p\in (2,\infty)$. We note for $p \in (2, \infty)$, while our lower bound for even integers is the same, for other $p$ in this range our lower bound is $n<sup>{1-g(\epsilon)}$, which is considerably stronger than the previous $n<sup>{1-2/p}$ for small enough constant $\epsilon &gt; 0$. We obtain similar near-linear lower bounds for Ky-Fan norms, SVD entropy, eigenvalue shrinkers, and M-estimators, many of which could have been solvable in logarithmic space prior to our work.