Papers
Topics
Authors
Recent
Search
2000 character limit reached

The maximum mutual information between the output of a discrete symmetric channel and several classes of Boolean functions of its input

Published 18 Jan 2017 in cs.IT and math.IT | (1701.05014v2)

Abstract: We prove the Courtade-Kumar conjecture, for several classes of n-dimensional Boolean functions, for all n≥2n \geq 2 and for all values of the error probability of the binary symmetric channel, 0≤p≤1/20 \leq p \leq 1/2. This conjecture states that the mutual information between any Boolean function of an n-dimensional vector of independent and identically distributed inputs to a memoryless binary symmetric channel and the corresponding vector of outputs is upper-bounded by 1−H⁡(p)1-\operatorname{H}(p), where H⁡(p)\operatorname{H}(p) represents the binary entropy function. That is, let X=[X1…Xn]\mathbf{X}=[X_1 \ldots X_n] be a vector of independent and identically distributed Bernoulli(1/2) random variables, which are the input to a memoryless binary symmetric channel, with the error probability in the interval 0≤p≤1/20 \leq p \leq 1/2 and Y=[Y1…Yn]\mathbf{Y}=[Y_1 \ldots Y_n] the corresponding output. Let f:0,1<sup>n</sup>→0,1f:{0,1}<sup>n</sup> \rightarrow {0,1} be an n-dimensional Boolean function. Then, MI⁡(f(X),Y)≤1−H⁡(p)\operatorname{MI}(f(X),Y) \leq 1-\operatorname{H}(p). Our proof employs Karamata's theorem, concepts from probability theory, transformations of random variables and vectors and algebraic manipulations.

Authors (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.