Approximating Boolean functions with depth-2 circuits

We study the complexity of approximating Boolean functions with DNFs and other depth-2 circuits, exploring two main directions: universal bounds on the approximability of all Boolean functions, and the approximability of the parity function. In the first direction, our main positive results are the first non-trivial universal upper bounds on approximability by DNFs: Every Boolean function can be epsilon-approximated by a DNF of size O-epsilon(2(n)/log n) Every Boolean function can be epsilon-approximated by a DNF of width c(epsilon) n, where c(epsilon) < 1. Our techniques extend broadly to give strong universal upper bounds on approximability by various depth-2 circuits that generalize DNFs, including the intersection of halfspaces, low-degree PTFs, and unate functions. We show that the parameters of our constructions come close to matching the information-theoretic inapproximability of a random function. In the second direction our main positive result is the construction of an explicit DNF that approximates the parity function: PAR(n) can be epsilon-approximated by a DNF of size 2((1-2 epsilon)n) and width (1-2 epsilon)n. Using Fourier analytic tools we show that our construction is essentially optimal not just within the class of DNFs, but also within the far more expressive classes of the intersection of halfspaces and intersection of unate functions.