Statistics and Data Science Seminar Ohad Shamir (Weizman Institute)
Size-Independent Sample Complexity of Neural Networks
Abstract: I'll describe new bounds on the sample complexity of deep neural networks, based on the norms of the parameter matrices at each layer. In particular, we show how certain norms lead to the first explicit bounds which are fully independent of the network size (both depth and width), and are therefore applicable to arbitrarily…