0.25
0.5
0.75
1.25
1.5
1.75
2
Norm-Based Capacity Control in Neural Networks
Published on Aug 20, 20151924 Views
We investigate the capacity, convexity and characterization of a general family of norm-constrained feed-forward networks.
Related categories
Chapter list
Norm-Based Capacity Control in Neural Networks00:00
Can we control the capacity of NNs independent of num. of params?00:14
Group norm regularization01:14
Rademacher complexity bound01:50
Per-unit regularization (q=∞) - 102:47
Per-unit regularization (q=∞) - 203:18
Overall regularization (p=q)03:54
Conclusions04:25