Norm-Based Capacity Control in Neural Networks thumbnail
Pause
Mute
Subtitles not available
Playback speed
0.25
0.5
0.75
1
1.25
1.5
1.75
2
Full screen

Norm-Based Capacity Control in Neural Networks

Published on Aug 20, 20151927 Views

We investigate the capacity, convexity and characterization of a general family of norm-constrained feed-forward networks.

Related categories

Chapter list

Norm-Based Capacity Control in Neural Networks00:00
Can we control the capacity of NNs independent of num. of params?00:14
Group norm regularization01:14
Rademacher complexity bound01:50
Per-unit regularization (q=∞) - 102:47
Per-unit regularization (q=∞) - 203:18
Overall regularization (p=q)03:54
Conclusions04:25