video thumbnail
Pause
Mute
Subtitles
Playback speed
0.25
0.5
0.75
1
1.25
1.5
1.75
2
Full screen

Dropout Training as Adaptive Regularization

Published on 2014-11-072231 Views

Dropout and other feature noising schemes control overfitting by artificially corrupting the training data. For generalized linear models, dropout performs a form of adaptive regularization. Using thi

Related categories

Presentation

Dropout Training as Adaptive Regularization00:00
Dropout acts as a label-independent regularizer00:23
The shape of the dropout regularizer01:37
Semi-supervised dropout03:00