New Quasi-Newton Methods for Efficient Large-Scale Machine Learning

The BFGS quasi-Newton method and its limited-memory variant LBFGS revolutionized nonlinear optimization, and dominate it to this day. Their application to large-scale machine learning, however, has be