Location: EU Supported » PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning » NIPS Workshop on Efficient Machine Learning, Whistler 2007

Who is Afraid of Non-Convex Loss Functions?

author: Yann LeCun, New York University (NYU)
published: Dec. 29, 2007,   recorded: December 2007,   views: 46370
Categories

Slides

Related Open Educational Resources

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.
  Bibliography

Description

The NIPS community has suffered of an acute convexivitis epidemic:
- ML applications seem to have trouble moving beyond logistic regression, SVMs, and exponential-family graphical models;
- For a new ML model, convexity is viewed as a virtue;
- Convexity is sometimes a virtue;
- But it is often a limitation.
ML theory has essentially never moved beyond convex models - the same way control theory has not really moved beyond linear systems.

See Also:

Download slides icon Download slides: eml07_lecun_wia_01.pdf (8.2 MB)

Help icon Streaming Video Help

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 Robert Hones, August 25, 2021 at 4:49 a.m.:

I am glad that that you discuss this ML theory which has essentially never moved beyond convex models - the same way control theory has not really moved beyond linear systems.

Cheers!
https://www.handysolutionsjcg.com

Comment2 Hayley, September 10, 2021 at 5:24 p.m.:

I believe the limitations you have encountered never limited the possibilities that you did during this time.

https://jaredspears.com/

Comment3 Fath Abv, December 2, 2021 at 1:08 p.m.:

ML applications seem to have trouble moving beyond logistic regression, SVMs, and exponential-family graphical models. This is a great discussion.
http://toledodeckpros.com

Comment4 Findjoo, October 13, 2023 at 3:23 p.m.:

Simplify online payments, event registration and email marketing for your business. Findjoo integrates seamlessly to your website and synchs with QuickBooks. https://www.findjoo.com/

Comment5 Garage Door Repair in Atlanta, October 24, 2023 at 1:30 a.m.:

We Proudly Provide Expert Service to the Following Atlanta Neighborhoods: Sandy Springs, Brookhaven, Dunwoody, Druid Hills. https://allgoodgaragedoor.com/garage-...

Comment6 Garage Door Repair in Cartersville , November 15, 2023 at 2:19 p.m.:

Get Same Day Garage Door Repair Services in Cartersville, GA.

https://allgoodgaragedoor.com/garage-...

Comment7 Garage Door Repair in Marietta, November 15, 2023 at 2:30 p.m.:

Get Same Day Garage Door Repair Services in Marietta GA.

Comment8 Garage Door Repair in Marietta, November 15, 2023 at 2:34 p.m.:

Get Same Day Garage Door Repair Services in Marietta GA. https://allgoodgaragedoor.com/garage-...

Comment9 Garage Door Repair in Powder Springs, November 15, 2023 at 2:37 p.m.:

Get Same Day Garage Door Repair Services in Powder Springs GA. https://allgoodgaragedoor.com/garage-...

Comment10 Garage Door Repair in Smyrna, November 15, 2023 at 2:41 p.m.:

Get Same Day Garage Door Repair Services in Smyrna GA. https://allgoodgaragedoor.com/garage-...

Comment11 Garage Door Repair in Cumming, November 15, 2023 at 2:47 p.m.:

Get Same Day Garage Door Repair Services in Cumming GA. https://allgoodgaragedoor.com/garage-...

Comment12 Garage Door Repair in Alpharetta, November 23, 2023 at 10:39 a.m.:

Get Same Day Garage Door Repair Services in Alpharetta GA.

https://allgoodgaragedoor.com/garage-...

Comment13 Garage Door Repair in Milton, November 23, 2023 at 10:59 a.m.:

Get Same Day Garage Door Repair Services in Milton GA.

https://allgoodgaragedoor.com/garage-...

Comment14 Garage Door Repair in Roswell, November 23, 2023 at 11:07 a.m.:

Get Same Day Garage Door Repair Services in Roswell GA.
https://allgoodgaragedoor.com/garage-...

Write your own review or comment:

make sure you have javascript enabled or clear this field: