Who is Afraid of Non-Convex Loss Functions?

author: Yann LeCun, New York University (NYU)
published: Dec. 29, 2007,   recorded: December 2007,   views: 46370
Categories

Slides

Related Open Educational Resources

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.
  Bibliography

Description

The NIPS community has suffered of an acute convexivitis epidemic:
- ML applications seem to have trouble moving beyond logistic regression, SVMs, and exponential-family graphical models;
- For a new ML model, convexity is viewed as a virtue;
- Convexity is sometimes a virtue;
- But it is often a limitation.
ML theory has essentially never moved beyond convex models - the same way control theory has not really moved beyond linear systems.

See Also:

Download slides icon Download slides: eml07_lecun_wia_01.pdf (8.2 MB)


Help icon Streaming Video Help

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 Robert Hones, August 25, 2021 at 4:49 a.m.:

I am glad that that you discuss this ML theory which has essentially never moved beyond convex models - the same way control theory has not really moved beyond linear systems.

Cheers!
https://www.handysolutionsjcg.com


Comment2 Hayley, September 10, 2021 at 5:24 p.m.:

I believe the limitations you have encountered never limited the possibilities that you did during this time.

https://jaredspears.com/


Comment3 Fath Abv, December 2, 2021 at 1:08 p.m.:

ML applications seem to have trouble moving beyond logistic regression, SVMs, and exponential-family graphical models. This is a great discussion.
http://toledodeckpros.com


Comment4 Chris Antrim, January 10, 2022 at 8:57 a.m.:

This is a great discussion, I hope they are up for a new article since it is an old blog.
https://www.saltlakecityroofers.com/


Comment5 Abby, February 17, 2022 at 11:03 p.m.:

this was really interesting in formation. thanks for sharing https://www.ssmhousecleaning.com/


Comment6 Adam, March 2, 2022 at 2:21 a.m.:

Thanks so much for sharing this amazing lecture!
https://www.ftworthwindshields.com/


Comment7 Carla, May 6, 2022 at 9:27 a.m.:

I am glad about this. | <a href="https://www.boiseteeth.com">www.boiseteeth.com</a>


Comment8 Carla, May 6, 2022 at 9:27 a.m.:

I am glad about this. | <a href="https://www.boiseteeth.com">www.boiseteeth.com</a>


Comment9 Carla, May 6, 2022 at 9:28 a.m.:

I am glad about this. - www.boiseteeth.com


Comment10 Rose Solero, May 7, 2022 at 5:14 a.m.:

I think this is a real great blog post. Really thank you! Fantastic.
https://www.upshotsolutionsllc.com/


Comment11 Mae, May 20, 2022 at 7:36 a.m.:

Call or book an appointment with us for your dental care and services! Our amazing dentist and accommodating staff are happy to assist you. - www.sacramentoemergencydental.net


Comment12 Antrim, May 20, 2022 at 7:41 a.m.:

Installation cannot be done using DIYs, this work should be done by professionals and skilled roofers. | https://www.boiseroofers.net


Comment13 James Kee, May 31, 2022 at 5:53 p.m.:

Awesome! This is very helpful for my team here https://stgeorge-atvrentals.com/


Comment14 Mae, June 9, 2022 at 6:25 a.m.:

There are numerous reasons why the roof of your home should be properly maintained. It serves as a protective barrier from debris and weather. However, despite its importance, the roof is not indestructible. - https://storage.googleapis.com/idaho-...


Comment15 R, June 9, 2022 at 6:27 a.m.:

Why visit an emergency dental clinic? To help you ease the pain in your mouth as soon as possible. Our team aims to give our patients the best dental services at a reasonable price. | https://24hours-emergency-dental-serv...


Comment16 C, June 10, 2022 at 6:35 a.m.:

Here at Rancho Cordova Roofing, we have over 15 years of experience and have put hundreds of new roofs and repaired them throughout the Sacramento-Roseville area. - https://www.ranchocordovaroofing.com


Comment17 Reyes, June 10, 2022 at 6:37 a.m.:

Let our professionals handle your roof installation, repairs, and maintenance. We can fix all sorts of problems with your roof. - https://www.idahofallsroofers.com


Comment18 Reyes, June 10, 2022 at 6:37 a.m.:

Let our professionals handle your roof installation, repairs, and maintenance. We can fix all sorts of problems with your roof. - https://www.idahofallsroofers.com


Comment19 marbrom, June 29, 2022 at 10:19 a.m.:

This tips contained therein will be really advantageous to my friend and colleague who is a cognitive psych major. Thanks a million!


Comment20 john, June 29, 2022 at 10:22 a.m.:

i have watched it twice already as i am a <a href="http://www.martinabromkova.com/">portrait photographer prague</a> Thanks a million!


Comment21 mar brom, June 29, 2022 at 11:13 a.m.:

Terrific insight into cognitive psychology!


Comment22 Joe, June 29, 2022 at 11:17 a.m.:

Great


Comment23 Jim, June 29, 2022 at 11:21 a.m.:

Excellent stuff


Comment24 Kate Sharma, July 1, 2022 at 1:14 p.m.:

This is new learning to me. Thanks for the information. https://cincinnati-seo.com/


Comment25 Allie Rice, July 5, 2022 at 5:07 p.m.:

I have learned about a lot of efficient tips and helpful insights from this video. I think I would like to know more about the topic.

https://sonnysdiamonds.com/


Comment26 finish room, August 5, 2022 at 2:02 a.m.:

Oops. My browser does not support the playback. I'll be back to watch it after installing adobe flash player. Regards!


Comment27 finish room, August 5, 2022 at 2:03 a.m.:

Oops. My browser does not support the playback. I'll be back to watch it after installing adobe flash player. Best Regards from all of us here at https://www.drywallarlington.com/ !


Comment28 Jennifer Hinckley, January 20, 2023 at 4:22 p.m.:

nice post. Thank you for posting something like this https://10starshomes.com/


Comment29 Breana, January 20, 2023 at 7:13 p.m.:

Glad to visit this site. https://www.davidbfisherhypnotherapy....


Comment30 Kael, January 20, 2023 at 7:15 p.m.:

Awesome post you shared here. https://www.northalpestcontrol.com/


Comment31 Miko, February 16, 2023 at 12:51 a.m.:

Thanks, Prof! https://www.sandyspringsfencepros.com/ admired your dedication to teach each one of us!


Comment32 Harry, March 8, 2023 at 9:32 p.m.:

Thank you so much. At last, I found an article which I am looking for a long time. I hope that it will help me too. https://10starshomes.com/tampa-proper...


Comment33 Marla, March 21, 2023 at 6:39 a.m.:

Can i share your lecture at https://www.portlandexcavationpros.com/ ? This is very interesting stuff to talk about.


Comment34 Terrie, March 28, 2023 at 8:36 p.m.:

Really nice article and helpful to me

https://10starshomes.com/saint-peters...


Comment35 Kayla, May 30, 2023 at 10:13 p.m.:

Absolutely great post here. It has a lot of key elements that truly makes it work.

https://10starshomes.com/alturas-flor...


Comment36 Jenny, June 1, 2023 at 3:14 a.m.:

Where else can i play the video? https://www.friscoconcretepros.com/ can't access it.

Write your own review or comment:

make sure you have javascript enabled or clear this field: