Deep Learning

author: Ruslan Salakhutdinov, Department of Statistical Sciences, University of Toronto
published: Oct. 9, 2014,   recorded: August 2014,   views: 74791


Related Open Educational Resources

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.

 Watch videos:   (click on thumbnail to launch)

Watch Part 1
Part 1 1:20:02
Watch Part 2
Part 2 1:11:03


Building intelligent systems that are capable of extracting high-level representations from high-dimensional sensory data lies at the core of solving many AI related tasks, including visual object or pattern recognition, speech perception, and language understanding. Theoretical and biological arguments strongly suggest that building such systems requires deep architectures that involve many layers of nonlinear processing. Many existing learning algorithms use shallow architectures, including neural networks with only one hidden layer, support vector machines, kernel logistic regression, and many others. The internal representations learned by such systems are necessarily simple and are incapable of extracting some types of complex structure from high-dimensional input. In the past few years, researchers across many different communities, from applied statistics to engineering, computer science and neuroscience, have proposed several deep (hierarchical) models that are capable of extracting useful, high-level structured representations. An important property of these models is that they can extract complex statistical dependencies from high-dimensional sensory input and efficiently learn high-level representations by re-using and combining intermediate concepts, allowing these models to generalize well across a wide variety of tasks. The learned high-level representations have been shown to give state-of-the-art results in many challenging learning problems, where data patterns often exhibit a high degree of variations, and have been successfully applied in a wide variety of application domains, including visual object recognition, information retrieval, natural language processing, and speech perception. A few notable examples of such models include Deep Belief Networks, Deep Boltzmann Machines, Deep Autoencoders, and sparse coding-based methods.

See Also:

Download slides icon Download slides: kdd2014_salakhutdinov_deep_learning.pdf (53.7┬áMB)

Help icon Streaming Video Help

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 Gustavo Arroyo Figueroa, November 10, 2015 at 1:19 a.m.:

Power systems are complex structure that require deep (hierarchical) models that are capable of extracting useful, high-level structured representations, for many applications such DSS, diagnosis and prediction systems. I am interested in using Deep Learning for model representation on processes real database. I would like to know your opinion. Intelligent systems are fundamental about the implementation of smart grid.

Comment2 Jayce, February 14, 2019 at 11:21 a.m.:

check this blog out! <a href=""></a>

Comment3 Yura, April 3, 2021 at 9:10 p.m.:

This lecture is very interesting, it helped me a lot with my research here

Comment4 Sophia Charlotte, October 6, 2021 at 11:25 a.m.:

The intelligence of computer science and technologies is increasing day by day. Machine learning education evolution is included in the university and academics. Learners also get the advantage of Machine learning and I also learned the SPSS Statistics at the stage of @ and this is capable of providing the high-level of SPSS writing.

Comment5 Lina, November 17, 2023 at 6:37 a.m.:

Thank you for posting; this is essential data.

Write your own review or comment:

make sure you have javascript enabled or clear this field: