A tutorial on Deep Learning

author: Geoffrey E. Hinton, Department of Computer Science, University of Toronto
published: Sept. 15, 2009, recorded: July 2009, views: 228777

Related Open Educational Resources

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Lecture popularity: You need to login to cast your vote.

Watch videos: (click on thumbnail to launch)

Part 1 1:34:54

!NOW PLAYING

Part 2 1:31:54

!NOW PLAYING

Description

Complex probabilistic models of unlabeled data can be created by combining simpler models. Mixture models are obtained by averaging the densities of simpler models and "products of experts" are obtained by multiplying the densities together and renormalizing. A far more powerful type of combination is to form a "composition of experts" by treating the values of the latent variables of one model as the data for learning the next model. The first half of the tutorial will show how deep belief nets -- directed generative models with many layers of hidden variables -- can be learned one layer at a time by composing simple, undirected, product of expert models that only have one hidden layer. It will also explain why composing directed models does not work. Deep belief nets are trained as generative models on large, unlabeled datasets, but once multiple layers of features have been created by unsupervised learning, they can be fine-tuned to give excellent discrimination on small, labeled datasets. The second half of the tutorial will describe applications of deep belief nets to several tasks including object recognition, non-linear dimensionality reduction, document retrieval, and the interpretation of medical images. It will also show how the learning procedure for deep belief nets can be extended to high-dimensional time series and hierarchies of Conditional Random Fields.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

1 Derrick Li, September 15, 2013 at 8:48 a.m.:

It is very good!But this lecture is difficult for me !

2 omar khalid, September 21, 2015 at 2:15 p.m.:

I m looking forward to watching more from u?

3 Peter, May 15, 2017 at 4:53 a.m.:

Old but still has relevant content

4 Jordan, November 23, 2019 at 8:04 p.m.:

Thanks for the information on this. I really enjoy the write-up.

Here are the quickest ways to make Windows 10 dish out helpful information when something on the desktop how to get help in windows 10 leaves you stumped. n each case, Windows fetches help, either by going online, fetching built-in instructions, or leading you to a tutorial built into Windows 10.

https://howtogethelpinwindows.com/

5 Diya, November 30, 2019 at 5:57 a.m.:

I enjoyed this deep learning concept.
https://freecodesmarket.com/

6 Asha, January 26, 2020 at 10:53 p.m.:

Getting help with file explorer in Windows 10 Configuring Windows 10 File Explorer to Open with This PC View. Step 1: First, open a new File Explorer window and click the View tab from the ribbon toolbar. Step 2: Now, click on Options, listed by default on the far right side. Step 3: In the Folder Options window, reach to the General tab and then find the drop-down box labeled Open File Explorer too. Click the drop-down How to Get Help in Windows 10 - https://windowscall.com/how-to-get-he...

7 najwayaminah, March 3, 2020 at 1:21 p.m.:

Deep learning is a branch of science which is working for the Artificial intelligence and in other fields as well. Data mining and deep learning is so vast field and in which https://writingservice.ae/thesis-help also works to provide help for students.

8 Goodluckastro, August 11, 2020 at 11:51 a.m.:

Good contenbt....

9 Sunny, August 11, 2020 at 11:52 a.m.:

Good contenbt...
https://goodluckastroservices.com/

10 Leo, October 9, 2020 at 3:25 p.m.:

Deep learning is an AI function that mimics the workings of the human brain in processing data for use in detecting objects, recognizing speech, translating languages, and making decisions. https://www.unmannedsas.com/

11 deepthought, December 14, 2020 at 5:21 p.m.:

flash player site, as of 12/2020 not much supports viewing the videos...so sad...I do hope there is an upgrade path in process.

12 Read online stories and poems, December 27, 2020 at 2:37 p.m.:

In need of writing services?

Are you searching for alpha editors? Maybe you are looking for that last minute touch to make your literary pieces stand out?

Do you want to start and own a blog? Maybe you are busy, or feel incapable of handling all the content writing and creation?

Well, ZenPens has you covered, with over 500 registered writers from all parts of the world, we are fully equipped and capable of taking care of your writing needs.

Our writers are well-trained, experienced and capable.

Content writing
Scriptwriting
Ghost writing
Editing
Proof reading
Copy writing
Manuscript evaluation

We are the writing platform you can rely on.

ZenPens Writing Services ... your surest bet at excellence.
[url]https://www.thezenpens.com/category/flash-fiction-stories/[url]

13 Ben, December 27, 2020 at 2:38 p.m.:

ZenPens is an online publishing platform where you can read, write and publish short stories, poems, articles and novels. Just register as a writer and start publishing or if you are a reader, read on!

https://www.thezenpens.com/category/s...

14 Brian, February 6, 2021 at 8:05 a.m.:

Pretty good website. If you need foundation repair contractors in Kansas city, visit here https://www.foundationrepairkansascit...

15 Ed, February 7, 2021 at 3:32 p.m.:

I really love to read such a nice article. https://www.miamifences.org/

16 Kim, February 9, 2021 at 3:14 p.m.:

Nice knowledge gaining article.
https://www.fencecompanybirminghamal....

17 Beckman, February 19, 2021 at 10:34 a.m.:

Informational content. Beckman offers automated liquid handling solutions for research areas such as drug discovery, biopharma, agriculture, synthetic biology, forensics and more. For more information - https://www.beckman.com/liquid-handlers

18 Kent Weterson, February 23, 2021 at 6:29 p.m.:

Great post!very interesting! keep sharing! thanks! https://cleaningcairns.com.au/

19 harrisonlee93, March 3, 2021 at 10:33 a.m.:

Well, the thing about solving a problem is that, one should consider the <a href="https://www.dmvracquetstringing.com/squash-racquet-restringing-in-dmv/">racquet stringing</a> rule, where you analyze first the situation before you pick up a stick and strategize a goal. If you try to look at it closer, you are able to gain more wisdom through this theory.

20 harrisonlee93, March 3, 2021 at 10:35 a.m.:

Well, the thing about solving a problem is that one should consider the rule, where you analyze first the situation before you pick up a stick and strategize a goal. If you try to look at it closer, you are able to gain more wisdom through this theory.

DMV Racquet Stringing
(202) 883-7985
https://www.dmvracquetstringing.com/s...

21 Elton, March 6, 2021 at 4:03 p.m.:

Great and informational tutorial. Glad to found this website.
If you are in need for foundation repair services in Raleigh NC and surrounding areas visit this website.

Foundation Repair Raleigh NC
https://www.foundationrepairraleighnc...
919-328-3477
501 Shelly Ridge Ln Ste 305 Raleigh, NC 27609

22 Rachel, March 19, 2021 at 8:34 a.m.:

Very well explained tutorial. I am really impressed. If you are looking for foundation repair services in St Petersburg, FL visit here:

https://www.fencecompaniesstpetersbur...
7279145101

23 Colleen, March 23, 2021 at 11:40 a.m.:

This is amazing, Thanks!

https://www.acrepairarlingtonva.com/

24 JillRynda, March 29, 2021 at 9:40 p.m.:

Very nicely done information onthis website! I sincerely thank you.

https://southwestmntreeservice.com/

25 Lawrence, April 3, 2021 at 2:41 p.m.:

Great video lecture. https://www.fencecompanyspringfieldil...

26 Jim Fran, April 4, 2021 at 8:44 p.m.:

Thank you after driving a tow truck in Red Deer https://www.towtruckreddeer.ca/ my whole life I need some deeper learning, to exercise my mind.

27 Larry, April 5, 2021 at 4:43 p.m.:

Informational video lecture. Keep up the good work.
https://www.treeremovalraleighpro.com/

28 Ray, April 16, 2021 at 7:56 p.m.:

Glad to found such a great content. https://www.homeinspectionraleighnc.net/

Write your own review or comment:

Comment:
Name:
Email address:
URL:

make sure you have javascript enabled or clear this field: