Deep Natural Language Understanding

author: Kyunghyun Cho, Courant Institute of Mathematical Sciences, New York University
published: Aug. 23, 2016,   recorded: August 2016,   views: 1672
Categories

Slides

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.
  Delicious Bibliography

Description

In this lecture, I start with a claim that natural language understanding can largely be approached as building a better language model and explain three widely-adopted approaches to language modelling. They are n-gram language modelling, feedforward neural language modelling and recurrent language modelling. As I develop from the traditional n-gram language model toward recurrent language model, I discuss the concepts of data sparsity and generalization via continuous space representations. I then continue on to the recent development of a novel paradigm in machine translation based on recurrent language modelling, often called neural machine translation. The lecture concludes with three new opportunities in natural language processing/understanding made possible by the introduction of continuous space representations in deep neural networks.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 Krishna, December 12, 2016 at 10:35 a.m.:

Very nice...


Comment2 sarah, May 20, 2017 at 3:33 a.m.:

Thank you for your presentation! I am studying translation and interpreting but unfortunately, I have not been very good at understanding all the principles that you have written. I hope there might be a way that I can understand them. If any of you know how to help me with it, it could be very helpful for me to give you some input from my own standpoint of view as a translator/interpreter (; Good luck on your work!

Write your own review or comment:

make sure you have javascript enabled or clear this field: