event thumbnail image
Workshops

High-Level Actions

author: Stuart Russell, Department of Electrical Engineering and Computer Sciences, UC Berkeley, University of California
You might be experiencing some problems with Your Video player.
Slides
0:00 High-Level Actions
0:22 Outline (1)
0:50 Life: Play and win in 20,000,000,000,000* moves
4:30 Temporal abstraction in RL
9:58 Running example
11:02 RL and partial programs (1)
11:30 RL and partial programs (2)
15:46 Technical development (2)
16:22 Technical development (3)
17:02 Q-functions
19:30 Technical development (4)
19:46 Technical development (5)
21:14 Technical development (6)
22:58 Internal state (1)
25:14 Internal state (2)
28:34 Current directions
33:30 Abstract Lookahead
38:46 High-level actions
40:42 Semantics of HLAs (1)
42:24 Semantics of HLAs (2)
42:41 Downward refinement (1)
43:39 Downward refinement (2)
43:58 Downward refinement (3)
45:16 Angelic semantics for HLAs
49:38 Technical development (7)
54:10 Example – Warehouse World
55:01 Representing descriptions: NCSTRIPS
56:26 Preliminary Results
57:42 Intuitive Picture (1)
58:06 Intuitive Picture (2)
58:15 Intuitive Picture (3)
58:17 Intuitive Picture (4)
58:30 Intuitive Picture (5)
58:34 Intuitive Picture (7)
58:38 Intuitive Picture (8)
58:50 Preliminary Results
59:46 Intuitive Picture (9)
60:43 Where does it break?
63:08 - Questions

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: