Information evolution of optimal learning

author: Roman V. Belavkin, School of Computing Science, Middlesex University
published: Sept. 4, 2008,   recorded: May 2008,   views: 379
Categories
You might be experiencing some problems with Your Video player.

Slides

Slides
0:00 Information Evolution of Optimal Learning
0:36 Outline
0:38 Historic remarks (1)
0:57 Historic remarks (2)
1:25 Historic remarks (3)
1:54 Historic remarks (4)
2:58 Historic remarks (5)
4:17 Historic remarks (6)
4:41 Optimisation & information in learning (1)
4:56 Optimisation & information in learning (2)
5:13 Choice and optimisation (1)
5:48 Choice and optimisation (2)
6:01 Choice and optimisation (3)
6:21 Preference morphisms (1)
6:48 Preference morphisms (2)
7:23 Preliminaries (1)
7:37 Preliminaries (2)
8:43 Preliminaries (3)
9:09 Probability triangle (simplex)
10:26 Convex functions (1)
11:16 Convex functions (2)
12:04 Convex functions (3)
12:16 Convex functions (4)
12:24 Convex functions (5)
12:55 Support and distance of a convex body (1)
13:22 Support and distance of a convex body (2)
13:59 Support and distance of a convex body (3)
14:25 Support and distance of a convex body (4)
14:42 Functions of polar sets (1)
15:02 Functions of polar sets (2)
15:19 Functions of polar sets (3)
15:44 Necessary conditions of extrema (1)
16:53 Necessary conditions of extrema (2)
17:28 Necessary conditions of extrema (3)
18:17 Why ‘extrema’?
18:47 Characterisation of the solution at ∞ (1)
19:31 Characterisation of the solution at ∞ (2)
19:51 Characterisation of the solution at ∞ (3)
20:27 Characterisation of the solution at 0 (1)
21:01 Characterisation of the solution at 0 (2)
21:10 Characterisation of the solution at 0 (3)
22:21 Generalised characteristic potentials (1)
22:50 Generalised characteristic potentials (2)
22:59 Generalised characteristic potentials (3)
23:03 Generalised characteristic potentials (4)
23:27 Examples (1)
23:54 Examples (2)
24:26 Examples (3)
24:48 Expected utility
25:30 Information
25:43 Dynamics (1)
26:10 Dynamics (2)
26:27 Dynamics (3)
26:46 Dynamics (4)
27:03 Dynamics (5)
27:05 Expected utility
27:48 Information divergence
28:06 Information brachistochrone
28:33 Why exponential and logarithmic functions? (1)
29:14 Why exponential and logarithmic functions? (2)
30:05 Why exponential and logarithmic functions? (3)
30:18 Probability matching (1)
31:09 Probability matching (2)
31:22 The inverted–U effect (1)
32:12 The inverted–U effect (2)
32:33 The inverted–U effect (3)
32:46 Optimal action selection (1)
33:09 Optimal action selection (2)
33:26 Optimal action selection (3)
33:36 Learning in neural cell assemblies
33:47 Questions?
34:51 - Questions

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.
 
    Delicious Bibliography

Description

It is widely accepted that learning is closely related to theories of optimisation and information. Indeed, there is no need to learn if there is nothing to optimise; if one possesses full information, then there is simply nothing new to learn. The paper considers learning as an optimisation problem with dynamical information constraints. Unlike the standard approach in the optimal control theory, where the solutions are given by the Hamilton–Jacobi–Bellman equation for Markov time evolution, the optimal solution is presented as the system of canonical Euler equations defining the optimal information–utility trajectory in the conjugate space. The optimal trajectory is parameterised by theinformation–utility constraints, which are illustrated on examples for finite and infinite–dimensional cases.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: