Information evolution of optimal learning
Description
It is widely accepted that learning is closely related to theories of optimisation and information. Indeed, there is no need to learn if there is nothing to optimise; if one possesses full information, then there is simply nothing new to learn. The paper considers learning as an optimisation problem with dynamical information constraints. Unlike the standard approach in the optimal control theory, where the solutions are given by the Hamilton–Jacobi–Bellman equation for Markov time evolution, the optimal solution is presented as the system of canonical Euler equations defining the optimal information–utility trajectory in the conjugate space. The optimal trajectory is parameterised by theinformation–utility constraints, which are illustrated on examples for finite and infinite–dimensional cases.
| Slides | |
| 0:00 | Information Evolution of Optimal Learning |
| 0:36 | Outline |
| 0:38 | Historic remarks (1) |
| 0:57 | Historic remarks (2) |
| 1:25 | Historic remarks (3) |
| 1:54 | Historic remarks (4) |
| 2:58 | Historic remarks (5) |
| 4:17 | Historic remarks (6) |
| 4:41 | Optimisation & information in learning (1) |
| 4:56 | Optimisation & information in learning (2) |
| 5:13 | Choice and optimisation (1) |
| 5:48 | Choice and optimisation (2) |
| 6:01 | Choice and optimisation (3) |
| 6:21 | Preference morphisms (1) |
| 6:48 | Preference morphisms (2) |
| 7:23 | Preliminaries (1) |
| 7:37 | Preliminaries (2) |
| 8:43 | Preliminaries (3) |
| 9:09 | Probability triangle (simplex) |
| 10:26 | Convex functions (1) |
| 11:16 | Convex functions (2) |
| 12:04 | Convex functions (3) |
| 12:16 | Convex functions (4) |
| 12:24 | Convex functions (5) |
| 12:55 | Support and distance of a convex body (1) |
| 13:22 | Support and distance of a convex body (2) |
| 13:59 | Support and distance of a convex body (3) |
| 14:25 | Support and distance of a convex body (4) |
| 14:42 | Functions of polar sets (1) |
| 15:02 | Functions of polar sets (2) |
| 15:19 | Functions of polar sets (3) |
| 15:44 | Necessary conditions of extrema (1) |
| 16:53 | Necessary conditions of extrema (2) |
| 17:28 | Necessary conditions of extrema (3) |
| 18:17 | Why ‘extrema’? |
| 18:47 | Characterisation of the solution at ∞ (1) |
| 19:31 | Characterisation of the solution at ∞ (2) |
| 19:51 | Characterisation of the solution at ∞ (3) |
| 20:27 | Characterisation of the solution at 0 (1) |
| 21:01 | Characterisation of the solution at 0 (2) |
| 21:10 | Characterisation of the solution at 0 (3) |
| 22:21 | Generalised characteristic potentials (1) |
| 22:50 | Generalised characteristic potentials (2) |
| 22:59 | Generalised characteristic potentials (3) |
| 23:03 | Generalised characteristic potentials (4) |
| 23:27 | Examples (1) |
| 23:54 | Examples (2) |
| 24:26 | Examples (3) |
| 24:48 | Expected utility |
| 25:30 | Information |
| 25:43 | Dynamics (1) |
| 26:10 | Dynamics (2) |
| 26:27 | Dynamics (3) |
| 26:46 | Dynamics (4) |
| 27:03 | Dynamics (5) |
| 27:05 | Expected utility |
| 27:48 | Information divergence |
| 28:06 | Information brachistochrone |
| 28:33 | Why exponential and logarithmic functions? (1) |
| 29:14 | Why exponential and logarithmic functions? (2) |
| 30:05 | Why exponential and logarithmic functions? (3) |
| 30:18 | Probability matching (1) |
| 31:09 | Probability matching (2) |
| 31:22 | The inverted–U effect (1) |
| 32:12 | The inverted–U effect (2) |
| 32:33 | The inverted–U effect (3) |
| 32:46 | Optimal action selection (1) |
| 33:09 | Optimal action selection (2) |
| 33:26 | Optimal action selection (3) |
| 33:36 | Learning in neural cell assemblies |
| 33:47 | Questions? |
| 34:51 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




