![Lagrange Dual Decomposition for Finite Horizon Markov Decision Processes thumbnail](https://apiminio.videolectures.net/vln/lectures/16676/1/en/thumbnail.jpg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=masoud%2F20241217%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20241217T014735Z&X-Amz-Expires=604800&X-Amz-SignedHeaders=host&X-Amz-Signature=b270c269df82cfb522c9c83175b8bed2352542f3a31de4aa322794e64cc2a335)
en
0.25
0.5
0.75
1.25
1.5
1.75
2
Lagrange Dual Decomposition for Finite Horizon Markov Decision Processes
Published on Nov 30, 20113073 Views
Solving finite-horizon Markov Decision Processes with stationary policies is a computationally difficult problem. Our dynamic dual decomposition approach uses Lagrange duality to decouple this hard pr
Related categories
Chapter list
Dual Decomposition of Finite Horizon Markov Decision Processes00:00
Outline00:12
Problem Framework00:29
Markov Decision Processes - 100:30
Markov Decision Processes - 200:38
Markov Decision Processes - 300:41
Markov Decision Processes - 400:44
Markov Decision Processes - 501:23
Problem Framework01:40
Influence Diagrams02:17
Dual Decomposition - 103:05
Dual Decomposition - 203:06
Dual Decomposition - 303:51
Dual Decomposition - 404:17
Dual Objective05:05
Slave Problem05:31
Master Problem06:05
Algorithm Summary06:45
Resource Allocation07:16
Resource Allocation - An Example08:38
Experiments09:44
Comparisons09:46
Chain Problem10:06
Mountain Car10:20
Puddle World10:41
Results10:59
Summary & Future Work - 112:25
Summary & Future Work - 212:26