## Stochastic Control as a Non-Equilibrium Statistical Physics: Gauge Invariant Bellman Equation

published: Oct. 16, 2012, recorded: September 2012, views: 238

# Slides

# Related content

# Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our**to describe your request and upload the data.**

__ticket system__*Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.*

# Description

In Stochastic Control (SC) one minimizes average cost-to-go, consisting of the cost-of-control (amount of efforts), the cost-of-space (where one wants the system to be) and the target cost (where one wants the system to finish), for the system obeying a forced and controlled Langevien dynamics. We generalize the SC problem adding to the cost-to-go a term accounting for the cost-of dynamics, characterized by a vector potential. We provide variational derivation of the generalized gauge-invariant Bellman-Hamilton-Jacobi equation for the optimal average cost-to-go, where the control is expressed in terms of current and density functionals, and discuss examples, e.g.ergodic control of particle-on-a-circle illustrating non-equilibrium space-time complexity over current/flux. The talk is based on a joint work with M. Chertkov, J. Bierkens and H.J. Kappen.

# Link this page

Would you like to put a link to this lecture on your homepage?

Go ahead! Copy the HTML snippet !

## Write your own review or comment: