Space-indexed Dynamic Programming: Learning to Follow Trajectories

We consider the task of learning to accurately follow a trajectory in a vehicle such as a car or helicopter. A number of dynamic programming algorithms such as Differential Dynamic Programming (DDP) a