Large-Scale Markov Decision Problems with KL Control Cost and its Application to Crowdsourcing

We study average and total cost Markov decision problems with large state spaces. Since the computational and statistical costs of finding the optimal policy scale with the size of the state space, we