Francisco S. Melo
search externally:   Google Scholar,   Springer,   CiteSeer,   Microsoft Academic Search,   Scirus ,   DBlife


I'm currently an Assistant Professor at the Department of Computer Science and Engineering of Instituto Superior Técnico and a Senior Researcher at INESC-ID, working with the Intelligent Agents and Synthetic Characters Group.

Prior to my current appointments at IST and INESC-ID, I was a short-term researcher at the Vision Lab, ISR and a Post-Doctoral Fellow at the Computer Science Department, Carnegie Mellon University, working with Prof. Manuela Veloso.

I completed my PhD on Electrical and Computer Engineering at Instituto Superior Técnico under the supervision of Prof. M. Isabel Ribeiro.

I am interested in the application of machine learning in the development of general intelligent autonomous agents capable of interacting with complex, possibly unknown environments. Concretely, my primary research interests are in general reinforcement learning both in single and multiagent systems and in the applications of this framework to real world problems, including robotic and sensor network applications. I am also particularly interested in developing computational models that may contribute to a better understanding of learning in biological systems.


flag Active Learning for Reward Estimation in Inverse Reinforcement Learning
as author at  Sessions,
flag An Analysis of Reinforcement Learning with Function Approximation
as author at  Reinforcement Learning,