What's going on? Discovering Spatio-Temporal Dependencies in Dynamic Scenes

author: Daniel Küttel, Department of Information Technology and Electrical Engineering, ETH Zurich
published: July 19, 2010,   recorded: June 2010,   views: 8075


Related Open Educational Resources

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.


We present two novel methods to automatically learn spatio-temporal dependencies of moving agents in complex dynamic scenes. They allow to discover temporal rules, such as the right of way between different lanes or typical traffic light sequences. To extract them, sequences of activities need to be learned. While the first method extracts rules based on a learned topic model, the second model called DDP-HMM jointly learns co-occurring activities and their time dependencies. To this end we employ Dependent Dirichlet Processes to learn an arbitrary number of infinite Hidden Markov Models. In contrast to previous work, we build on state-of-the-art topic models that allow to automatically infer all parameters such as the optimal number of HMMs necessary to explain the rules governing a scene. The models are trained offline by Gibbs Sampling using unlabeled training data.

See Also:

Download slides icon Download slides: cvpr2010_kuettel_wgo_01.v1.pdf (2.6 MB)

Download article icon Download article: cvpr2010_kuettel_wgo_01.pdf (2.7 MB)

Help icon Streaming Video Help

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 Parag Mital, June 4, 2011 at 2:17 a.m.:

Very clear and interesting talk!

Write your own review or comment:

make sure you have javascript enabled or clear this field: