Modeling Natural Sounds with Modulation Cascade Processes

author:Richard Turner, Gatsby Computational Neuroscience Unit, London's Global University
published: Feb. 1, 2008,   recorded: December 2007,   views: 96
You might be experiencing some problems with Your Video player.

Slides

Slides
0:00 Probabilistic Amplitude Demodulation
0:16 Motivation - 1
0:20 Motivation - 2
0:26 Motivation - 3
0:34 Motivation - 4
0:34 Motivation - 5
0:41 Motivation - 6
0:41 Motivation - 7
1:13 Motivation - 8
1:20 Motivation - 9
1:36 Motivation: Traditional AM - 1
1:40 Motivation: Traditional AM - 2
1:45 Motivation: Traditional AM - 3
2:04 Motivation: Demodulate the Modulator - 1
2:07 Motivation: Demodulate the Modulator - 2
2:10 Motivation: Demodulate the Modulator - 3
2:11 Motivation: Demodulate the Modulator - 4
2:16 Motivation: Demodulation Cascade
2:44 Traditional Demodulation Algorithms: Analytic Signal - 1
2:46 Motivation: Demodulation Cascade
2:56 Traditional Demodulation Algorithms: Analytic Signal - 1
3:22 Traditional Demodulation Algorithms: Analytic Signal - 2
3:23 Traditional Demodulation Algorithms: Analytic Signal - 3
3:38 Traditional Demodulation Algorithms: Square and Lowpass - 1
4:26 Traditional Demodulation Algorithms: Square and Lowpass - 2
4:27 Traditional Demodulation Algorithms: Square and Lowpass - 3
4:28 Traditional Demodulation Algorithms Are not Sufficient
4:40 Advantages of the Probabilistic Approach
5:27 A Simple Generative Model for AM - 1
6:48 A Simple Generative Model for AM - 2
6:52 A Simple Generative Model for AM - 3
7:09 A Simple Generative Model for AM - 4
7:18 Learning Algorithms - 1
7:30 Learning Algorithms - 2
7:30 Learning Algorithms - 3
7:31 Learning Algorithms - 4
7:31 Learning Algorithms: Cheap and Cheerful
8:00 Learning Algorithms: Slow and Bayesian
8:13 Results: Vanilla Probabilistic Amplitude Demodulation (PAD)
8:39 Results: PAD Tuning Parameters for Phonemes - 1
8:55 Results: PAD Tuning Parameters for Phonemes - 2
8:56 Results: PAD Tuning Parameters for Phonemes - 3
9:09 Results: PAD Tuning Parameters for Pitch - 1
9:21 Results: PAD Tuning Parameters for Pitch - 2
9:22 Results: PAD Tuning Parameters for Pitch - 3
9:23 New Model: Demodulation Cascade
10:05 Results: Demodulation Cascade - 1
10:08 Results: Demodulation Cascade - 2
10:10 Mode: Sentences
10:24 Mean and Error-Bars: Hamiltonian MCMC
10:31 Mode: Phonemes
10:32 Error-Bars: Hamiltonian MCMC - 1
10:33 Mode: Cascade
10:33 Error-Bars: Hamiltonian MCMC - 2
10:34 Mode: Cascade
10:35 Error-Bars: Hamiltonian MCMC - 2
10:47 Part 2: Extension
11:03 - Questions
11:33 Part 2: Extension
11:33 Modeling the Fine Temporal Structure - 1
11:35 Modeling the Fine Temporal Structure - 2
11:51 Modeling the Fine Temporal Structure - 3
11:52 Modeling the Fine Temporal Structure - 4
11:53 Modeling the Fine Temporal Structure - 5
11:56 Modeling the Fine Temporal Structure - 6
12:13 Frequency Modulation and Instantaneous Frequency - 1
12:30 Frequency Modulation and Instantaneous Frequency - 2
12:44 Frequency Modulation and Instantaneous Frequency - 3
12:56 Frequency Modulation and Instantaneous Frequency - 4
13:14 Proof of Concept - 1
13:40 Proof of Concept - 2
13:54 Proof of Concept - 3
13:55 Proof of Concept - 2
13:56 Proof of Concept - 3
13:56 Proof of Concept - 2
13:57 Proof of Concept - 3
14:04 Proof of Concept - 4
14:06 Proof of Concept - 3
14:07 Proof of Concept - 4
14:08 Proof of Concept - 3
14:08 - Questions
15:30 Probabilistic Short Time Fourier Transform - 1
18:36 Generative Model for Natural Sounds
20:20 Inference and Learning
21:20 Generative Model for Natural Sounds
21:33 Inference and Learning
21:37 A Typical Sample
23:17 Filling in Missing Data
24:32 - Questions

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.

Description

Auditory scene analysis is extremely challenging. One approach, perhaps that adopted by the brain, is to shape useful representations of sounds on prior knowledge about their statistical structure. For example, sounds with harmonic sections are common and so time-frequency representations are efficient. Most current representations concentrate on the shorter components. Here, we propose representations for structures on longer time-scales, like the phonemes and sentences of speech. We decompose a sound into a product of processes, each with its own characteristic time-scale. This demodulation cascade relates to classical amplitude demodulation, but traditional algorithms fail to realise the representation fully. A new approach, probabilistic amplitude demodulation, is shown to out-perform the established methods, and to easily extend to representation of a full demodulation cascade.

Link this page  

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: