event thumbnail image
NIPS '07 Workshop on Music, Brain and Cognition

Modeling Natural Sounds with Modulation Cascade Processes

author: Richard Turner, Gatsby Computational Neuroscience Unit, UCL

Description

Auditory scene analysis is extremely challenging. One approach, perhaps that adopted by the brain, is to shape useful representations of sounds on prior knowledge about their statistical structure. For example, sounds with harmonic sections are common and so time-frequency representations are efficient. Most current representations concentrate on the shorter components. Here, we propose representations for structures on longer time-scales, like the phonemes and sentences of speech. We decompose a sound into a product of processes, each with its own characteristic time-scale. This demodulation cascade relates to classical amplitude demodulation, but traditional algorithms fail to realise the representation fully. A new approach, probabilistic amplitude demodulation, is shown to out-perform the established methods, and to easily extend to representation of a full demodulation cascade.

You might be experiencing some problems with Your Video player.
Slides
0:00 Probabilistic Amplitude Demodulation
0:16 Motivation - 1
0:20 Motivation - 2
0:26 Motivation - 3
0:34 Motivation - 4
0:34 Motivation - 5
0:41 Motivation - 6
0:41 Motivation - 7
1:13 Motivation - 8
1:20 Motivation - 9
1:36 Motivation: Traditional AM - 1
1:40 Motivation: Traditional AM - 2
1:45 Motivation: Traditional AM - 3
2:04 Motivation: Demodulate the Modulator - 1
2:07 Motivation: Demodulate the Modulator - 2
2:10 Motivation: Demodulate the Modulator - 3
2:11 Motivation: Demodulate the Modulator - 4
2:16 Motivation: Demodulation Cascade
2:44 Traditional Demodulation Algorithms: Analytic Signal - 1
2:46 Motivation: Demodulation Cascade
2:56 Traditional Demodulation Algorithms: Analytic Signal - 1
3:22 Traditional Demodulation Algorithms: Analytic Signal - 2
3:23 Traditional Demodulation Algorithms: Analytic Signal - 3
3:38 Traditional Demodulation Algorithms: Square and Lowpass - 1
4:26 Traditional Demodulation Algorithms: Square and Lowpass - 2
4:27 Traditional Demodulation Algorithms: Square and Lowpass - 3
4:28 Traditional Demodulation Algorithms Are not Sufficient
4:40 Advantages of the Probabilistic Approach
5:27 A Simple Generative Model for AM - 1
6:48 A Simple Generative Model for AM - 2
6:52 A Simple Generative Model for AM - 3
7:09 A Simple Generative Model for AM - 4
7:18 Learning Algorithms - 1
7:30 Learning Algorithms - 2
7:30 Learning Algorithms - 3
7:31 Learning Algorithms - 4
7:31 Learning Algorithms: Cheap and Cheerful
8:00 Learning Algorithms: Slow and Bayesian
8:13 Results: Vanilla Probabilistic Amplitude Demodulation (PAD)
8:39 Results: PAD Tuning Parameters for Phonemes - 1
8:55 Results: PAD Tuning Parameters for Phonemes - 2
8:56 Results: PAD Tuning Parameters for Phonemes - 3
9:09 Results: PAD Tuning Parameters for Pitch - 1
9:21 Results: PAD Tuning Parameters for Pitch - 2
9:22 Results: PAD Tuning Parameters for Pitch - 3
9:23 New Model: Demodulation Cascade
10:05 Results: Demodulation Cascade - 1
10:08 Results: Demodulation Cascade - 2
10:10 Mode: Sentences
10:24 Mean and Error-Bars: Hamiltonian MCMC
10:31 Mode: Phonemes
10:32 Error-Bars: Hamiltonian MCMC - 1
10:33 Mode: Cascade
10:33 Error-Bars: Hamiltonian MCMC - 2
10:34 Mode: Cascade
10:35 Error-Bars: Hamiltonian MCMC - 2
10:47 Part 2: Extension
11:03 - Questions
11:33 Part 2: Extension
11:33 Modeling the Fine Temporal Structure - 1
11:35 Modeling the Fine Temporal Structure - 2
11:51 Modeling the Fine Temporal Structure - 3
11:52 Modeling the Fine Temporal Structure - 4
11:53 Modeling the Fine Temporal Structure - 5
11:56 Modeling the Fine Temporal Structure - 6
12:13 Frequency Modulation and Instantaneous Frequency - 1
12:30 Frequency Modulation and Instantaneous Frequency - 2
12:44 Frequency Modulation and Instantaneous Frequency - 3
12:56 Frequency Modulation and Instantaneous Frequency - 4
13:14 Proof of Concept - 1
13:40 Proof of Concept - 2
13:54 Proof of Concept - 3
13:55 Proof of Concept - 2
13:56 Proof of Concept - 3
13:56 Proof of Concept - 2
13:57 Proof of Concept - 3
14:04 Proof of Concept - 4
14:06 Proof of Concept - 3
14:07 Proof of Concept - 4
14:08 Proof of Concept - 3
14:08 - Questions
15:30 Probabilistic Short Time Fourier Transform - 1
18:36 Generative Model for Natural Sounds
20:20 Inference and Learning
21:20 Generative Model for Natural Sounds
21:33 Inference and Learning
21:37 A Typical Sample
23:17 Filling in Missing Data
24:32 - Questions

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment: