Modeling Natural Sounds with Modulation Cascade Processes
Description
Auditory scene analysis is extremely challenging. One approach, perhaps that adopted by the brain, is to shape useful representations of sounds on prior knowledge about their statistical structure. For example, sounds with harmonic sections are common and so time-frequency representations are efficient. Most current representations concentrate on the shorter components. Here, we propose representations for structures on longer time-scales, like the phonemes and sentences of speech. We decompose a sound into a product of processes, each with its own characteristic time-scale. This demodulation cascade relates to classical amplitude demodulation, but traditional algorithms fail to realise the representation fully. A
new approach, probabilistic amplitude demodulation, is shown to out-perform the established methods, and to easily extend to representation of a full demodulation cascade.
| Slides | |
| 0:00 | Probabilistic Amplitude Demodulation |
| 0:16 | Motivation - 1 |
| 0:20 | Motivation - 2 |
| 0:26 | Motivation - 3 |
| 0:34 | Motivation - 4 |
| 0:34 | Motivation - 5 |
| 0:41 | Motivation - 6 |
| 0:41 | Motivation - 7 |
| 1:13 | Motivation - 8 |
| 1:20 | Motivation - 9 |
| 1:36 | Motivation: Traditional AM - 1 |
| 1:40 | Motivation: Traditional AM - 2 |
| 1:45 | Motivation: Traditional AM - 3 |
| 2:04 | Motivation: Demodulate the Modulator - 1 |
| 2:07 | Motivation: Demodulate the Modulator - 2 |
| 2:10 | Motivation: Demodulate the Modulator - 3 |
| 2:11 | Motivation: Demodulate the Modulator - 4 |
| 2:16 | Motivation: Demodulation Cascade |
| 2:44 | Traditional Demodulation Algorithms: Analytic Signal - 1 |
| 2:46 | Motivation: Demodulation Cascade |
| 2:56 | Traditional Demodulation Algorithms: Analytic Signal - 1 |
| 3:22 | Traditional Demodulation Algorithms: Analytic Signal - 2 |
| 3:23 | Traditional Demodulation Algorithms: Analytic Signal - 3 |
| 3:38 | Traditional Demodulation Algorithms: Square and Lowpass - 1 |
| 4:26 | Traditional Demodulation Algorithms: Square and Lowpass - 2 |
| 4:27 | Traditional Demodulation Algorithms: Square and Lowpass - 3 |
| 4:28 | Traditional Demodulation Algorithms Are not Sufficient |
| 4:40 | Advantages of the Probabilistic Approach |
| 5:27 | A Simple Generative Model for AM - 1 |
| 6:48 | A Simple Generative Model for AM - 2 |
| 6:52 | A Simple Generative Model for AM - 3 |
| 7:09 | A Simple Generative Model for AM - 4 |
| 7:18 | Learning Algorithms - 1 |
| 7:30 | Learning Algorithms - 2 |
| 7:30 | Learning Algorithms - 3 |
| 7:31 | Learning Algorithms - 4 |
| 7:31 | Learning Algorithms: Cheap and Cheerful |
| 8:00 | Learning Algorithms: Slow and Bayesian |
| 8:13 | Results: Vanilla Probabilistic Amplitude Demodulation (PAD) |
| 8:39 | Results: PAD Tuning Parameters for Phonemes - 1 |
| 8:55 | Results: PAD Tuning Parameters for Phonemes - 2 |
| 8:56 | Results: PAD Tuning Parameters for Phonemes - 3 |
| 9:09 | Results: PAD Tuning Parameters for Pitch - 1 |
| 9:21 | Results: PAD Tuning Parameters for Pitch - 2 |
| 9:22 | Results: PAD Tuning Parameters for Pitch - 3 |
| 9:23 | New Model: Demodulation Cascade |
| 10:05 | Results: Demodulation Cascade - 1 |
| 10:08 | Results: Demodulation Cascade - 2 |
| 10:10 | Mode: Sentences |
| 10:24 | Mean and Error-Bars: Hamiltonian MCMC |
| 10:31 | Mode: Phonemes |
| 10:32 | Error-Bars: Hamiltonian MCMC - 1 |
| 10:33 | Mode: Cascade |
| 10:33 | Error-Bars: Hamiltonian MCMC - 2 |
| 10:34 | Mode: Cascade |
| 10:35 | Error-Bars: Hamiltonian MCMC - 2 |
| 10:47 | Part 2: Extension |
| 11:03 | - Questions |
| 11:33 | Part 2: Extension |
| 11:33 | Modeling the Fine Temporal Structure - 1 |
| 11:35 | Modeling the Fine Temporal Structure - 2 |
| 11:51 | Modeling the Fine Temporal Structure - 3 |
| 11:52 | Modeling the Fine Temporal Structure - 4 |
| 11:53 | Modeling the Fine Temporal Structure - 5 |
| 11:56 | Modeling the Fine Temporal Structure - 6 |
| 12:13 | Frequency Modulation and Instantaneous Frequency - 1 |
| 12:30 | Frequency Modulation and Instantaneous Frequency - 2 |
| 12:44 | Frequency Modulation and Instantaneous Frequency - 3 |
| 12:56 | Frequency Modulation and Instantaneous Frequency - 4 |
| 13:14 | Proof of Concept - 1 |
| 13:40 | Proof of Concept - 2 |
| 13:54 | Proof of Concept - 3 |
| 13:55 | Proof of Concept - 2 |
| 13:56 | Proof of Concept - 3 |
| 13:56 | Proof of Concept - 2 |
| 13:57 | Proof of Concept - 3 |
| 14:04 | Proof of Concept - 4 |
| 14:06 | Proof of Concept - 3 |
| 14:07 | Proof of Concept - 4 |
| 14:08 | Proof of Concept - 3 |
| 14:08 | - Questions |
| 15:30 | Probabilistic Short Time Fourier Transform - 1 |
| 18:36 | Generative Model for Natural Sounds |
| 20:20 | Inference and Learning |
| 21:20 | Generative Model for Natural Sounds |
| 21:33 | Inference and Learning |
| 21:37 | A Typical Sample |
| 23:17 | Filling in Missing Data |
| 24:32 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !



