Measuring and Modeling Musical Expression
Description
Expressive timing and dynamics are an important part of musical meaning. For those skeptical of this claim I will play some examples of music with and without expressive timing and dynamics. I will then provide an overview of previous approaches to measuring and modeling musical expression in different contexts. One relatively unexplored task is that of analyzing music for which no musical score is available. I will describe why this is a different problem than score following and will argue for the importance of score-free models in working with improvisation and related tasks. I will provide some preliminary results employing a correlation-based model (Autocorrelation Phase Matrix; APM) to infer metrical trees in unscored music. Expressive timing and dynamics can then be measured with respect to these trees. A note for the audience:
The spirit of NIPS workshops is to bring new and perhaps even half-baked ideas to the table. In that spirit, my hope is that my talk is derailed into a discussion about measuring and modeling expressive timing and dynamics in unscored streams of MIDI or audio.
| Slides | |
| 0:00 | Measuring & Modeling Musical Expression |
| 2:25 | Overview |
| 2:34 | Note-level measures (MIDI) |
| 3:35 | Example: Chopin Etude Opus 10 No 3 - 1 |
| 3:56 | Example: Chopin Etude Opus 10 No 3 - 2 |
| 4:15 | - Questions |
| 11:51 | What can we measure? - 1 |
| 12:55 | What can we measure? - 2 |
| 14:01 | Timing versus expressive dynamics |
| 16:18 | KTH model - 1 |
| 17:47 | KTH model - 2 |
| 18:33 | KTH model - 3 |
| 19:19 | Widmer et al. performance model - 1 |
| 20:39 | Widmer et al. performance model - 2 |
| 21:43 | Music Plus One (C. Raphael) - 1 |
| 22:56 | Music Plus One (C. Raphael) - 2 |
| 23:18 | Graphical model for “Play” component |
| 23:38 | Inference and generation in “Play” component |
| 23:50 | KCCA (Dorard, Hardoon & Shawe-Taylor) - 1 |
| 24:03 | KCCA (Dorard, Hardoon & Shawe-Taylor) - 2 |
| 24:06 | Summary |
| 25:11 | - Questions |
| 26:48 | Focus: Musical meter |
| 29:27 | Finding beat and meter |
| 29:50 | Metrical interpretation |
| 30:33 | Expressive performance dynamics |
| 31:12 | Modest example |
| 35:01 | Collecting performance stats for the piano |
| 35:30 | Hand-specific statistics for piano |
| 35:40 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !





