event thumbnail image
NIPS '07 Workshop on Music, Brain and Cognition
Pascal

Measuring and Modeling Musical Expression

author: Douglas Eck, Department of Computer Science, University of Leipzig

Description

Expressive timing and dynamics are an important part of musical meaning. For those skeptical of this claim I will play some examples of music with and without expressive timing and dynamics. I will then provide an overview of previous approaches to measuring and modeling musical expression in different contexts. One relatively unexplored task is that of analyzing music for which no musical score is available. I will describe why this is a different problem than score following and will argue for the importance of score-free models in working with improvisation and related tasks. I will provide some preliminary results employing a correlation-based model (Autocorrelation Phase Matrix; APM) to infer metrical trees in unscored music. Expressive timing and dynamics can then be measured with respect to these trees.

A note for the audience:
The spirit of NIPS workshops is to bring new and perhaps even half-baked ideas to the table. In that spirit, my hope is that my talk is derailed into a discussion about measuring and modeling expressive timing and dynamics in unscored streams of MIDI or audio.

You might be experiencing some problems with Your Video player.
Slides
0:00 Measuring & Modeling Musical Expression
2:25 Overview
2:34 Note-level measures (MIDI)
3:35 Example: Chopin Etude Opus 10 No 3 - 1
3:56 Example: Chopin Etude Opus 10 No 3 - 2
4:15 - Questions
11:51 What can we measure? - 1
12:55 What can we measure? - 2
14:01 Timing versus expressive dynamics
16:18 KTH model - 1
17:47 KTH model - 2
18:33 KTH model - 3
19:19 Widmer et al. performance model - 1
20:39 Widmer et al. performance model - 2
21:43 Music Plus One (C. Raphael) - 1
22:56 Music Plus One (C. Raphael) - 2
23:18 Graphical model for “Play” component
23:38 Inference and generation in “Play” component
23:50 KCCA (Dorard, Hardoon & Shawe-Taylor) - 1
24:03 KCCA (Dorard, Hardoon & Shawe-Taylor) - 2
24:06 Summary
25:11 - Questions
26:48 Focus: Musical meter
29:27 Finding beat and meter
29:50 Metrical interpretation
30:33 Expressive performance dynamics
31:12 Modest example
35:01 Collecting performance stats for the piano
35:30 Hand-specific statistics for piano
35:40 - Questions

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment: