published: Feb. 14, 2008, recorded: February 2008, views: 3928
Report a problem or upload filesIf you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Two important issues in multimodal system design, is the selection and mix of input and output modalities and the exploitation of the synergies between the modalities in order to maximize the usability of the system. In this talk, we propose two new objective metrics, relative modality efficiency and multimodal synergy, that can provide valuable information and identify usability problems during the evaluation of multimodal systems. Relative modality efficiency (when compared with modality usage) can identify suboptimal use of modalities due to poor interface design or information asymmetries. Multimodal synergy measures the added value from efficiently combining multiple input modalities, and can be used as a single measure of the quality of modality fusion and fission in a multimodal system. The proposed metrics are used to evaluate a multimodal system that combines pen and speech input, and are compared with traditional evaluation metrics. The results provide much insight into multimodal interface usability issues, and demonstrate how multimodal systems should adapt to maximize modalities synergy resulting in efficient, natural, and intelligent multimodal interfaces.
Link this pageWould you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !