0.25
0.5
0.75
1.25
1.5
1.75
2
Multimodal Interfaces
Published on Feb 14, 20083934 Views
Two important issues in multimodal system design, is the selection and mix of input and output modalities and the exploitation of the synergies between the modalities in order to maximize the usabilit
Related categories
Chapter list
Multimodal Dialogue Interfaces00:00
Research Goals00:09
Speech: An interaction modality and more01:07
Idiosyncrasies of the speech modality02:17
Design principles for multimodal dialogue systems04:24
Multimodal dialogue systems and synergies06:12
Interaction modes evaluated07:07
System demo (desktop version)08:39
PDA environment: “Modality selection” example10:01
Evaluation and mode statistics10:49
Modality selection and unimodal efficiency (context statistics)11:32
Evaluation of multimodal form filling systems12:30
Relative modality efficiency13:25
Multimodal synergy14:12
Random multimodal synergy14:50
Relative speech efficiency for the four contexts15:24
Relative speech efficiency for the three modes16:39
Relative speech efficiency for mode/context17:01
Relative speech efficiency for the eight users17:25
Relative speech efficiency for users & contexts17:43
Results: Synergy and multimodal modes18:28
Results: Synergy and contexts21:17
Results: Synergy and users - 121:39
Results: Synergy and users - 222:00
Summary22:09