Multimodal dialog in the car: combining speech and turn-and-push dial to control comfort functions

Sandro Castronovo, Angela Mahr, Margarita Pentcheva, Christian Müller

In this paper, we address the question how speech and tangible interfaces can be combined in order to provide effective multimodal interaction in vehicles, taking into account the special requirements induced by the circumstances of driving. Speech is used to set the interaction context and a turn-and-push dial is used to manipulate/adjust. An experimental study is presented that measures the distraction induced by manual, speech-only, and multimodal interaction (combination of speech and turn-and-push dial). Results show that while subjects where able to perform more tasks in the manual condition, their driving was significantly safer with using speech-only or multimodal dialog. Supplemental contributions of this paper are descriptions of how a multimodal dialog manager as well as a driving simulation software are connected to the CAN vehicle bus as well as how driver distraction caused by interacting with a system are measured using the standardized lane change task.

doi: 10.21437/Interspeech.2010-210

Cite as: Castronovo, S., Mahr, A., Pentcheva, M., Müller, C. (2010) Multimodal dialog in the car: combining speech and turn-and-push dial to control comfort functions. Proc. Interspeech 2010, 510-513, doi: 10.21437/Interspeech.2010-210

@inproceedings{castronovo10_interspeech,
  author={Sandro Castronovo and Angela Mahr and Margarita Pentcheva and Christian Müller},
  title={{Multimodal dialog in the car: combining speech and turn-and-push dial to control comfort functions}},
  year=2010,
  booktitle={Proc. Interspeech 2010},
  pages={510--513},
  doi={10.21437/Interspeech.2010-210}
}