We present the first demonstration version of the WITAS dialogue system for multi-modal conversations with autonomous mobile robots, and motivate several innovations currently in development for version II. The human-robot interaction setting is argued to present new challenges for dialogue system engineers, in comparison to previous work in dialogue systems under the travel-planning paradigm, in that dialogues must be asynchronous, mixed-initiative, open-ended, and involve a dynamic environment. We approached these general problems in a dialogue interface to the WITAS robot helicopter, or UAV (`Unmanned Aerial Vehicle'). We present this system and the modelling ideas behind it, and then motivate changes being made for version II of the system, involving more richly structured dialogue states and the use of automated reasoning systems over task, ability, and world-state models. We argue that these sorts of enhancement are vital to the future development of conversational systems.
Cite as: Lemon, O., Bracy, A., Gruenstein, A., Peters, S. (2001) The WITAS multi-modal dialogue system I. Proc. 7th European Conference on Speech Communication and Technology (Eurospeech 2001), 1559-1562, doi: 10.21437/Eurospeech.2001-350
@inproceedings{lemon01_eurospeech,
author={Oliver Lemon and Anne Bracy and Alexander Gruenstein and Stanley Peters},
title={{The WITAS multi-modal dialogue system I}},
year=2001,
booktitle={Proc. 7th European Conference on Speech Communication and Technology (Eurospeech 2001)},
pages={1559--1562},
doi={10.21437/Eurospeech.2001-350}
}