In conversational dialogue systems, users prefer to speak at any time and to use natural expressions. We have developed an Independent Component Analysis (ICA) based semi-blind source separation method, which allows users to barge-in over system utterances at any time. We created a novel method from timing information derived from barge-in utterances to identify one item that a user indicates during system enumeration. First, we determine the timing distribution of user utterances containing referential expressions and then approximate it using a gamma distribution. Second, we represent both the utterance timing and automatic speech recognition (ASR) results as probabilities of the desired selection from the systems enumeration. We then integrate these two probabilities to identify the item having the maximum likelihood of selection. Experimental results using 400 utterances indicated that our method outperformed two methods used as a baseline (one of ASR results only and one of utterance timing only) in identification accuracy.
Cite as: Matsuyama, K., Komatani, K., Ogata, T., Okuno, H.G. (2009) Enabling a user to specify an item at any time during system enumeration - item identification for barge-in-able conversational dialogue systems. Proc. Interspeech 2009, 252-255, doi: 10.21437/Interspeech.2009-88
@inproceedings{matsuyama09_interspeech,
author={Kyoko Matsuyama and Kazunori Komatani and Tetsuya Ogata and Hiroshi G. Okuno},
title={{Enabling a user to specify an item at any time during system enumeration - item identification for barge-in-able conversational dialogue systems}},
year=2009,
booktitle={Proc. Interspeech 2009},
pages={252--255},
doi={10.21437/Interspeech.2009-88}
}