Improving Voice Trigger Detection with Metric Learning

Prateeth Nayak, Takuya Higuchi, Anmol Gupta, Shivesh Ranjan, Stephen Shum, Siddharth Sigtia, Erik Marchi, Varun Lakshminarasimhan, Minsik Cho, Saurabh Adya, Chandra Dhir, Ahmed Tewfik

Voice trigger detection is an important task, which enables activating a voice assistant when a target user speaks a keyword phrase. A detector is typically trained on speech data independent of speaker information and used for the voice trigger detection task. However, such a speaker independent voice trigger detector typically suffers from performance degradation on speech from underrepresented groups, such as accented speakers. In this work, we propose a novel voice trigger detector that can use a small number of utterances from a target speaker to improve detection accuracy. Our proposed model employs an encoder-decoder architecture. While the encoder performs speaker independent voice trigger detection, similar to the conventional detector, the decoder is trained with metric learning and predicts a personalized embedding for each utterance. A personalized voice trigger score is then obtained as a similarity score between the embeddings of enrollment utterances and a test utterance. The personalized embedding allows adapting to target speaker's speech when computing the voice trigger score, hence improving voice trigger detection accuracy. Experimental results show that the proposed approach achieves a 38\% relative reduction in a false rejection rate (FRR) compared to a baseline speaker independent voice trigger model.

doi: 10.21437/Interspeech.2022-11160

Cite as: Nayak, P., Higuchi, T., Gupta, A., Ranjan, S., Shum, S., Sigtia, S., Marchi, E., Lakshminarasimhan, V., Cho, M., Adya, S., Dhir, C., Tewfik, A. (2022) Improving Voice Trigger Detection with Metric Learning. Proc. Interspeech 2022, 1896-1900, doi: 10.21437/Interspeech.2022-11160

@inproceedings{nayak22_interspeech,
  author={Prateeth Nayak and Takuya Higuchi and Anmol Gupta and Shivesh Ranjan and Stephen Shum and Siddharth Sigtia and Erik Marchi and Varun Lakshminarasimhan and Minsik Cho and Saurabh Adya and Chandra Dhir and Ahmed Tewfik},
  title={{Improving Voice Trigger Detection with Metric Learning}},
  year=2022,
  booktitle={Proc. Interspeech 2022},
  pages={1896--1900},
  doi={10.21437/Interspeech.2022-11160}
}