On-line language model biasing for multi-pass automatic speech recognition

Sankaranarayanan Ananthakrishnan, Stavros Tsakalidis, Rohit Prasad, Premkumar Natarajan

a probability distribution over the hypothesis space. In typical use, the LM is trained off-line and remains static at run-time. While cache LMs, dialogue/style adaptation, and information retrieval-based biasing provide some ability for modifying the LM at run-time, they are limited in scope, susceptible to recognition error, place restrictions on the training data and/or test sets, or cannot be implemented for on-line, interactive systems. In this paper, we describe a novel LM biasing method suitable for multi-pass ASR systems. We use k-best lists from the initial recognition pass to obtain a confidence-weighted biasing of the LM training corpus. The latter is used to train a LM biased to the test input. The biased LM is used in the second pass to obtain refined hypotheses either by re-decoding or by re-ranking the k-best list. We sketch an on-line implementation of this scheme that lends itself to integration within low-latency systems. The proposed method is robust to recognition error, and operates on individual utterances without the need for dialogue context. The biased LMs provide significant reduction in perplexity and consistent improvement in word error rate (WER) over unbiased, state-of-the-art, large-vocabulary baseline ASR systems. On the Farsi and English test sets, we obtained relative reductions in perplexity of 24.5% and 31.6%, respectively. Additionally, relative reductions of 1.6% and 1.8% in WER were obtained for large-vocabulary Farsi and English ASR, respectively.

doi: 10.21437/Interspeech.2011-246

Cite as: Ananthakrishnan, S., Tsakalidis, S., Prasad, R., Natarajan, P. (2011) On-line language model biasing for multi-pass automatic speech recognition. Proc. Interspeech 2011, 621-624, doi: 10.21437/Interspeech.2011-246

@inproceedings{ananthakrishnan11_interspeech,
  author={Sankaranarayanan Ananthakrishnan and Stavros Tsakalidis and Rohit Prasad and Premkumar Natarajan},
  title={{On-line language model biasing for multi-pass automatic speech recognition}},
  year=2011,
  booktitle={Proc. Interspeech 2011},
  pages={621--624},
  doi={10.21437/Interspeech.2011-246}
}