Uncertainty-driven compensation of multi-stream MLP acoustic models for robust ASR ramon

Ramón Fernandez Astudillo, Alberto Abad, João Paulo da Silva Neto

In this paper we show how the robustness of multi-stream multi-layer perceptron (MLP) acoustic models can be increased through uncertainty propagation and decoding. We demonstrate that MLP uncertainty decoding yields consistent improvements over using minimum mean square error (MMSE) feature enhancement in MFCC and RASTA-LPCC domains. We introduce as well formulas for the computation of the uncertainty associated to the acoustic likelihood computation and explore different stream integration schemes using this uncertainty on the AURORA4 corpus.

Index Terms: uncertainty propagation, observation uncertainty, MLP, multi-stream

doi: 10.21437/Interspeech.2012-17

Cite as: Fernandez Astudillo, R., Abad, A., Neto, J.P.d.S. (2012) Uncertainty-driven compensation of multi-stream MLP acoustic models for robust ASR ramon. Proc. Interspeech 2012, 2606-2609, doi: 10.21437/Interspeech.2012-17

@inproceedings{fernandezastudillo12_interspeech,
  author={Ramón {Fernandez Astudillo} and Alberto Abad and João Paulo da Silva Neto},
  title={{Uncertainty-driven compensation of multi-stream MLP acoustic models for robust ASR ramon}},
  year=2012,
  booktitle={Proc. Interspeech 2012},
  pages={2606--2609},
  doi={10.21437/Interspeech.2012-17}
}